aboutsummaryrefslogtreecommitdiff
path: root/pyaggr3g470r/crawler.py
Commit message (Expand)AuthorAge
* Log 'bozo' exception.Cédric Bonhomme2014-11-08
* Configuration variables has been updated.Cédric Bonhomme2014-08-18
* minor changes.Cédric Bonhomme2014-07-13
* Timeout of 5 seconds for all sockets.Cédric Bonhomme2014-07-13
* Update headers tags.Cédric Bonhomme2014-07-13
* Performance improvement for the crawler (database insertion step).Cédric Bonhomme2014-07-13
* Minor improvemnts for the crawler.Cédric Bonhomme2014-07-13
* if the crawler is not able to get the link of the article, continue.Cédric Bonhomme2014-06-21
* fixes #7Cédric Bonhomme2014-06-10
* making pyagregator runnable by apacheFrançois Schmidts2014-06-09
* supporting feed without date or with ill formated dateFrançois Schmidts2014-06-08
* Removed unused variable.Cédric Bonhomme2014-05-03
* keep the original title.Cédric Bonhomme2014-05-03
* Using lxml parser instead of html.parser, fixes #4.Cédric Bonhomme2014-05-03
* Better to send email without Flask-Mail.Cédric Bonhomme2014-04-27
* Improved code readability.Cédric Bonhomme2014-04-27
* Cleaned code.Cédric Bonhomme2014-04-27
* Separate indexes by users.Cédric Bonhomme2014-04-23
* Autoindexation of new articles (not on Heroku).Cédric Bonhomme2014-04-23
* Updated comments and log messages.Cédric Bonhomme2014-04-13
* Removed old feedgetter module.Cédric Bonhomme2014-04-13
* Test of the new crawler with gevent.Cédric Bonhomme2014-04-13
bgstack15