108 Commits (master)
 

Author SHA1 Message Date
Rémi Oudin 89d1f8301a Remove duplicated url in history 5 years ago
Théophile Bastian 379b53e6ce Fix printing in gen_history 5 years ago
Théophile Bastian c94841c17b Add gen_history django-admin command 5 years ago
Rémi Oudin 97107d9bec Merge branch 'master' of git.tobast.fr:tobast/mpri-webdam 5 years ago
Rémi Oudin dedc66bb9d Bug fix 5 years ago
Théophile Bastian d3d04739e7 Add DuckDuckGo lite search engine to stock data 5 years ago
Théophile Bastian b88aeffd5a Helpful README 5 years ago
Rémi Oudin 7c8ec7351c Merge branch 'master' of git.tobast.fr:tobast/mpri-webdam 5 years ago
Théophile Bastian 2005c0f24f Add xml string gen 5 years ago
Rémi Oudin 392e16b797 Merge branch 'histories_models' 5 years ago
Théophile Bastian 185c1cf8a4 Fix XML generation 5 years ago
Rémi Oudin 9dd1954067 Partial runner fix 5 years ago
Rémi Oudin 04270e88c0 Bug fix 5 years ago
Théophile Bastian 6bc64ceb7a Add requirement for aiohttp 5 years ago
Rémi Oudin 15e0c2a11c Partial runner fix 5 years ago
Rémi Oudin 2b07779f5c Bug fix 5 years ago
Théophile Bastian 8cdc50c04e Fix stupid typo 5 years ago
Rémi Oudin 22fa039f1b Remove debug print 5 years ago
Théophile Bastian e4ad8c7ce6 Towards a working XML export 5 years ago
Théophile Bastian 67ad232533 Add a timeout to a single page retrieval 5 years ago
Théophile Bastian e140d4a8a7 Fix merge remanences 5 years ago
Théophile Bastian 98fe69ba62 Real async crawling 5 years ago
Théophile Bastian 968ff6d24c More robust crawling 5 years ago
Rémi Oudin 5d4bd30e20 Exception handling 5 years ago
Rémi Oudin bdfa285e6b We do not want to use settings 5 years ago
Rémi Oudin 65f777f00f Should get the objects and not the Manager 5 years ago
Rémi Oudin 236e40d359 Sanity check 5 years ago
Rémi Oudin 22017cea91 Typo in data u_u 5 years ago
Rémi Oudin 549c861908 Bug fixé 5 years ago
Rémi Oudin 517be1d822 Merge rdf branch 5 years ago
Rémi Oudin c4f63a92b2 Error in the merge, mea culpa 5 years ago
Rémi Oudin db067e56fc Typo 5 years ago
Rémi Oudin 33bdae96e4 merge commit from histories_tobast into histories_models 5 years ago
Rémi Oudin 526aad1364 Add interests 5 years ago
Théophile Bastian 02e91bb2b7 Fix function calls 5 years ago
Théophile Bastian 3e5fc2f9b3 Fix search engine URL generation 5 years ago
Théophile Bastian 45ddbff91a Crawling and histories: fix a lot of stuff 5 years ago
Théophile Bastian e6d587bffd Actually save to DB a created history 5 years ago
Théophile Bastian 8baf408e02 Use dict from data/nicknames_dict for nicknames 5 years ago
Théophile Bastian 6463e348ac Fix populate.sh exec path 5 years ago
Théophile Bastian 22064ebee3 Histories: xml import/export — untested 5 years ago
Théophile Bastian a4de51b84a Crawl: do not use global SEARCH_ENGINES 5 years ago
Théophile Bastian 4f0148cb63 Crawler: use a random fingerprint 5 years ago
Théophile Bastian 4a8bd32516 Fix tor_runner import 5 years ago
Rémi Oudin 44cf26df8f It can be useful to save a new object 5 years ago
Rémi Oudin adb892ab7d Check if crawling a search engine 5 years ago
Rémi Oudin 15db8b4697 Change option name due to downgrade of aiohttp 5 years ago
Rémi Oudin d6b26c0a46 Better use of history 5 years ago
Rémi Oudin 8f5c4f3f0f Use datetimes 5 years ago
Rémi Oudin 71d9e18eec Add headers support 5 years ago