Commit graph

21 commits

Author SHA1 Message Date
a4de51b84a Crawl: do not use global SEARCH_ENGINES 2018-02-26 11:48:51 +01:00
4a8bd32516 Fix tor_runner import 2018-02-26 11:48:51 +01:00
adb892ab7d Check if crawling a search engine 2018-02-26 11:12:36 +01:00
d6b26c0a46 Better use of history 2018-02-26 10:05:33 +01:00
8f5c4f3f0f Use datetimes 2018-02-26 09:49:24 +01:00
71d9e18eec Add headers support 2018-02-25 23:56:51 +01:00
8ad46c0481 Bug fix, syntax erro 2018-02-25 21:59:29 +01:00
f66c978466 Tor runner has a run function to replay the history 2018-02-25 21:53:28 +01:00
0a676a2f65 PEP8 2018-02-25 21:34:20 +01:00
e074d96f02 tor_runner can make requests 2018-02-25 21:27:15 +01:00
ae5699c089 Basic tor runner 2018-02-25 19:42:58 +01:00
7c0fb7dda1 Better naming 2018-02-25 11:49:44 +01:00
bc7348f677 Integration of crawl module in histories 2018-02-24 23:17:24 +01:00
854481dbd3 Import utilities 2018-02-24 17:21:41 +01:00
5decd205fb Typos + improvements 2018-02-22 11:06:45 +01:00
cd4d8a4c3f More generic code using @8f4458b 2018-02-21 11:50:28 +01:00
4920de5838 Going on in the generation of history 2018-02-20 23:42:21 +01:00
7c13ee17d4 Skeleton of history generation 2018-02-19 22:56:16 +01:00
7f343d8ad8 Better formatting 2018-02-19 13:59:29 +01:00
60f09bd4d3 Add basic models for histories 2018-02-19 13:58:55 +01:00
a3e6308837 Init apps histories and profiles 2018-01-23 18:12:47 +01:00