 Rémi Oudin
|
89d1f8301a
|
Remove duplicated url in history
|
2018-02-26 17:46:49 +01:00 |
 Théophile Bastian
|
379b53e6ce
|
Fix printing in gen_history
|
2018-02-26 17:25:04 +01:00 |
|
Théophile Bastian
|
c94841c17b
|
Add gen_history django-admin command
|
2018-02-26 17:25:04 +01:00 |
|
Rémi Oudin
|
dedc66bb9d
|
Bug fix
|
2018-02-26 17:12:19 +01:00 |
|
Théophile Bastian
|
2005c0f24f
|
Add xml string gen
|
2018-02-26 17:03:27 +01:00 |
|
Théophile Bastian
|
185c1cf8a4
|
Fix XML generation
|
2018-02-26 17:00:53 +01:00 |
|
Rémi Oudin
|
9dd1954067
|
Partial runner fix
|
2018-02-26 17:00:53 +01:00 |
|
Théophile Bastian
|
8cdc50c04e
|
Fix stupid typo
|
2018-02-26 16:34:43 +01:00 |
|
Théophile Bastian
|
e4ad8c7ce6
|
Towards a working XML export
|
2018-02-26 15:58:30 +01:00 |
|
Théophile Bastian
|
e140d4a8a7
|
Fix merge remanences
|
2018-02-26 15:37:05 +01:00 |
|
Théophile Bastian
|
98fe69ba62
|
Real async crawling
|
2018-02-26 15:30:38 +01:00 |
|
Théophile Bastian
|
968ff6d24c
|
More robust crawling
|
2018-02-26 15:29:36 +01:00 |
|
Rémi Oudin
|
5d4bd30e20
|
Exception handling
|
2018-02-26 15:15:03 +01:00 |
|
Rémi Oudin
|
236e40d359
|
Sanity check
|
2018-02-26 14:57:46 +01:00 |
|
Rémi Oudin
|
549c861908
|
Bug fixé
|
2018-02-26 14:38:26 +01:00 |
|
Rémi Oudin
|
c4f63a92b2
|
Error in the merge, mea culpa
|
2018-02-26 14:01:29 +01:00 |
|
Théophile Bastian
|
45ddbff91a
|
Crawling and histories: fix a lot of stuff
|
2018-02-26 11:49:24 +01:00 |
|
Théophile Bastian
|
e6d587bffd
|
Actually save to DB a created history
|
2018-02-26 11:49:24 +01:00 |
|
Théophile Bastian
|
22064ebee3
|
Histories: xml import/export — untested
To be tested when history generation is available
|
2018-02-26 11:48:51 +01:00 |
|
Théophile Bastian
|
a4de51b84a
|
Crawl: do not use global SEARCH_ENGINES
|
2018-02-26 11:48:51 +01:00 |
|
Théophile Bastian
|
4a8bd32516
|
Fix tor_runner import
|
2018-02-26 11:48:51 +01:00 |
|
Rémi Oudin
|
adb892ab7d
|
Check if crawling a search engine
|
2018-02-26 11:12:36 +01:00 |
|
Rémi Oudin
|
d6b26c0a46
|
Better use of history
|
2018-02-26 10:05:33 +01:00 |
|
Rémi Oudin
|
8f5c4f3f0f
|
Use datetimes
|
2018-02-26 09:49:24 +01:00 |
|
Rémi Oudin
|
71d9e18eec
|
Add headers support
|
2018-02-25 23:56:51 +01:00 |
|
Rémi Oudin
|
8ad46c0481
|
Bug fix, syntax erro
|
2018-02-25 21:59:29 +01:00 |
|
Rémi Oudin
|
f66c978466
|
Tor runner has a run function to replay the history
|
2018-02-25 21:53:28 +01:00 |
|
Rémi Oudin
|
0a676a2f65
|
PEP8
|
2018-02-25 21:34:20 +01:00 |
|
Rémi Oudin
|
e074d96f02
|
tor_runner can make requests
|
2018-02-25 21:27:15 +01:00 |
|
Rémi Oudin
|
ae5699c089
|
Basic tor runner
|
2018-02-25 19:42:58 +01:00 |
|
Rémi Oudin
|
7c0fb7dda1
|
Better naming
|
2018-02-25 11:49:44 +01:00 |
|
Rémi Oudin
|
bc7348f677
|
Integration of crawl module in histories
|
2018-02-24 23:17:24 +01:00 |
|
Rémi Oudin
|
854481dbd3
|
Import utilities
|
2018-02-24 17:21:41 +01:00 |
|
Rémi Oudin
|
5decd205fb
|
Typos + improvements
|
2018-02-22 11:06:45 +01:00 |
|
Rémi Oudin
|
cd4d8a4c3f
|
More generic code using @8f4458b
|
2018-02-21 11:50:28 +01:00 |
|
Rémi Oudin
|
4920de5838
|
Going on in the generation of history
|
2018-02-20 23:42:21 +01:00 |
|
Rémi Oudin
|
7c13ee17d4
|
Skeleton of history generation
|
2018-02-19 22:56:16 +01:00 |
|
Rémi Oudin
|
7f343d8ad8
|
Better formatting
|
2018-02-19 13:59:29 +01:00 |
|
Rémi Oudin
|
60f09bd4d3
|
Add basic models for histories
|
2018-02-19 13:58:55 +01:00 |
|
Théophile Bastian
|
a3e6308837
|
Init apps `histories` and `profiles`
|
2018-01-23 18:12:47 +01:00 |