|
9b78e268c9
|
Nearly working crawler
|
2018-02-22 14:33:07 +01:00 |
|
|
e19e623df1
|
Multiple bug fixes. TODO : remove <div id=footer>-like patterns
|
2018-02-22 14:07:53 +01:00 |
|
|
5decd205fb
|
Typos + improvements
|
2018-02-22 11:06:45 +01:00 |
|
|
236e15296c
|
It can be useful to return the links list
|
2018-02-21 23:11:57 +01:00 |
|
|
4e6ac5ac7b
|
Url getter function : retrieves the list of so-called relevant links
|
2018-02-21 22:51:05 +01:00 |
|
|
a907cad33d
|
Start of url getter function
|
2018-02-21 19:06:46 +01:00 |
|
|
ad0ad0a783
|
Command to add browser fingerprint data
|
2018-02-21 16:50:27 +01:00 |
|
|
b05e642c79
|
Make the code somewhat readable
|
2018-02-21 11:54:41 +01:00 |
|
|
cd4d8a4c3f
|
More generic code using @8f4458b
|
2018-02-21 11:50:28 +01:00 |
|
|
8f4458b009
|
Url generation method, for more genericity
|
2018-02-21 11:37:44 +01:00 |
|
|
5539f57139
|
Add missing docstrings
|
2018-02-21 11:35:53 +01:00 |
|
|
4920de5838
|
Going on in the generation of history
|
2018-02-20 23:42:21 +01:00 |
|
|
c97acb22b5
|
Add tentative crawl file
Nothing functional, just tests
|
2018-02-20 12:48:53 +01:00 |
|
|
c05c2561d2
|
Add crawler settings and requirements
|
2018-02-20 12:48:16 +01:00 |
|
|
bef1fca5b9
|
Init app 'crawl'
|
2018-02-20 08:51:16 +01:00 |
|
|
7c13ee17d4
|
Skeleton of history generation
|
2018-02-19 22:56:16 +01:00 |
|
|
7f343d8ad8
|
Better formatting
|
2018-02-19 13:59:29 +01:00 |
|
|
3b0fa27951
|
Add histories application to settings file
|
2018-02-19 13:59:29 +01:00 |
|
|
60f09bd4d3
|
Add basic models for histories
|
2018-02-19 13:58:55 +01:00 |
|
|
924657abdb
|
Generate profiles' migration
|
2018-01-24 22:49:34 +01:00 |
|
|
e9b3127226
|
Use profiles as an installed application in pinocchio
|
2018-01-24 22:49:08 +01:00 |
|
|
cbf1911fe7
|
Add models for Interest and Profile
|
2018-01-24 22:48:53 +01:00 |
|
|
37581fb96a
|
Add models for Place and Event
|
2018-01-24 22:39:20 +01:00 |
|
|
6531415d63
|
Add model for a webpage and website
|
2018-01-24 14:09:33 +01:00 |
|
|
114c8a3d3e
|
Add model for search engines
|
2018-01-24 13:52:43 +01:00 |
|
|
225742798b
|
Add BrowserFingerprint model
|
2018-01-24 13:36:55 +01:00 |
|
|
a3e6308837
|
Init apps histories and profiles
|
2018-01-23 18:12:47 +01:00 |
|
|
397784a673
|
Add first version of requirements.txt
Mainly Django, by now
|
2018-01-23 18:11:07 +01:00 |
|
|
132b7250c8
|
Initialize Django
|
2018-01-23 18:11:00 +01:00 |
|
|
c1e3be346f
|
Initial commit
|
2018-01-23 17:53:08 +01:00 |
|