Commit Graph

20 Commits

Author SHA1 Message Date
Jordan ERNST 6ce018418a Last changes 2021-12-12 21:58:25 +01:00
Jordan ERNST ec7acf9308 PricePerSqm Pipeline 2020-08-16 18:55:03 +02:00
Jordan ERNST 828035e166 WIP: pipelines, code cleanup, export now to JSON 2020-08-16 18:10:59 +02:00
Jordan ERNST 34e577a794 Adding CSV export 2020-08-16 17:33:24 +02:00
Jordan ERNST 03c60c98cf Set LOG_LEVEL to WARNING 2020-08-16 01:26:33 +02:00
Jordan ERNST 214c351efc Disable cookies, added download delay 2020-08-16 01:23:04 +02:00
Jordan ERNST 0655c01cc9 Added User-Agent rotation 2020-08-16 01:13:20 +02:00
Jordan ERNST 3771e4d507 Make sure Telnet extension is disabled 2020-08-12 22:52:17 +02:00
Jordan ERNST d42cc51088 Launch spriders from main Immoscrap.py script 2020-08-12 22:36:22 +02:00
Jordan ERNST 1e18327a9e Simplify start_requests: https://docs.scrapy.org/en/latest/intro/tutorial.html#a-shortcut-to-the-start-requests-method 2020-08-11 12:18:24 +02:00
Jordan ERNST 814aea4e66 Unify yield values + leboncoin: Fixes 2020-08-03 23:31:38 +02:00
Jordan ERNST 7e58f445a5 leboncoin: St-Etienne added 2020-08-02 20:32:37 +02:00
Jordan ERNST ccf5ddda5b leboncoin: parsing OK, time to add St-Etienne 2020-08-02 17:21:17 +02:00
Jordan ERNST 251f3c107e PAP: Added Saint-Etienne 2020-08-02 16:41:03 +02:00
Jordan ERNST cadd198b3d rm cached files 2020-07-18 19:47:03 +02:00
Jordan ERNST 7693e0c9d7 Added .gitignore 2020-07-18 18:12:43 +02:00
Jordan ERNST 2e52581737 Leboncoin working, need to parse now 2020-07-03 12:59:24 +02:00
Jordan ERNST 42ad03f6e4 Added PAP spider 2020-07-02 13:02:05 +02:00
Jordan ERNST 9a2cc429d0 Fixed 2020-07-02 10:28:26 +02:00
Jordan ERNST c1ee5eba52 Initial commit 2020-07-02 08:40:13 +02:00