Web scraping freelancer's routine working days - debugging SCRAPY spider's pagination crawling logic
Автор: Monkey see, monkey do
Загружено: 2020-04-07
Просмотров: 651
Hey what's up guys, in this video I'm debugging the onthemarket web scraper that we've created in one of my previous videos, so I sent the code to the client and there was an issue regarding pagination crawling logic, so I'm fixing it until discover that the problem was in inappropriate resetting of page counter variable that eventually led the scraper to crawl pages that doesn't exists, hence eventually being redirected to the base url.
Original OnTheMarket web scraping tutorial
• Working LIVE on FREELANCE PROJECT | Scrapi...
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке: