'How to call same start_urls for different search codes in scrapy
Apologies in advance, if my question sounds pretty lame.
As per my crawling requirements, I need to hit 1 url and search for 1 item at a time in the search box from the list of itemcodes. If i give the base url in start_urls, parse method will be called only once and all items will not be processed. How do I make sure
- to have concurrent processing of different itemcodes
- to process all itemcodes by having a single start_url
Ex: items_list = ['A', 'B', 'C'], need to process items in items_list concurrently with same start_url
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|