Scrapyd
Scrapy projects:
- OrdersData
- SwiggyAds
- SwiggyComplaintsData
- SwiggyDailyReportingData
- SwiggyItemOnOff
- SwiggyOrdersORS
- SwiggyOutletOnOff
- SwiggyOutletTiming
- SwiggyPayoutData
- SwiggyReviewData
- ZomatoAds
- ZomatoAdsCampaignData
- ZomatoComplaintData
- ZomatoDailyReportingData
- ZomatoItemOnOff
- ZomatoOrderHistory
- ZomatoOutletOnOff
- ZomatoOutletTiming
- ZomatoPageRating
- ZomatoPayoutData
- ZomatoReviewData
This web UI is for monitoring only. To upload projects and schedule crawls, use the API.
For example, using curl:
curl http://localhost:6800/schedule.json -d project=default -d spider=somespider
See the Scrapyd documentation for details.