2026-06-25 08:30:08 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: ZomatoDailyReportingData) 2026-06-25 08:30:08 [scrapy.utils.log] INFO: Versions: lxml 6.0.2.0, libxml2 2.14.6, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 25.5.0, Python 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0], pyOpenSSL 25.1.0 (OpenSSL 3.5.2 5 Aug 2025), cryptography 45.0.6, Platform Linux-6.17.0-1013-aws-x86_64-with-glibc2.39 2026-06-25 08:30:08 [scrapy.addons] INFO: Enabled addons: [] 2026-06-25 08:30:08 [asyncio] DEBUG: Using selector: EpollSelector 2026-06-25 08:30:08 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-06-25 08:30:08 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-06-25 08:30:08 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-06-25 08:30:08 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-06-25 08:30:08 [scrapy.extensions.telnet] INFO: Telnet Password: 4a524ef760dfbb58 2026-06-25 08:30:08 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats'] 2026-06-25 08:30:08 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'ZomatoDailyReportingData', 'CONCURRENT_REQUESTS': 8, 'DOWNLOAD_DELAY': 0.5, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/home/ubuntu/logs/ZomatoDailyReportingData/zomato_daily_reporting_data/111ca945707011f195a70aab37b1cebd.log', 'NEWSPIDER_MODULE': 'ZomatoDailyReportingData.spiders', 'SPIDER_MODULES': ['ZomatoDailyReportingData.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'} 2026-06-25 08:30:09 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-06-25 08:30:09 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-06-25 08:30:09 [scrapy.middleware] INFO: Enabled item pipelines: ['ZomatoDailyReportingData.pipelines.ZomatodailyreportingdataPipeline'] 2026-06-25 08:30:09 [scrapy.core.engine] INFO: Spider opened 2026-06-25 08:30:09 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-06-25 08:30:09 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024 2026-06-25 08:30:09 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:116: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. 2026-06-25 08:30:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:11 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:12 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:12 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:13 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:14 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:14 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:15 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:16 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:19 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:20 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:27 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:43 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:30:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:50 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:07 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:08 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:08 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:08 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:09 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 96 pages/min), scraped 77 items (at 77 items/min) 2026-06-25 08:31:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:15 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:17 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:18 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:25 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [] 2026-06-25 08:31:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:29 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:36 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [] 2026-06-25 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:37 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): [] 2026-06-25 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:49 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:50 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:31:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:09 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 93 pages/min), scraped 157 items (at 80 items/min) 2026-06-25 08:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:32:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:14 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:32:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:33 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:32:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:34 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:32:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:47 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:32:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:48 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:32:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:32:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:09 [scrapy.extensions.logstats] INFO: Crawled 285 pages (at 96 pages/min), scraped 247 items (at 90 items/min) 2026-06-25 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:33:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:33:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:40 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 268, in get_reporting_data data_to_upload["menu_to_cart_percentage"] TypeError: unsupported operand type(s) for *: 'NoneType' and 'float' 2026-06-25 08:33:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:46 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:33:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:46 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:33:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:50 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:33:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:51 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:33:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:33:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:04 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 268, in get_reporting_data data_to_upload["menu_to_cart_percentage"] TypeError: unsupported operand type(s) for *: 'NoneType' and 'float' 2026-06-25 08:34:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:09 [scrapy.extensions.logstats] INFO: Crawled 386 pages (at 101 pages/min), scraped 340 items (at 93 items/min) 2026-06-25 08:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:25 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:26 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:26 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:27 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:27 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:28 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:29 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:30 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:34:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:34:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:02 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:03 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:03 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:04 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:04 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:05 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:06 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:06 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:09 [scrapy.extensions.logstats] INFO: Crawled 484 pages (at 98 pages/min), scraped 422 items (at 82 items/min) 2026-06-25 08:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:35:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:35:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:35:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:12 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:35:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:13 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:35:14 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24 took longer than 180.0 seconds.. 2026-06-25 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:19 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:20 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:35:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:21 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:30 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:34 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:37 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:38 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:41 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:46 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:47 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:48 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:50 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:51 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:54 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:54 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:54 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:55 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:55 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:56 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:56 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:57 [scrapy.core.engine] DEBUG: Crawled (401) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:57 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <401 https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite>: HTTP status code is not handled or not allowed 2026-06-25 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:57 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:58 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:58 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:58 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py:160: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy. comp_response = pd.read_sql_query(comp_query, self.conn) 2026-06-25 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:00 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:01 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:03 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:03 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:09 [scrapy.extensions.logstats] INFO: Crawled 579 pages (at 95 pages/min), scraped 502 items (at 80 items/min) 2026-06-25 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:09 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:10 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:10 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260623' 2026-06-25 08:36:11 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:11 [scrapy.core.scraper] ERROR: Spider error processing (referer: https://www.zomato.com/partners/login) Traceback (most recent call last): File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback yield next(it) ^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__ return next(self.data) ^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in return (self._set_referer(r, response) for r in result) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in return (r for r in result if self._filter(r, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in return (r for r in result if self._filter(r, response, spider)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync yield from iterable File "/home/ubuntu/eggs/ZomatoDailyReportingData/1774845340.egg/ZomatoDailyReportingData/spiders/ReportingDailyData.py", line 236, in get_reporting_data data_to_upload[row_data["metric"]["value"].replace(" ","_")] = row_data[ ^^^^^^^^^ KeyError: '20260624' 2026-06-25 08:36:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.zomato.com/partners/login) 2026-06-25 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/owner-hub/reporting/get-business-report?view=table&selected_res_id=0&time_filter=ist_day&page_type=owner_hub&start_date=2026-06-18&end_date=2026-06-24> None 2026-06-25 08:36:18 [scrapy.core.engine] INFO: Closing spider (finished) 2026-06-25 08:36:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/exception_count': 4, 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 1, 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 3, 'downloader/request_bytes': 3397173, 'downloader/request_count': 598, 'downloader/request_method_count/GET': 34, 'downloader/request_method_count/POST': 564, 'downloader/response_bytes': 13915651, 'downloader/response_count': 594, 'downloader/response_status_count/200': 593, 'downloader/response_status_count/401': 1, 'elapsed_time_seconds': 369.959221, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 6, 25, 8, 36, 19, 18149, tzinfo=datetime.timezone.utc), 'httperror/response_ignored_count': 1, 'httperror/response_ignored_status_count/401': 1, 'item_scraped_count': 512, 'items_per_minute': None, 'log_count/DEBUG': 1115, 'log_count/ERROR': 48, 'log_count/INFO': 17, 'log_count/WARNING': 34, 'memusage/max': 145027072, 'memusage/startup': 130383872, 'request_depth_max': 1, 'response_received_count': 594, 'responses_per_minute': None, 'retry/count': 4, 'retry/reason_count/twisted.internet.error.TimeoutError': 1, 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 3, 'scheduler/dequeued': 598, 'scheduler/dequeued/memory': 598, 'scheduler/enqueued': 598, 'scheduler/enqueued/memory': 598, 'spider_exceptions/KeyError': 46, 'spider_exceptions/TypeError': 2, 'start_time': datetime.datetime(2026, 6, 25, 8, 30, 9, 58928, tzinfo=datetime.timezone.utc)} 2026-06-25 08:36:19 [scrapy.core.engine] INFO: Spider closed (finished)