2026-06-22 08:28:28 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: ZomatoAdsCampaignData)
2026-06-22 08:28:28 [scrapy.utils.log] INFO: Versions: lxml 6.0.2.0, libxml2 2.14.6, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 25.5.0, Python 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0], pyOpenSSL 25.1.0 (OpenSSL 3.5.2 5 Aug 2025), cryptography 45.0.6, Platform Linux-6.17.0-1013-aws-x86_64-with-glibc2.39
2026-06-22 08:28:28 [scrapy.addons] INFO: Enabled addons:
[]
2026-06-22 08:28:28 [asyncio] DEBUG: Using selector: EpollSelector
2026-06-22 08:28:28 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-22 08:28:28 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-22 08:28:28 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-22 08:28:28 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-22 08:28:28 [scrapy.extensions.telnet] INFO: Telnet Password: 80cc7fd54e092a13
2026-06-22 08:28:28 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats']
2026-06-22 08:28:28 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'ZomatoAdsCampaignData',
 'DOWNLOAD_DELAY': 0.5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/logs/ZomatoAdsCampaignData/zomato_ads_campaign_data/57245f496e1411f198350aab37b1cebd.log',
 'NEWSPIDER_MODULE': 'ZomatoAdsCampaignData.spiders',
 'SPIDER_MODULES': ['ZomatoAdsCampaignData.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2026-06-22 08:28:28 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-06-22 08:28:28 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-06-22 08:28:28 [scrapy.middleware] INFO: Enabled item pipelines:
['ZomatoAdsCampaignData.pipelines.ZomatoadscampaigndataPipeline']
2026-06-22 08:28:28 [scrapy.core.engine] INFO: Spider opened
2026-06-22 08:28:28 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-06-22 08:28:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-06-22 08:28:28 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:79: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.

2026-06-22 08:28:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:30 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:31 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:31 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:32 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:32 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:33 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:34 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:34 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:35 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:35 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:36 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:37 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:38 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:39 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:43 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:28:47 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:28:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:28:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:28:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119> (referer: https://www.zomato.com/)
2026-06-22 08:28:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119>
None
2026-06-22 08:28:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-22 08:28:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-22 08:28:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189689> (referer: https://www.zomato.com/)
2026-06-22 08:28:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189689>
None
2026-06-22 08:28:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245> (referer: https://www.zomato.com/)
2026-06-22 08:28:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245>
None
2026-06-22 08:28:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132133> (referer: https://www.zomato.com/)
2026-06-22 08:28:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132133>
None
2026-06-22 08:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132492> (referer: https://www.zomato.com/)
2026-06-22 08:28:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132492>
None
2026-06-22 08:28:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132134> (referer: https://www.zomato.com/)
2026-06-22 08:28:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132134>
None
2026-06-22 08:28:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-22 08:28:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-22 08:28:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-22 08:28:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-22 08:28:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132232> (referer: https://www.zomato.com/)
2026-06-22 08:28:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132232>
None
2026-06-22 08:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132136> (referer: https://www.zomato.com/)
2026-06-22 08:28:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132136>
None
2026-06-22 08:28:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132489> (referer: https://www.zomato.com/)
2026-06-22 08:28:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132489>
None
2026-06-22 08:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:28:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=2611954> (referer: https://www.zomato.com/)
2026-06-22 08:28:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=2611954>
None
2026-06-22 08:28:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132244> (referer: https://www.zomato.com/)
2026-06-22 08:28:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132244>
None
2026-06-22 08:28:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577782> (referer: https://www.zomato.com/)
2026-06-22 08:28:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577782>
None
2026-06-22 08:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674401> (referer: https://www.zomato.com/)
2026-06-22 08:29:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457455> (referer: https://www.zomato.com/)
2026-06-22 08:29:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674401>
None
2026-06-22 08:29:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457455>
None
2026-06-22 08:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269> (referer: https://www.zomato.com/)
2026-06-22 08:29:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269>
None
2026-06-22 08:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944> (referer: https://www.zomato.com/)
2026-06-22 08:29:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944>
None
2026-06-22 08:29:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167977> (referer: https://www.zomato.com/)
2026-06-22 08:29:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167977>
None
2026-06-22 08:29:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920390> (referer: https://www.zomato.com/)
2026-06-22 08:29:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920390>
None
2026-06-22 08:29:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813> (referer: https://www.zomato.com/)
2026-06-22 08:29:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813>
None
2026-06-22 08:29:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245> (referer: https://www.zomato.com/)
2026-06-22 08:29:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245>
None
2026-06-22 08:29:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-22 08:29:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-22 08:29:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577806> (referer: https://www.zomato.com/)
2026-06-22 08:29:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577806>
None
2026-06-22 08:29:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3636332> (referer: https://www.zomato.com/)
2026-06-22 08:29:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3636332>
None
2026-06-22 08:29:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4088178> (referer: https://www.zomato.com/)
2026-06-22 08:29:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4088178>
None
2026-06-22 08:29:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4504879> (referer: https://www.zomato.com/)
2026-06-22 08:29:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4504879>
None
2026-06-22 08:29:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62621330> (referer: https://www.zomato.com/)
2026-06-22 08:29:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62621330>
None
2026-06-22 08:29:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674388> (referer: https://www.zomato.com/)
2026-06-22 08:29:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674388>
None
2026-06-22 08:29:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167983> (referer: https://www.zomato.com/)
2026-06-22 08:29:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167983>
None
2026-06-22 08:29:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577762> (referer: https://www.zomato.com/)
2026-06-22 08:29:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577762>
None
2026-06-22 08:29:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674392> (referer: https://www.zomato.com/)
2026-06-22 08:29:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674392>
None
2026-06-22 08:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-22 08:29:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-22 08:29:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:29:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:29:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-22 08:29:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-22 08:29:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:29:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-22 08:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400> (referer: https://www.zomato.com/)
2026-06-22 08:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-22 08:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400>
None
2026-06-22 08:29:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132267> (referer: https://www.zomato.com/)
2026-06-22 08:29:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132267>
None
2026-06-22 08:29:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132769> (referer: https://www.zomato.com/)
2026-06-22 08:29:16 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132769> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:29:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546549> (referer: https://www.zomato.com/)
2026-06-22 08:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546549>
None
2026-06-22 08:29:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167986> (referer: https://www.zomato.com/)
2026-06-22 08:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167986>
None
2026-06-22 08:29:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577800> (referer: https://www.zomato.com/)
2026-06-22 08:29:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577800>
None
2026-06-22 08:29:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674398> (referer: https://www.zomato.com/)
2026-06-22 08:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674398>
None
2026-06-22 08:29:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132239> (referer: https://www.zomato.com/)
2026-06-22 08:29:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132239>
None
2026-06-22 08:29:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132768> (referer: https://www.zomato.com/)
2026-06-22 08:29:19 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132768> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:29:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167961> (referer: https://www.zomato.com/)
2026-06-22 08:29:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167961>
None
2026-06-22 08:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577773> (referer: https://www.zomato.com/)
2026-06-22 08:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577773>
None
2026-06-22 08:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674397> (referer: https://www.zomato.com/)
2026-06-22 08:29:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674397>
None
2026-06-22 08:29:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981> (referer: https://www.zomato.com/)
2026-06-22 08:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981>
None
2026-06-22 08:29:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577776> (referer: https://www.zomato.com/)
2026-06-22 08:29:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577776>
None
2026-06-22 08:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577774> (referer: https://www.zomato.com/)
2026-06-22 08:29:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577774>
None
2026-06-22 08:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-22 08:29:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-22 08:29:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674388> (referer: https://www.zomato.com/)
2026-06-22 08:29:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674388>
None
2026-06-22 08:29:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167952> (referer: https://www.zomato.com/)
2026-06-22 08:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167952>
None
2026-06-22 08:29:28 [scrapy.extensions.logstats] INFO: Crawled 95 pages (at 95 pages/min), scraped 55 items (at 55 items/min)
2026-06-22 08:29:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479556> (referer: https://www.zomato.com/)
2026-06-22 08:29:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479556>
None
2026-06-22 08:29:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577788> (referer: https://www.zomato.com/)
2026-06-22 08:29:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577788>
None
2026-06-22 08:29:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-22 08:29:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-22 08:29:30 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (failed 1 times): [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', '', 'packet length too long'), ('SSL routines', '', 'record layer failure')]>]
2026-06-22 08:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024> (referer: https://www.zomato.com/)
2026-06-22 08:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189859> (referer: https://www.zomato.com/)
2026-06-22 08:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024>
None
2026-06-22 08:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189859>
None
2026-06-22 08:29:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:29:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:29:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132253> (referer: https://www.zomato.com/)
2026-06-22 08:29:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132253>
None
2026-06-22 08:29:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236> (referer: https://www.zomato.com/)
2026-06-22 08:29:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236>
None
2026-06-22 08:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236> (referer: https://www.zomato.com/)
2026-06-22 08:29:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236>
None
2026-06-22 08:29:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964> (referer: https://www.zomato.com/)
2026-06-22 08:29:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964>
None
2026-06-22 08:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457456> (referer: https://www.zomato.com/)
2026-06-22 08:29:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457456>
None
2026-06-22 08:29:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132263> (referer: https://www.zomato.com/)
2026-06-22 08:29:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132263>
None
2026-06-22 08:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269> (referer: https://www.zomato.com/)
2026-06-22 08:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-22 08:29:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269>
None
2026-06-22 08:29:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-22 08:29:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577794> (referer: https://www.zomato.com/)
2026-06-22 08:29:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577794>
None
2026-06-22 08:29:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785> (referer: https://www.zomato.com/)
2026-06-22 08:29:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785>
None
2026-06-22 08:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964> (referer: https://www.zomato.com/)
2026-06-22 08:29:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964>
None
2026-06-22 08:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785> (referer: https://www.zomato.com/)
2026-06-22 08:29:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785>
None
2026-06-22 08:29:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944> (referer: https://www.zomato.com/)
2026-06-22 08:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944>
None
2026-06-22 08:29:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813> (referer: https://www.zomato.com/)
2026-06-22 08:29:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813>
None
2026-06-22 08:29:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167992> (referer: https://www.zomato.com/)
2026-06-22 08:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167992>
None
2026-06-22 08:29:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674399> (referer: https://www.zomato.com/)
2026-06-22 08:29:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674399>
None
2026-06-22 08:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577780> (referer: https://www.zomato.com/)
2026-06-22 08:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577780>
None
2026-06-22 08:29:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:29:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:45 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:52 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-22 08:29:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-22 08:29:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-22 08:29:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-22 08:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-22 08:29:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-22 08:29:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-22 08:29:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-22 08:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:29:56 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:29:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132137> (referer: https://www.zomato.com/)
2026-06-22 08:29:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132137>
None
2026-06-22 08:29:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132252> (referer: https://www.zomato.com/)
2026-06-22 08:29:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132252>
None
2026-06-22 08:29:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-22 08:29:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-22 08:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:29:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:29:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-22 08:30:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-22 08:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132233> (referer: https://www.zomato.com/)
2026-06-22 08:30:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132233>
None
2026-06-22 08:30:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-22 08:30:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-22 08:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132132> (referer: https://www.zomato.com/)
2026-06-22 08:30:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167980> (referer: https://www.zomato.com/)
2026-06-22 08:30:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132132>
None
2026-06-22 08:30:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167980>
None
2026-06-22 08:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167971> (referer: https://www.zomato.com/)
2026-06-22 08:30:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167971>
None
2026-06-22 08:30:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577778> (referer: https://www.zomato.com/)
2026-06-22 08:30:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577778>
None
2026-06-22 08:30:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674396> (referer: https://www.zomato.com/)
2026-06-22 08:30:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674396>
None
2026-06-22 08:30:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-22 08:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-22 08:30:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:30:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132235> (referer: https://www.zomato.com/)
2026-06-22 08:30:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132235>
None
2026-06-22 08:30:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:30:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:30:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-22 08:30:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:30:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400> (referer: https://www.zomato.com/)
2026-06-22 08:30:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400>
None
2026-06-22 08:30:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132266> (referer: https://www.zomato.com/)
2026-06-22 08:30:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132266>
None
2026-06-22 08:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132767> (referer: https://www.zomato.com/)
2026-06-22 08:30:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132767> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:30:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167959> (referer: https://www.zomato.com/)
2026-06-22 08:30:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167959>
None
2026-06-22 08:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577779> (referer: https://www.zomato.com/)
2026-06-22 08:30:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577779>
None
2026-06-22 08:30:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546548> (referer: https://www.zomato.com/)
2026-06-22 08:30:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546548>
None
2026-06-22 08:30:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577787> (referer: https://www.zomato.com/)
2026-06-22 08:30:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577787>
None
2026-06-22 08:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347509> (referer: https://www.zomato.com/)
2026-06-22 08:30:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347509> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577770> (referer: https://www.zomato.com/)
2026-06-22 08:30:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577770>
None
2026-06-22 08:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:30:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577811> (referer: https://www.zomato.com/)
2026-06-22 08:30:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577811>
None
2026-06-22 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674390> (referer: https://www.zomato.com/)
2026-06-22 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674390>
None
2026-06-22 08:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:30:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-22 08:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-22 08:30:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400> (referer: https://www.zomato.com/)
2026-06-22 08:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400>
None
2026-06-22 08:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:30:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920361> (referer: https://www.zomato.com/)
2026-06-22 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920361>
None
2026-06-22 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-22 08:30:19 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-22 08:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-22 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400> (referer: https://www.zomato.com/)
2026-06-22 08:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400>
None
2026-06-22 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-22 08:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-22 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-22 08:30:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920365> (referer: https://www.zomato.com/)
2026-06-22 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920365>
None
2026-06-22 08:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-22 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-22 08:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400> (referer: https://www.zomato.com/)
2026-06-22 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674400>
None
2026-06-22 08:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167991> (referer: https://www.zomato.com/)
2026-06-22 08:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167991>
None
2026-06-22 08:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-22 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577807> (referer: https://www.zomato.com/)
2026-06-22 08:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-22 08:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577807>
None
2026-06-22 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674389> (referer: https://www.zomato.com/)
2026-06-22 08:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674389>
None
2026-06-22 08:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-22 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-22 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-22 08:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-22 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-22 08:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-22 08:30:28 [scrapy.extensions.logstats] INFO: Crawled 190 pages (at 95 pages/min), scraped 129 items (at 74 items/min)
2026-06-22 08:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:29 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-22 08:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-22 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:31 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:33 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:34 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:37 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132251> (referer: https://www.zomato.com/)
2026-06-22 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132251>
None
2026-06-22 08:30:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-22 08:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-22 08:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-22 08:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-22 08:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-22 08:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-22 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-22 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-22 08:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-22 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-22 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942> (referer: https://www.zomato.com/)
2026-06-22 08:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942>
None
2026-06-22 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557> (referer: https://www.zomato.com/)
2026-06-22 08:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557>
None
2026-06-22 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230> (referer: https://www.zomato.com/)
2026-06-22 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230>
None
2026-06-22 08:30:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265> (referer: https://www.zomato.com/)
2026-06-22 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265>
None
2026-06-22 08:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230> (referer: https://www.zomato.com/)
2026-06-22 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230>
None
2026-06-22 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-22 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-22 08:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265> (referer: https://www.zomato.com/)
2026-06-22 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265>
None
2026-06-22 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979> (referer: https://www.zomato.com/)
2026-06-22 08:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979>
None
2026-06-22 08:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479558> (referer: https://www.zomato.com/)
2026-06-22 08:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479558>
None
2026-06-22 08:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577765> (referer: https://www.zomato.com/)
2026-06-22 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577765>
None
2026-06-22 08:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639738> (referer: https://www.zomato.com/)
2026-06-22 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639738>
None
2026-06-22 08:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942> (referer: https://www.zomato.com/)
2026-06-22 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942>
None
2026-06-22 08:30:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557> (referer: https://www.zomato.com/)
2026-06-22 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557>
None
2026-06-22 08:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577792> (referer: https://www.zomato.com/)
2026-06-22 08:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577792>
None
2026-06-22 08:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639735> (referer: https://www.zomato.com/)
2026-06-22 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639735>
None
2026-06-22 08:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577805> (referer: https://www.zomato.com/)
2026-06-22 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577805>
None
2026-06-22 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577784> (referer: https://www.zomato.com/)
2026-06-22 08:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577784>
None
2026-06-22 08:30:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-22 08:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-22 08:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577783> (referer: https://www.zomato.com/)
2026-06-22 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577783>
None
2026-06-22 08:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639737> (referer: https://www.zomato.com/)
2026-06-22 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639737>
None
2026-06-22 08:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979> (referer: https://www.zomato.com/)
2026-06-22 08:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577795> (referer: https://www.zomato.com/)
2026-06-22 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979>
None
2026-06-22 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577795>
None
2026-06-22 08:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981> (referer: https://www.zomato.com/)
2026-06-22 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981>
None
2026-06-22 08:30:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:00 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:01 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:03 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:04 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189683> (referer: https://www.zomato.com/)
2026-06-22 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189683>
None
2026-06-22 08:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189860> (referer: https://www.zomato.com/)
2026-06-22 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189860>
None
2026-06-22 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577781> (referer: https://www.zomato.com/)
2026-06-22 08:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686> (referer: https://www.zomato.com/)
2026-06-22 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577781>
None
2026-06-22 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686>
None
2026-06-22 08:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-22 08:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686> (referer: https://www.zomato.com/)
2026-06-22 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-22 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686>
None
2026-06-22 08:31:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-22 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-22 08:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-22 08:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-22 08:31:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-22 08:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-22 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-22 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-22 08:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189685> (referer: https://www.zomato.com/)
2026-06-22 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189685>
None
2026-06-22 08:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189857> (referer: https://www.zomato.com/)
2026-06-22 08:31:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-22 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189857>
None
2026-06-22 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-22 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864> (referer: https://www.zomato.com/)
2026-06-22 08:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864>
None
2026-06-22 08:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864> (referer: https://www.zomato.com/)
2026-06-22 08:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864>
None
2026-06-22 08:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-22 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-22 08:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-22 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-22 08:31:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:26 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:28 [scrapy.extensions.logstats] INFO: Crawled 288 pages (at 98 pages/min), scraped 190 items (at 61 items/min)
2026-06-22 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:30 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (failed 1 times): User timeout caused connection failure: Getting https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite took longer than 180.0 seconds..
2026-06-22 08:31:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189680> (referer: https://www.zomato.com/)
2026-06-22 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189680>
None
2026-06-22 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189682> (referer: https://www.zomato.com/)
2026-06-22 08:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189682>
None
2026-06-22 08:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-22 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-22 08:31:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-22 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-22 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-22 08:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-22 08:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-22 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-22 08:31:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189684> (referer: https://www.zomato.com/)
2026-06-22 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189684>
None
2026-06-22 08:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132240> (referer: https://www.zomato.com/)
2026-06-22 08:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132240>
None
2026-06-22 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132495> (referer: https://www.zomato.com/)
2026-06-22 08:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132495>
None
2026-06-22 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167968> (referer: https://www.zomato.com/)
2026-06-22 08:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167968>
None
2026-06-22 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884250> (referer: https://www.zomato.com/)
2026-06-22 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884250>
None
2026-06-22 08:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639736> (referer: https://www.zomato.com/)
2026-06-22 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639736>
None
2026-06-22 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655765> (referer: https://www.zomato.com/)
2026-06-22 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655765>
None
2026-06-22 08:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-22 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-22 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920385> (referer: https://www.zomato.com/)
2026-06-22 08:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920385>
None
2026-06-22 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577789> (referer: https://www.zomato.com/)
2026-06-22 08:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577789>
None
2026-06-22 08:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189861> (referer: https://www.zomato.com/)
2026-06-22 08:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189861>
None
2026-06-22 08:31:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-22 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-22 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-22 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-22 08:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-22 08:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-22 08:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189855> (referer: https://www.zomato.com/)
2026-06-22 08:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189855>
None
2026-06-22 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189858> (referer: https://www.zomato.com/)
2026-06-22 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189858>
None
2026-06-22 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-22 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-22 08:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132246> (referer: https://www.zomato.com/)
2026-06-22 08:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132246>
None
2026-06-22 08:32:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167957> (referer: https://www.zomato.com/)
2026-06-22 08:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167957>
None
2026-06-22 08:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132243> (referer: https://www.zomato.com/)
2026-06-22 08:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132243>
None
2026-06-22 08:32:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132490> (referer: https://www.zomato.com/)
2026-06-22 08:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132490>
None
2026-06-22 08:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119> (referer: https://www.zomato.com/)
2026-06-22 08:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119>
None
2026-06-22 08:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-22 08:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-22 08:32:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-22 08:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-22 08:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132248> (referer: https://www.zomato.com/)
2026-06-22 08:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132248>
None
2026-06-22 08:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237> (referer: https://www.zomato.com/)
2026-06-22 08:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237>
None
2026-06-22 08:32:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966> (referer: https://www.zomato.com/)
2026-06-22 08:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966>
None
2026-06-22 08:32:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577797> (referer: https://www.zomato.com/)
2026-06-22 08:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577797>
None
2026-06-22 08:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167950> (referer: https://www.zomato.com/)
2026-06-22 08:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167950>
None
2026-06-22 08:32:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577767> (referer: https://www.zomato.com/)
2026-06-22 08:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577767>
None
2026-06-22 08:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-22 08:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-22 08:32:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-22 08:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-22 08:32:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648045> (referer: https://www.zomato.com/)
2026-06-22 08:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648045>
None
2026-06-22 08:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-22 08:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-22 08:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777> (referer: https://www.zomato.com/)
2026-06-22 08:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777>
None
2026-06-22 08:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-22 08:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-22 08:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-22 08:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-22 08:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503023> (referer: https://www.zomato.com/)
2026-06-22 08:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503023>
None
2026-06-22 08:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167972> (referer: https://www.zomato.com/)
2026-06-22 08:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167972>
None
2026-06-22 08:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889645> (referer: https://www.zomato.com/)
2026-06-22 08:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889645>
None
2026-06-22 08:32:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4900860> (referer: https://www.zomato.com/)
2026-06-22 08:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4900860>
None
2026-06-22 08:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024> (referer: https://www.zomato.com/)
2026-06-22 08:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479561> (referer: https://www.zomato.com/)
2026-06-22 08:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024>
None
2026-06-22 08:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479561>
None
2026-06-22 08:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674395> (referer: https://www.zomato.com/)
2026-06-22 08:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674395>
None
2026-06-22 08:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4913636> (referer: https://www.zomato.com/)
2026-06-22 08:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4913636>
None
2026-06-22 08:32:28 [scrapy.extensions.logstats] INFO: Crawled 388 pages (at 100 pages/min), scraped 262 items (at 72 items/min)
2026-06-22 08:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577764> (referer: https://www.zomato.com/)
2026-06-22 08:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577764>
None
2026-06-22 08:32:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167974> (referer: https://www.zomato.com/)
2026-06-22 08:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167974>
None
2026-06-22 08:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132250> (referer: https://www.zomato.com/)
2026-06-22 08:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132250>
None
2026-06-22 08:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-22 08:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-22 08:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132258> (referer: https://www.zomato.com/)
2026-06-22 08:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132258>
None
2026-06-22 08:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-22 08:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-22 08:32:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237> (referer: https://www.zomato.com/)
2026-06-22 08:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237>
None
2026-06-22 08:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132254> (referer: https://www.zomato.com/)
2026-06-22 08:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132254>
None
2026-06-22 08:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-22 08:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-22 08:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-22 08:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-22 08:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-22 08:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-22 08:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577814> (referer: https://www.zomato.com/)
2026-06-22 08:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577814>
None
2026-06-22 08:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-22 08:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-22 08:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:32:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-22 08:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-22 08:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167958> (referer: https://www.zomato.com/)
2026-06-22 08:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167958>
None
2026-06-22 08:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648044> (referer: https://www.zomato.com/)
2026-06-22 08:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648044>
None
2026-06-22 08:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966> (referer: https://www.zomato.com/)
2026-06-22 08:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966>
None
2026-06-22 08:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479563> (referer: https://www.zomato.com/)
2026-06-22 08:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479563>
None
2026-06-22 08:32:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577791> (referer: https://www.zomato.com/)
2026-06-22 08:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577791>
None
2026-06-22 08:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648041> (referer: https://www.zomato.com/)
2026-06-22 08:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648041>
None
2026-06-22 08:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777> (referer: https://www.zomato.com/)
2026-06-22 08:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777>
None
2026-06-22 08:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167963> (referer: https://www.zomato.com/)
2026-06-22 08:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167963>
None
2026-06-22 08:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648043> (referer: https://www.zomato.com/)
2026-06-22 08:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648043>
None
2026-06-22 08:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-22 08:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-22 08:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-22 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-22 08:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-22 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-22 08:33:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-22 08:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-22 08:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-22 08:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-22 08:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577798> (referer: https://www.zomato.com/)
2026-06-22 08:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577798>
None
2026-06-22 08:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-22 08:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-22 08:33:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-22 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-22 08:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167962> (referer: https://www.zomato.com/)
2026-06-22 08:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167962>
None
2026-06-22 08:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479565> (referer: https://www.zomato.com/)
2026-06-22 08:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479565>
None
2026-06-22 08:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577799> (referer: https://www.zomato.com/)
2026-06-22 08:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577799>
None
2026-06-22 08:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648042> (referer: https://www.zomato.com/)
2026-06-22 08:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648042>
None
2026-06-22 08:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-22 08:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-22 08:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:14 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:15 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:16 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:16 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:16 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:17 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:18 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:18 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:19 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:19 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:19 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:21 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:21 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:22 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:23 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:24 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:26 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:27 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:28 [scrapy.extensions.logstats] INFO: Crawled 482 pages (at 94 pages/min), scraped 315 items (at 53 items/min)
2026-06-22 08:33:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:33:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167954> (referer: https://www.zomato.com/)
2026-06-22 08:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167954>
None
2026-06-22 08:33:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-22 08:33:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-22 08:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-22 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-22 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167946> (referer: https://www.zomato.com/)
2026-06-22 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167946>
None
2026-06-22 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-22 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-22 08:33:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4866397> (referer: https://www.zomato.com/)
2026-06-22 08:33:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4866397>
None
2026-06-22 08:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884435> (referer: https://www.zomato.com/)
2026-06-22 08:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884435>
None
2026-06-22 08:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132241> (referer: https://www.zomato.com/)
2026-06-22 08:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132241>
None
2026-06-22 08:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132257> (referer: https://www.zomato.com/)
2026-06-22 08:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132257>
None
2026-06-22 08:33:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132496> (referer: https://www.zomato.com/)
2026-06-22 08:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132496>
None
2026-06-22 08:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167953> (referer: https://www.zomato.com/)
2026-06-22 08:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167953>
None
2026-06-22 08:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167949> (referer: https://www.zomato.com/)
2026-06-22 08:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167949>
None
2026-06-22 08:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-22 08:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-22 08:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-22 08:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-22 08:33:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973> (referer: https://www.zomato.com/)
2026-06-22 08:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973>
None
2026-06-22 08:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475683> (referer: https://www.zomato.com/)
2026-06-22 08:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475683>
None
2026-06-22 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4891674> (referer: https://www.zomato.com/)
2026-06-22 08:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4891674>
None
2026-06-22 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475583> (referer: https://www.zomato.com/)
2026-06-22 08:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475583>
None
2026-06-22 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626425> (referer: https://www.zomato.com/)
2026-06-22 08:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626425>
None
2026-06-22 08:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884423> (referer: https://www.zomato.com/)
2026-06-22 08:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884423>
None
2026-06-22 08:33:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624347> (referer: https://www.zomato.com/)
2026-06-22 08:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624347>
None
2026-06-22 08:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920404> (referer: https://www.zomato.com/)
2026-06-22 08:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920404>
None
2026-06-22 08:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577772> (referer: https://www.zomato.com/)
2026-06-22 08:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577772>
None
2026-06-22 08:33:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167960> (referer: https://www.zomato.com/)
2026-06-22 08:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167960>
None
2026-06-22 08:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577810> (referer: https://www.zomato.com/)
2026-06-22 08:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577810>
None
2026-06-22 08:33:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167978> (referer: https://www.zomato.com/)
2026-06-22 08:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167978>
None
2026-06-22 08:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479559> (referer: https://www.zomato.com/)
2026-06-22 08:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479559>
None
2026-06-22 08:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577796> (referer: https://www.zomato.com/)
2026-06-22 08:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577796>
None
2026-06-22 08:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132242> (referer: https://www.zomato.com/)
2026-06-22 08:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132242>
None
2026-06-22 08:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167943> (referer: https://www.zomato.com/)
2026-06-22 08:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167943>
None
2026-06-22 08:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920397> (referer: https://www.zomato.com/)
2026-06-22 08:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920397>
None
2026-06-22 08:33:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577771> (referer: https://www.zomato.com/)
2026-06-22 08:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577771>
None
2026-06-22 08:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:53 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:54 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:33:55 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:33:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:33:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132260> (failed 1 times): [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', '', 'packet length too long'), ('SSL routines', '', 'record layer failure')]>]
2026-06-22 08:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475597> (referer: https://www.zomato.com/)
2026-06-22 08:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475597>
None
2026-06-22 08:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475600> (referer: https://www.zomato.com/)
2026-06-22 08:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475600>
None
2026-06-22 08:34:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475602> (referer: https://www.zomato.com/)
2026-06-22 08:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475602>
None
2026-06-22 08:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626428> (referer: https://www.zomato.com/)
2026-06-22 08:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626428>
None
2026-06-22 08:34:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-22 08:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-22 08:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-22 08:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-22 08:34:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166179> (referer: https://www.zomato.com/)
2026-06-22 08:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166179>
None
2026-06-22 08:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3639674> (referer: https://www.zomato.com/)
2026-06-22 08:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256> (referer: https://www.zomato.com/)
2026-06-22 08:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3639674>
None
2026-06-22 08:34:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256>
None
2026-06-22 08:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132491> (referer: https://www.zomato.com/)
2026-06-22 08:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132491>
None
2026-06-22 08:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497> (referer: https://www.zomato.com/)
2026-06-22 08:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497>
None
2026-06-22 08:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-22 08:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-22 08:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256> (referer: https://www.zomato.com/)
2026-06-22 08:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256>
None
2026-06-22 08:34:11 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-06-22 08:34:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-22 08:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-22 08:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-22 08:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-22 08:34:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132498> (referer: https://www.zomato.com/)
2026-06-22 08:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132498>
None
2026-06-22 08:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167967> (referer: https://www.zomato.com/)
2026-06-22 08:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167967>
None
2026-06-22 08:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577763> (referer: https://www.zomato.com/)
2026-06-22 08:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577763>
None
2026-06-22 08:34:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-22 08:34:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-22 08:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453> (referer: https://www.zomato.com/)
2026-06-22 08:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453>
None
2026-06-22 08:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-22 08:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-22 08:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793> (referer: https://www.zomato.com/)
2026-06-22 08:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793>
None
2026-06-22 08:34:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674391> (referer: https://www.zomato.com/)
2026-06-22 08:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674391>
None
2026-06-22 08:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497> (referer: https://www.zomato.com/)
2026-06-22 08:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497>
None
2026-06-22 08:34:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-22 08:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-22 08:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769> (referer: https://www.zomato.com/)
2026-06-22 08:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769>
None
2026-06-22 08:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879072> (referer: https://www.zomato.com/)
2026-06-22 08:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879072>
None
2026-06-22 08:34:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769> (referer: https://www.zomato.com/)
2026-06-22 08:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769>
None
2026-06-22 08:34:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167984> (referer: https://www.zomato.com/)
2026-06-22 08:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167984>
None
2026-06-22 08:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577801> (referer: https://www.zomato.com/)
2026-06-22 08:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577801>
None
2026-06-22 08:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674393> (referer: https://www.zomato.com/)
2026-06-22 08:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674393>
None
2026-06-22 08:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-22 08:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-22 08:34:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793> (referer: https://www.zomato.com/)
2026-06-22 08:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793>
None
2026-06-22 08:34:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973> (referer: https://www.zomato.com/)
2026-06-22 08:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973>
None
2026-06-22 08:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4943174> (referer: https://www.zomato.com/)
2026-06-22 08:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4943174>
None
2026-06-22 08:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62622299> (referer: https://www.zomato.com/)
2026-06-22 08:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62622299>
None
2026-06-22 08:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:28 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:34:28 [scrapy.extensions.logstats] INFO: Crawled 580 pages (at 98 pages/min), scraped 386 items (at 71 items/min)
2026-06-22 08:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-22 08:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-22 08:34:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-22 08:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-22 08:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167941> (referer: https://www.zomato.com/)
2026-06-22 08:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167941>
None
2026-06-22 08:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62346407> (referer: https://www.zomato.com/)
2026-06-22 08:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62346407>
None
2026-06-22 08:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:34:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-22 08:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-22 08:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-22 08:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-22 08:34:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-22 08:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-22 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:41 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:34:44 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:34:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:34:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:34:47 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:34:49 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:34:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:34:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:34:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:34:54 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:34:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:34:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:35:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:35:02 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:35:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:35:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:35:04 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:04 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:05 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:06 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:06 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:07 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:07 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:08 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:09 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132135> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:10 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:10 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:11 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:11 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577766> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:12 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:12 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577812> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:13 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:14 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:15 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4926163> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:15 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132488> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:16 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167988> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:16 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879053> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:17 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:17 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:18 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:20 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:20 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:22 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:22 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:23 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:24 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:25 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:26 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:27 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:28 [scrapy.extensions.logstats] INFO: Crawled 639 pages (at 59 pages/min), scraped 423 items (at 37 items/min)
2026-06-22 08:35:29 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:30 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:30 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:30 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:32 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:33 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:34 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:34 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:35 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', '', 'packet length too long'), ('SSL routines', '', 'record layer failure')]>]
2026-06-22 08:35:36 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:36 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:37 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:38 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:38 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:39 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:39 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:40 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:41 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:42 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:42 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:43 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:44 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:47 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:48 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:48 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:50 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:51 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:53 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:53 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:56 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:35:59 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:00 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:00 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:01 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:02 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:03 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:03 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', '', 'packet length too long'), ('SSL routines', '', 'record layer failure')]>]
2026-06-22 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:05 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:09 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): [<twisted.python.failure.Failure OpenSSL.SSL.Error: [('SSL routines', '', 'packet length too long'), ('SSL routines', '', 'record layer failure')]>]
2026-06-22 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:36:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:13 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4908801> (referer: https://www.zomato.com/)
2026-06-22 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4908801>
None
2026-06-22 08:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:36:23 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:36:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:36:26 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:28 [scrapy.extensions.logstats] INFO: Crawled 684 pages (at 45 pages/min), scraped 448 items (at 25 items/min)
2026-06-22 08:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:36:31 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:36:32 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:36:34 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:36:35 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:36:40 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:36:41 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:44 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:44 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:45 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:46 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:48 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:48 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:49 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:50 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:53 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>]
2026-06-22 08:36:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:54 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:55 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (failed 1 times): 429 Unknown Status
2026-06-22 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:36:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 2 times): 429 Unknown Status
2026-06-22 08:36:58 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (failed 2 times): 429 Unknown Status
2026-06-22 08:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-22 08:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-22 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-22 08:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-22 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-22 08:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-22 08:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945> (referer: https://www.zomato.com/)
2026-06-22 08:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945>
None
2026-06-22 08:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945> (referer: https://www.zomato.com/)
2026-06-22 08:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889641> (referer: https://www.zomato.com/)
2026-06-22 08:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945>
None
2026-06-22 08:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889641>
None
2026-06-22 08:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-22 08:37:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678249> (referer: https://www.zomato.com/)
2026-06-22 08:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678249>
None
2026-06-22 08:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-22 08:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-22 08:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-22 08:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-22 08:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-22 08:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-22 08:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479560> (referer: https://www.zomato.com/)
2026-06-22 08:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479560>
None
2026-06-22 08:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-22 08:37:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-22 08:37:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-22 08:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-22 08:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-22 08:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-22 08:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248> (referer: https://www.zomato.com/)
2026-06-22 08:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-22 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62678248>
None
2026-06-22 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-22 08:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:28 [scrapy.extensions.logstats] INFO: Crawled 764 pages (at 80 pages/min), scraped 500 items (at 52 items/min)
2026-06-22 08:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:37:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:37:45 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:37:49 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:37:49 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:37:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:37:52 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:37:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:37:55 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:37:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:37:58 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:37:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:00 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:04 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:17 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:20 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:26 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:27 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:28 [scrapy.extensions.logstats] INFO: Crawled 860 pages (at 96 pages/min), scraped 562 items (at 62 items/min)
2026-06-22 08:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:38:52 [scrapy.core.downloader.handlers.http11] WARNING: Got data loss in https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests
2026-06-22 08:38:52 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (failed 1 times): [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>, <twisted.python.failure.Failure twisted.web.http._DataLoss: >]
2026-06-22 08:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:54 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:38:55 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:38:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:57 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:38:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:02 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:02 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:28 [scrapy.extensions.logstats] INFO: Crawled 959 pages (at 99 pages/min), scraped 619 items (at 57 items/min)
2026-06-22 08:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:33 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:39:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:50 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:52 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:39:54 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:39:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:39:57 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:40:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:40:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:20 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:40:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:23 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:40:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:40:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:28 [scrapy.extensions.logstats] INFO: Crawled 1057 pages (at 98 pages/min), scraped 684 items (at 65 items/min)
2026-06-22 08:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:36 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:50 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:40:52 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:40:58 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:40:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:00 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:19 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:23 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:24 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:28 [scrapy.extensions.logstats] INFO: Crawled 1155 pages (at 98 pages/min), scraped 743 items (at 59 items/min)
2026-06-22 08:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-22 08:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-22 08:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453> (referer: https://www.zomato.com/)
2026-06-22 08:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453>
None
2026-06-22 08:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879053> (referer: https://www.zomato.com/)
2026-06-22 08:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879053>
None
2026-06-22 08:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:41:52 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:41:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:41:54 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:41:57 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:00 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:42:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:42:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-22 08:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-22 08:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359> (referer: https://www.zomato.com/)
2026-06-22 08:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668359>
None
2026-06-22 08:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:42:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:42:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:42:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:42:16 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167988> (referer: https://www.zomato.com/)
2026-06-22 08:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167988>
None
2026-06-22 08:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132488> (referer: https://www.zomato.com/)
2026-06-22 08:42:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4926163> (referer: https://www.zomato.com/)
2026-06-22 08:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132488>
None
2026-06-22 08:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4926163>
None
2026-06-22 08:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-22 08:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-22 08:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577812> (referer: https://www.zomato.com/)
2026-06-22 08:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577812>
None
2026-06-22 08:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-22 08:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-22 08:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (referer: https://www.zomato.com/)
2026-06-22 08:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562>
None
2026-06-22 08:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577766> (referer: https://www.zomato.com/)
2026-06-22 08:42:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577766>
None
2026-06-22 08:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (referer: https://www.zomato.com/)
2026-06-22 08:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562>
None
2026-06-22 08:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-22 08:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-22 08:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-22 08:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-22 08:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357> (referer: https://www.zomato.com/)
2026-06-22 08:42:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132135> (referer: https://www.zomato.com/)
2026-06-22 08:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668357>
None
2026-06-22 08:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132135>
None
2026-06-22 08:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-22 08:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-22 08:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:42:26 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:42:28 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:42:28 [scrapy.extensions.logstats] INFO: Crawled 1256 pages (at 101 pages/min), scraped 816 items (at 73 items/min)
2026-06-22 08:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:29 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:42:29 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132260> (referer: https://www.zomato.com/)
2026-06-22 08:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132260>
None
2026-06-22 08:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-22 08:42:32 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:42:32 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-22 08:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:42:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:42:41 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-22 08:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-22 08:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-22 08:42:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:42:43 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-22 08:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-22 08:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132249> (referer: https://www.zomato.com/)
2026-06-22 08:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132499> (referer: https://www.zomato.com/)
2026-06-22 08:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132249>
None
2026-06-22 08:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132499>
None
2026-06-22 08:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-22 08:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-22 08:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132493> (referer: https://www.zomato.com/)
2026-06-22 08:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132493>
None
2026-06-22 08:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-22 08:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-22 08:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-22 08:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-22 08:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-22 08:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-22 08:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674402> (referer: https://www.zomato.com/)
2026-06-22 08:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674402>
None
2026-06-22 08:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-22 08:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-22 08:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-22 08:42:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454> (referer: https://www.zomato.com/)
2026-06-22 08:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-22 08:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454>
None
2026-06-22 08:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577802> (referer: https://www.zomato.com/)
2026-06-22 08:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577802>
None
2026-06-22 08:42:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655766> (referer: https://www.zomato.com/)
2026-06-22 08:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655766>
None
2026-06-22 08:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167947> (referer: https://www.zomato.com/)
2026-06-22 08:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167947>
None
2026-06-22 08:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577803> (referer: https://www.zomato.com/)
2026-06-22 08:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577803>
None
2026-06-22 08:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167982> (referer: https://www.zomato.com/)
2026-06-22 08:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674394> (referer: https://www.zomato.com/)
2026-06-22 08:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167982>
None
2026-06-22 08:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674394>
None
2026-06-22 08:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577804> (referer: https://www.zomato.com/)
2026-06-22 08:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577804>
None
2026-06-22 08:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-22 08:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-22 08:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454> (referer: https://www.zomato.com/)
2026-06-22 08:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454>
None
2026-06-22 08:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577809> (referer: https://www.zomato.com/)
2026-06-22 08:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577809>
None
2026-06-22 08:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:43:00 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:43:01 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-22 08:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-22 08:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-22 08:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-22 08:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-22 08:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-22 08:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-22 08:43:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-22 08:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-22 08:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:43:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:43:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-22 08:43:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1774845291.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-22 08:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358> (referer: https://www.zomato.com/)
2026-06-22 08:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62668358>
None
2026-06-22 08:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840575> (referer: https://www.zomato.com/)
2026-06-22 08:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840575>
None
2026-06-22 08:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840578> (referer: https://www.zomato.com/)
2026-06-22 08:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840578>
None
2026-06-22 08:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62621587> (referer: https://www.zomato.com/)
2026-06-22 08:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62621587>
None
2026-06-22 08:43:08 [scrapy.core.engine] INFO: Closing spider (finished)
2026-06-22 08:43:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 9,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 1,
 'downloader/exception_type_count/twisted.web._newclient.ResponseFailed': 1,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 7,
 'downloader/request_bytes': 7214455,
 'downloader/request_count': 1439,
 'downloader/request_method_count/GET': 1071,
 'downloader/request_method_count/POST': 368,
 'downloader/response_bytes': 14231370,
 'downloader/response_count': 1430,
 'downloader/response_status_count/200': 1321,
 'downloader/response_status_count/429': 109,
 'elapsed_time_seconds': 881.049219,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 6, 22, 8, 43, 9, 589422, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 857,
 'items_per_minute': None,
 'log_count/DEBUG': 2301,
 'log_count/ERROR': 171,
 'log_count/INFO': 24,
 'log_count/WARNING': 36,
 'memusage/max': 144257024,
 'memusage/startup': 130162688,
 'request_depth_max': 2,
 'response_received_count': 1321,
 'responses_per_minute': None,
 'retry/count': 118,
 'retry/reason_count/429 Unknown Status': 109,
 'retry/reason_count/twisted.internet.error.TimeoutError': 1,
 'retry/reason_count/twisted.web._newclient.ResponseFailed': 1,
 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 7,
 'scheduler/dequeued': 1439,
 'scheduler/dequeued/memory': 1439,
 'scheduler/enqueued': 1439,
 'scheduler/enqueued/memory': 1439,
 'spider_exceptions/KeyError': 145,
 'spider_exceptions/TypeError': 26,
 'start_time': datetime.datetime(2026, 6, 22, 8, 28, 28, 540203, tzinfo=datetime.timezone.utc)}
2026-06-22 08:43:09 [scrapy.core.engine] INFO: Spider closed (finished)