2026-06-24 07:53:53 [scrapy.utils.log] INFO: Scrapy 2.12.0 started (bot: ZomatoAdsCampaignData)
2026-06-24 07:53:53 [scrapy.utils.log] INFO: Versions: lxml 6.0.2.0, libxml2 2.14.6, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 25.5.0, Python 3.12.3 (main, Mar 23 2026, 19:04:32) [GCC 13.3.0], pyOpenSSL 25.1.0 (OpenSSL 3.5.2 5 Aug 2025), cryptography 45.0.6, Platform Linux-6.17.0-1013-aws-x86_64-with-glibc2.39
2026-06-24 07:53:53 [scrapy.addons] INFO: Enabled addons:
[]
2026-06-24 07:53:53 [asyncio] DEBUG: Using selector: EpollSelector
2026-06-24 07:53:53 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-24 07:53:53 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-24 07:53:53 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-06-24 07:53:53 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-06-24 07:53:53 [scrapy.extensions.telnet] INFO: Telnet Password: ea306f1622e8d66a
2026-06-24 07:53:53 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats']
2026-06-24 07:53:53 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'ZomatoAdsCampaignData',
 'DOWNLOAD_DELAY': 0.5,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/home/ubuntu/logs/ZomatoAdsCampaignData/zomato_ads_campaign_data/d637ac5f6fa111f199190aab37b1cebd.log',
 'NEWSPIDER_MODULE': 'ZomatoAdsCampaignData.spiders',
 'SPIDER_MODULES': ['ZomatoAdsCampaignData.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor'}
2026-06-24 07:53:53 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-06-24 07:53:53 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-06-24 07:53:53 [scrapy.middleware] INFO: Enabled item pipelines:
['ZomatoAdsCampaignData.pipelines.ZomatoadscampaigndataPipeline']
2026-06-24 07:53:53 [scrapy.core.engine] INFO: Spider opened
2026-06-24 07:53:53 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-06-24 07:53:53 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-06-24 07:53:53 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:79: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.

2026-06-24 07:53:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:55 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:56 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:56 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:57 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:57 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:57 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:58 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:59 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:53:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:53:59 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:00 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:01 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:02 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:02 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:03 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:03 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:05 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:06 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 07:54:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 07:54:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132489> (referer: https://www.zomato.com/)
2026-06-24 07:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132489>
None
2026-06-24 07:54:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167952> (referer: https://www.zomato.com/)
2026-06-24 07:54:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167952>
None
2026-06-24 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3636332> (referer: https://www.zomato.com/)
2026-06-24 07:54:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3636332>
None
2026-06-24 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-24 07:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-24 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189689> (referer: https://www.zomato.com/)
2026-06-24 07:54:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189689>
None
2026-06-24 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245> (referer: https://www.zomato.com/)
2026-06-24 07:54:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245>
None
2026-06-24 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-24 07:54:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-24 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132490> (referer: https://www.zomato.com/)
2026-06-24 07:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132490>
None
2026-06-24 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132133> (referer: https://www.zomato.com/)
2026-06-24 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-24 07:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132133>
None
2026-06-24 07:54:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-24 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132233> (referer: https://www.zomato.com/)
2026-06-24 07:54:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132233>
None
2026-06-24 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-24 07:54:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-24 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132136> (referer: https://www.zomato.com/)
2026-06-24 07:54:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132136>
None
2026-06-24 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132252> (referer: https://www.zomato.com/)
2026-06-24 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132252>
None
2026-06-24 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167991> (referer: https://www.zomato.com/)
2026-06-24 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167991>
None
2026-06-24 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167980> (referer: https://www.zomato.com/)
2026-06-24 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167980>
None
2026-06-24 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577807> (referer: https://www.zomato.com/)
2026-06-24 07:54:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577807>
None
2026-06-24 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269> (referer: https://www.zomato.com/)
2026-06-24 07:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269>
None
2026-06-24 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944> (referer: https://www.zomato.com/)
2026-06-24 07:54:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944>
None
2026-06-24 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813> (referer: https://www.zomato.com/)
2026-06-24 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813>
None
2026-06-24 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920390> (referer: https://www.zomato.com/)
2026-06-24 07:54:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920390>
None
2026-06-24 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245> (referer: https://www.zomato.com/)
2026-06-24 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132245>
None
2026-06-24 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-24 07:54:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-24 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577806> (referer: https://www.zomato.com/)
2026-06-24 07:54:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577806>
None
2026-06-24 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 07:54:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 07:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 07:54:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920365> (referer: https://www.zomato.com/)
2026-06-24 07:54:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920365>
None
2026-06-24 07:54:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-24 07:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-24 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132232> (referer: https://www.zomato.com/)
2026-06-24 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132232>
None
2026-06-24 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167983> (referer: https://www.zomato.com/)
2026-06-24 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167983>
None
2026-06-24 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-24 07:54:34 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577762> (referer: https://www.zomato.com/)
2026-06-24 07:54:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577762>
None
2026-06-24 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577770> (referer: https://www.zomato.com/)
2026-06-24 07:54:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577770>
None
2026-06-24 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347509> (referer: https://www.zomato.com/)
2026-06-24 07:54:35 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347509> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 07:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-24 07:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-24 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 07:54:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132768> (referer: https://www.zomato.com/)
2026-06-24 07:54:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132768> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132239> (referer: https://www.zomato.com/)
2026-06-24 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132239>
None
2026-06-24 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167961> (referer: https://www.zomato.com/)
2026-06-24 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167961>
None
2026-06-24 07:54:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-24 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-24 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503023> (referer: https://www.zomato.com/)
2026-06-24 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577773> (referer: https://www.zomato.com/)
2026-06-24 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503023>
None
2026-06-24 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577773>
None
2026-06-24 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132492> (referer: https://www.zomato.com/)
2026-06-24 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132492>
None
2026-06-24 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981> (referer: https://www.zomato.com/)
2026-06-24 07:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981>
None
2026-06-24 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577776> (referer: https://www.zomato.com/)
2026-06-24 07:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577776>
None
2026-06-24 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577774> (referer: https://www.zomato.com/)
2026-06-24 07:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577774>
None
2026-06-24 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189859> (referer: https://www.zomato.com/)
2026-06-24 07:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189859>
None
2026-06-24 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4088178> (referer: https://www.zomato.com/)
2026-06-24 07:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4088178>
None
2026-06-24 07:54:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4504879> (referer: https://www.zomato.com/)
2026-06-24 07:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4504879>
None
2026-06-24 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-24 07:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-24 07:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:53 [scrapy.extensions.logstats] INFO: Crawled 97 pages (at 97 pages/min), scraped 49 items (at 49 items/min)
2026-06-24 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:54:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:17 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:19 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:24 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:27 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:28 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:30 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:30 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:55:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:38 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:41 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:55:53 [scrapy.extensions.logstats] INFO: Crawled 198 pages (at 101 pages/min), scraped 107 items (at 58 items/min)
2026-06-24 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:55:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:55:57 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:55:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:55:58 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:55:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:55:59 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:02 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:04 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:16 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:56:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:18 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:20 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:21 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:41 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4908801> (referer: https://www.zomato.com/)
2026-06-24 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4908801>
None
2026-06-24 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:56:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:56:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:56:49 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:50 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:52 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:56:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:56:53 [scrapy.extensions.logstats] INFO: Crawled 296 pages (at 98 pages/min), scraped 163 items (at 56 items/min)
2026-06-24 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:56:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:56:56 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:56:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:56:58 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:56:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:00 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:16 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:25 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:26 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:28 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:57:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:57:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:29 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:31 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:32 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:35 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:36 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:37 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:57:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:42 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:44 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:57:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:46 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:48 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:57:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:57:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:57:50 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:57:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:57:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:57:51 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:53 [scrapy.extensions.logstats] INFO: Crawled 399 pages (at 103 pages/min), scraped 219 items (at 56 items/min)
2026-06-24 07:57:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:54 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 07:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:57:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:18 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:19 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:20 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:24 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:30 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:31 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:32 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:33 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:35 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:36 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:58:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:58:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:58:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:58:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:58:38 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:58:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:58:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:53 [scrapy.extensions.logstats] INFO: Crawled 498 pages (at 99 pages/min), scraped 267 items (at 48 items/min)
2026-06-24 07:58:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:54 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:58:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:58:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:02 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:04 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:07 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 07:59:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:10 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:12 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:14 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:17 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:18 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:20 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:22 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:23 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:24 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:27 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:28 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479556> (referer: https://www.zomato.com/)
2026-06-24 07:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479556>
None
2026-06-24 07:59:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577788> (referer: https://www.zomato.com/)
2026-06-24 07:59:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577788>
None
2026-06-24 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 07:59:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:42 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:44 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 07:59:47 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 07:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 07:59:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132253> (referer: https://www.zomato.com/)
2026-06-24 07:59:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132253>
None
2026-06-24 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236> (referer: https://www.zomato.com/)
2026-06-24 07:59:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236>
None
2026-06-24 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269> (referer: https://www.zomato.com/)
2026-06-24 07:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132269>
None
2026-06-24 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944> (referer: https://www.zomato.com/)
2026-06-24 07:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167944>
None
2026-06-24 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813> (referer: https://www.zomato.com/)
2026-06-24 07:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577813>
None
2026-06-24 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785> (referer: https://www.zomato.com/)
2026-06-24 07:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785>
None
2026-06-24 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964> (referer: https://www.zomato.com/)
2026-06-24 07:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964>
None
2026-06-24 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167992> (referer: https://www.zomato.com/)
2026-06-24 07:59:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167992>
None
2026-06-24 07:59:53 [scrapy.extensions.logstats] INFO: Crawled 595 pages (at 97 pages/min), scraped 327 items (at 60 items/min)
2026-06-24 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577780> (referer: https://www.zomato.com/)
2026-06-24 07:59:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577780>
None
2026-06-24 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236> (referer: https://www.zomato.com/)
2026-06-24 07:59:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132236>
None
2026-06-24 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457456> (referer: https://www.zomato.com/)
2026-06-24 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964> (referer: https://www.zomato.com/)
2026-06-24 07:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457456>
None
2026-06-24 07:59:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167964>
None
2026-06-24 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785> (referer: https://www.zomato.com/)
2026-06-24 07:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577785>
None
2026-06-24 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 07:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 07:59:57 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 07:59:58 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 07:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 07:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 08:00:00 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 08:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 08:00:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 08:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 08:00:01 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 08:00:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 08:00:03 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 08:00:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 08:00:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 08:00:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 08:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 08:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 08:00:05 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 08:00:06 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 08:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 08:00:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 08:00:09 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 08:00:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785> (referer: https://www.zomato.com/)
2026-06-24 08:00:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4856785>
None
2026-06-24 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 08:00:11 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539> (referer: https://www.zomato.com/)
2026-06-24 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4917539>
None
2026-06-24 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446> (referer: https://www.zomato.com/)
2026-06-24 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
2026-06-24 08:00:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591446>
None
2026-06-24 08:00:13 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62591471> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988> (referer: https://www.zomato.com/)
2026-06-24 08:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624988>
None
2026-06-24 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
2026-06-24 08:00:15 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62624994> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191> (referer: https://www.zomato.com/)
2026-06-24 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870191>
None
2026-06-24 08:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
2026-06-24 08:00:17 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62141024> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199> (referer: https://www.zomato.com/)
2026-06-24 08:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4870199>
None
2026-06-24 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:19 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:27 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:27 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=2611954> (referer: https://www.zomato.com/)
2026-06-24 08:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=2611954>
None
2026-06-24 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132244> (referer: https://www.zomato.com/)
2026-06-24 08:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132244>
None
2026-06-24 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132137> (referer: https://www.zomato.com/)
2026-06-24 08:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132137>
None
2026-06-24 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-24 08:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-24 08:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-24 08:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-24 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-24 08:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-24 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-24 08:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-24 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-24 08:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-24 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-24 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-24 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131> (referer: https://www.zomato.com/)
2026-06-24 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 08:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132131>
None
2026-06-24 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132134> (referer: https://www.zomato.com/)
2026-06-24 08:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132134>
None
2026-06-24 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132132> (referer: https://www.zomato.com/)
2026-06-24 08:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132132>
None
2026-06-24 08:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132235> (referer: https://www.zomato.com/)
2026-06-24 08:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132235>
None
2026-06-24 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167971> (referer: https://www.zomato.com/)
2026-06-24 08:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577778> (referer: https://www.zomato.com/)
2026-06-24 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167971>
None
2026-06-24 08:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577778>
None
2026-06-24 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132251> (referer: https://www.zomato.com/)
2026-06-24 08:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132251>
None
2026-06-24 08:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981> (referer: https://www.zomato.com/)
2026-06-24 08:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167981>
None
2026-06-24 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577781> (referer: https://www.zomato.com/)
2026-06-24 08:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577781>
None
2026-06-24 08:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132266> (referer: https://www.zomato.com/)
2026-06-24 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132266>
None
2026-06-24 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132767> (referer: https://www.zomato.com/)
2026-06-24 08:00:40 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132767> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167959> (referer: https://www.zomato.com/)
2026-06-24 08:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167959>
None
2026-06-24 08:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577787> (referer: https://www.zomato.com/)
2026-06-24 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546548> (referer: https://www.zomato.com/)
2026-06-24 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577787>
None
2026-06-24 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546548>
None
2026-06-24 08:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132267> (referer: https://www.zomato.com/)
2026-06-24 08:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132267>
None
2026-06-24 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132769> (referer: https://www.zomato.com/)
2026-06-24 08:00:43 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132769> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167986> (referer: https://www.zomato.com/)
2026-06-24 08:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167986>
None
2026-06-24 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546549> (referer: https://www.zomato.com/)
2026-06-24 08:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577800> (referer: https://www.zomato.com/)
2026-06-24 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62546549>
None
2026-06-24 08:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577800>
None
2026-06-24 08:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 08:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 08:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 08:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577811> (referer: https://www.zomato.com/)
2026-06-24 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577811>
None
2026-06-24 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 08:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920361> (referer: https://www.zomato.com/)
2026-06-24 08:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920361>
None
2026-06-24 08:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-24 08:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-24 08:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 08:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 08:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 08:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-24 08:00:50 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577779> (referer: https://www.zomato.com/)
2026-06-24 08:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577779>
None
2026-06-24 08:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231> (referer: https://www.zomato.com/)
2026-06-24 08:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132231>
None
2026-06-24 08:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
2026-06-24 08:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948> (referer: https://www.zomato.com/)
2026-06-24 08:00:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62347510> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167948>
None
2026-06-24 08:00:53 [scrapy.extensions.logstats] INFO: Crawled 694 pages (at 99 pages/min), scraped 391 items (at 64 items/min)
2026-06-24 08:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775> (referer: https://www.zomato.com/)
2026-06-24 08:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577775>
None
2026-06-24 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-24 08:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-24 08:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-24 08:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-24 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-24 08:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-24 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-24 08:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-24 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262> (referer: https://www.zomato.com/)
2026-06-24 08:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132262>
None
2026-06-24 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993> (referer: https://www.zomato.com/)
2026-06-24 08:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167993>
None
2026-06-24 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457455> (referer: https://www.zomato.com/)
2026-06-24 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457455>
None
2026-06-24 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577782> (referer: https://www.zomato.com/)
2026-06-24 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577782>
None
2026-06-24 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167977> (referer: https://www.zomato.com/)
2026-06-24 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167977>
None
2026-06-24 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727554> (referer: https://www.zomato.com/)
2026-06-24 08:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727554>
None
2026-06-24 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:00 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:01 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:04 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:06 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:09 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-24 08:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-24 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230> (referer: https://www.zomato.com/)
2026-06-24 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230>
None
2026-06-24 08:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-24 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-24 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265> (referer: https://www.zomato.com/)
2026-06-24 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265>
None
2026-06-24 08:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-24 08:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-24 08:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-24 08:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-24 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230> (referer: https://www.zomato.com/)
2026-06-24 08:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265> (referer: https://www.zomato.com/)
2026-06-24 08:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132230>
None
2026-06-24 08:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132265>
None
2026-06-24 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268> (referer: https://www.zomato.com/)
2026-06-24 08:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132268>
None
2026-06-24 08:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965> (referer: https://www.zomato.com/)
2026-06-24 08:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167965>
None
2026-06-24 08:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989> (referer: https://www.zomato.com/)
2026-06-24 08:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167989>
None
2026-06-24 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119> (referer: https://www.zomato.com/)
2026-06-24 08:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119>
None
2026-06-24 08:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119> (referer: https://www.zomato.com/)
2026-06-24 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132119>
None
2026-06-24 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189684> (referer: https://www.zomato.com/)
2026-06-24 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189684>
None
2026-06-24 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189861> (referer: https://www.zomato.com/)
2026-06-24 08:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189861>
None
2026-06-24 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024> (referer: https://www.zomato.com/)
2026-06-24 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-24 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024>
None
2026-06-24 08:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-24 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661> (referer: https://www.zomato.com/)
2026-06-24 08:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889661>
None
2026-06-24 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024> (referer: https://www.zomato.com/)
2026-06-24 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62503024>
None
2026-06-24 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577783> (referer: https://www.zomato.com/)
2026-06-24 08:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577783>
None
2026-06-24 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979> (referer: https://www.zomato.com/)
2026-06-24 08:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979>
None
2026-06-24 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479558> (referer: https://www.zomato.com/)
2026-06-24 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479558>
None
2026-06-24 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577765> (referer: https://www.zomato.com/)
2026-06-24 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577765>
None
2026-06-24 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639738> (referer: https://www.zomato.com/)
2026-06-24 08:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639738>
None
2026-06-24 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942> (referer: https://www.zomato.com/)
2026-06-24 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942>
None
2026-06-24 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557> (referer: https://www.zomato.com/)
2026-06-24 08:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557>
None
2026-06-24 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577792> (referer: https://www.zomato.com/)
2026-06-24 08:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577792>
None
2026-06-24 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639735> (referer: https://www.zomato.com/)
2026-06-24 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639737> (referer: https://www.zomato.com/)
2026-06-24 08:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639735>
None
2026-06-24 08:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639737>
None
2026-06-24 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942> (referer: https://www.zomato.com/)
2026-06-24 08:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167942>
None
2026-06-24 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557> (referer: https://www.zomato.com/)
2026-06-24 08:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479557>
None
2026-06-24 08:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577784> (referer: https://www.zomato.com/)
2026-06-24 08:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577784>
None
2026-06-24 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979> (referer: https://www.zomato.com/)
2026-06-24 08:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167979>
None
2026-06-24 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577805> (referer: https://www.zomato.com/)
2026-06-24 08:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577805>
None
2026-06-24 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577795> (referer: https://www.zomato.com/)
2026-06-24 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577795>
None
2026-06-24 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:35 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:36 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:40 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-24 08:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-24 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-24 08:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-24 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189682> (referer: https://www.zomato.com/)
2026-06-24 08:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189682>
None
2026-06-24 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189855> (referer: https://www.zomato.com/)
2026-06-24 08:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189855>
None
2026-06-24 08:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686> (referer: https://www.zomato.com/)
2026-06-24 08:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686>
None
2026-06-24 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-24 08:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-24 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686> (referer: https://www.zomato.com/)
2026-06-24 08:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189686>
None
2026-06-24 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-24 08:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-24 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-24 08:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-24 08:01:53 [scrapy.extensions.logstats] INFO: Crawled 794 pages (at 100 pages/min), scraped 457 items (at 66 items/min)
2026-06-24 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-24 08:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-24 08:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-24 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-24 08:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864> (referer: https://www.zomato.com/)
2026-06-24 08:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864>
None
2026-06-24 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-24 08:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-24 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864> (referer: https://www.zomato.com/)
2026-06-24 08:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189864>
None
2026-06-24 08:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:00 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:00 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:02 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189683> (referer: https://www.zomato.com/)
2026-06-24 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189685> (referer: https://www.zomato.com/)
2026-06-24 08:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189683>
None
2026-06-24 08:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189685>
None
2026-06-24 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189680> (referer: https://www.zomato.com/)
2026-06-24 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688> (referer: https://www.zomato.com/)
2026-06-24 08:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189680>
None
2026-06-24 08:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189688>
None
2026-06-24 08:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679> (referer: https://www.zomato.com/)
2026-06-24 08:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189679>
None
2026-06-24 08:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681> (referer: https://www.zomato.com/)
2026-06-24 08:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189681>
None
2026-06-24 08:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-24 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132240> (referer: https://www.zomato.com/)
2026-06-24 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-24 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132240>
None
2026-06-24 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-24 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-24 08:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970> (referer: https://www.zomato.com/)
2026-06-24 08:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167970>
None
2026-06-24 08:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132263> (referer: https://www.zomato.com/)
2026-06-24 08:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132263>
None
2026-06-24 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132495> (referer: https://www.zomato.com/)
2026-06-24 08:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132495>
None
2026-06-24 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985> (referer: https://www.zomato.com/)
2026-06-24 08:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167985>
None
2026-06-24 08:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132243> (referer: https://www.zomato.com/)
2026-06-24 08:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132243>
None
2026-06-24 08:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889645> (referer: https://www.zomato.com/)
2026-06-24 08:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167972> (referer: https://www.zomato.com/)
2026-06-24 08:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889645>
None
2026-06-24 08:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167972>
None
2026-06-24 08:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4900860> (referer: https://www.zomato.com/)
2026-06-24 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4900860>
None
2026-06-24 08:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727555> (referer: https://www.zomato.com/)
2026-06-24 08:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479561> (referer: https://www.zomato.com/)
2026-06-24 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727555>
None
2026-06-24 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479561>
None
2026-06-24 08:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167968> (referer: https://www.zomato.com/)
2026-06-24 08:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167968>
None
2026-06-24 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639736> (referer: https://www.zomato.com/)
2026-06-24 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884250> (referer: https://www.zomato.com/)
2026-06-24 08:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62639736>
None
2026-06-24 08:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884250>
None
2026-06-24 08:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655765> (referer: https://www.zomato.com/)
2026-06-24 08:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655765>
None
2026-06-24 08:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577794> (referer: https://www.zomato.com/)
2026-06-24 08:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577794>
None
2026-06-24 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920385> (referer: https://www.zomato.com/)
2026-06-24 08:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920385>
None
2026-06-24 08:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577789> (referer: https://www.zomato.com/)
2026-06-24 08:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577789>
None
2026-06-24 08:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863> (referer: https://www.zomato.com/)
2026-06-24 08:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189863>
None
2026-06-24 08:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856> (referer: https://www.zomato.com/)
2026-06-24 08:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189856>
None
2026-06-24 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189858> (referer: https://www.zomato.com/)
2026-06-24 08:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189858>
None
2026-06-24 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865> (referer: https://www.zomato.com/)
2026-06-24 08:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189865>
None
2026-06-24 08:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189857> (referer: https://www.zomato.com/)
2026-06-24 08:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189857>
None
2026-06-24 08:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189860> (referer: https://www.zomato.com/)
2026-06-24 08:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189860>
None
2026-06-24 08:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862> (referer: https://www.zomato.com/)
2026-06-24 08:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687> (referer: https://www.zomato.com/)
2026-06-24 08:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189862>
None
2026-06-24 08:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62189687>
None
2026-06-24 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167957> (referer: https://www.zomato.com/)
2026-06-24 08:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167957>
None
2026-06-24 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132246> (referer: https://www.zomato.com/)
2026-06-24 08:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132246>
None
2026-06-24 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237> (referer: https://www.zomato.com/)
2026-06-24 08:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237>
None
2026-06-24 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132248> (referer: https://www.zomato.com/)
2026-06-24 08:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132248>
None
2026-06-24 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167950> (referer: https://www.zomato.com/)
2026-06-24 08:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167950>
None
2026-06-24 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132250> (referer: https://www.zomato.com/)
2026-06-24 08:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132250>
None
2026-06-24 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-24 08:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-24 08:02:53 [scrapy.extensions.logstats] INFO: Crawled 892 pages (at 98 pages/min), scraped 519 items (at 62 items/min)
2026-06-24 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237> (referer: https://www.zomato.com/)
2026-06-24 08:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132237>
None
2026-06-24 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-24 08:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-24 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132258> (referer: https://www.zomato.com/)
2026-06-24 08:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132258>
None
2026-06-24 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167963> (referer: https://www.zomato.com/)
2026-06-24 08:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167963>
None
2026-06-24 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648043> (referer: https://www.zomato.com/)
2026-06-24 08:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648043>
None
2026-06-24 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-24 08:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-24 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777> (referer: https://www.zomato.com/)
2026-06-24 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777>
None
2026-06-24 08:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966> (referer: https://www.zomato.com/)
2026-06-24 08:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966>
None
2026-06-24 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479563> (referer: https://www.zomato.com/)
2026-06-24 08:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479563>
None
2026-06-24 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577791> (referer: https://www.zomato.com/)
2026-06-24 08:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577791>
None
2026-06-24 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648041> (referer: https://www.zomato.com/)
2026-06-24 08:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648041>
None
2026-06-24 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-24 08:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-24 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-24 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167962> (referer: https://www.zomato.com/)
2026-06-24 08:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-24 08:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167962>
None
2026-06-24 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479565> (referer: https://www.zomato.com/)
2026-06-24 08:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479565>
None
2026-06-24 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577799> (referer: https://www.zomato.com/)
2026-06-24 08:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577799>
None
2026-06-24 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648042> (referer: https://www.zomato.com/)
2026-06-24 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648042>
None
2026-06-24 08:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577767> (referer: https://www.zomato.com/)
2026-06-24 08:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577767>
None
2026-06-24 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966> (referer: https://www.zomato.com/)
2026-06-24 08:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167966>
None
2026-06-24 08:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577797> (referer: https://www.zomato.com/)
2026-06-24 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577797>
None
2026-06-24 08:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167974> (referer: https://www.zomato.com/)
2026-06-24 08:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167974>
None
2026-06-24 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4913636> (referer: https://www.zomato.com/)
2026-06-24 08:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4913636>
None
2026-06-24 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577764> (referer: https://www.zomato.com/)
2026-06-24 08:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577764>
None
2026-06-24 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674395> (referer: https://www.zomato.com/)
2026-06-24 08:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62674395>
None
2026-06-24 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:03:21 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:03:23 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:03:23 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:03:23 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132254> (referer: https://www.zomato.com/)
2026-06-24 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132254>
None
2026-06-24 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-24 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-24 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259> (referer: https://www.zomato.com/)
2026-06-24 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132259>
None
2026-06-24 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:03:28 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-24 08:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-24 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-24 08:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-24 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:32 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:34 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167954> (referer: https://www.zomato.com/)
2026-06-24 08:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167954>
None
2026-06-24 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-24 08:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-24 08:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132260> (referer: https://www.zomato.com/)
2026-06-24 08:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132260>
None
2026-06-24 08:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167978> (referer: https://www.zomato.com/)
2026-06-24 08:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167978>
None
2026-06-24 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-24 08:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-24 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132498> (referer: https://www.zomato.com/)
2026-06-24 08:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132498>
None
2026-06-24 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167941> (referer: https://www.zomato.com/)
2026-06-24 08:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167941>
None
2026-06-24 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-24 08:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-24 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132488> (referer: https://www.zomato.com/)
2026-06-24 08:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132488>
None
2026-06-24 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264> (referer: https://www.zomato.com/)
2026-06-24 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-24 08:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132264>
None
2026-06-24 08:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-24 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-24 08:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-24 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132135> (referer: https://www.zomato.com/)
2026-06-24 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132499> (referer: https://www.zomato.com/)
2026-06-24 08:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132135>
None
2026-06-24 08:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132499>
None
2026-06-24 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-24 08:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-24 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167982> (referer: https://www.zomato.com/)
2026-06-24 08:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167982>
None
2026-06-24 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577804> (referer: https://www.zomato.com/)
2026-06-24 08:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577804>
None
2026-06-24 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-24 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-24 08:03:53 [scrapy.extensions.logstats] INFO: Crawled 991 pages (at 99 pages/min), scraped 584 items (at 65 items/min)
2026-06-24 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-24 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-24 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (referer: https://www.zomato.com/)
2026-06-24 08:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562>
None
2026-06-24 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577812> (referer: https://www.zomato.com/)
2026-06-24 08:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577812>
None
2026-06-24 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562> (referer: https://www.zomato.com/)
2026-06-24 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479562>
None
2026-06-24 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-24 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-24 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-24 08:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-24 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-24 08:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-24 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261> (referer: https://www.zomato.com/)
2026-06-24 08:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132261>
None
2026-06-24 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577766> (referer: https://www.zomato.com/)
2026-06-24 08:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577766>
None
2026-06-24 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975> (referer: https://www.zomato.com/)
2026-06-24 08:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167975>
None
2026-06-24 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479559> (referer: https://www.zomato.com/)
2026-06-24 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577796> (referer: https://www.zomato.com/)
2026-06-24 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479559>
None
2026-06-24 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577796>
None
2026-06-24 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727553> (referer: https://www.zomato.com/)
2026-06-24 08:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62727553>
None
2026-06-24 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-24 08:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-24 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453> (referer: https://www.zomato.com/)
2026-06-24 08:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453>
None
2026-06-24 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-24 08:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-24 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167988> (referer: https://www.zomato.com/)
2026-06-24 08:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167988>
None
2026-06-24 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-24 08:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-24 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-24 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879053> (referer: https://www.zomato.com/)
2026-06-24 08:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-24 08:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879053>
None
2026-06-24 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4926163> (referer: https://www.zomato.com/)
2026-06-24 08:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4926163>
None
2026-06-24 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62346405> (referer: https://www.zomato.com/)
2026-06-24 08:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62346405>
None
2026-06-24 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167967> (referer: https://www.zomato.com/)
2026-06-24 08:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167967>
None
2026-06-24 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577763> (referer: https://www.zomato.com/)
2026-06-24 08:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577763>
None
2026-06-24 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951> (referer: https://www.zomato.com/)
2026-06-24 08:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167951>
None
2026-06-24 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453> (referer: https://www.zomato.com/)
2026-06-24 08:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457453>
None
2026-06-24 08:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111> (referer: https://www.zomato.com/)
2026-06-24 08:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62483111>
None
2026-06-24 08:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454> (referer: https://www.zomato.com/)
2026-06-24 08:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454>
None
2026-06-24 08:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577809> (referer: https://www.zomato.com/)
2026-06-24 08:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577809>
None
2026-06-24 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713372> (referer: https://www.zomato.com/)
2026-06-24 08:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713372>
None
2026-06-24 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768> (referer: https://www.zomato.com/)
2026-06-24 08:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577768>
None
2026-06-24 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234> (referer: https://www.zomato.com/)
2026-06-24 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132493> (referer: https://www.zomato.com/)
2026-06-24 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132234>
None
2026-06-24 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132493>
None
2026-06-24 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132249> (referer: https://www.zomato.com/)
2026-06-24 08:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132249>
None
2026-06-24 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-24 08:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-24 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945> (referer: https://www.zomato.com/)
2026-06-24 08:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945>
None
2026-06-24 08:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945> (referer: https://www.zomato.com/)
2026-06-24 08:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167945>
None
2026-06-24 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-24 08:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-24 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-24 08:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-24 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-24 08:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-24 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494> (referer: https://www.zomato.com/)
2026-06-24 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132494>
None
2026-06-24 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255> (referer: https://www.zomato.com/)
2026-06-24 08:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132255>
None
2026-06-24 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-24 08:04:29 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-24 08:04:31 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-24 08:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:34 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-24 08:04:37 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
2026-06-24 08:04:39 [scrapy.core.scraper] ERROR: Spider error processing <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132766> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 307, in getting_camp_data
    data_to_upload["cpc"] = row["CPC"]
                            ~~~^^^^^^^
KeyError: 'CPC'
2026-06-24 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479560> (referer: https://www.zomato.com/)
2026-06-24 08:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479560>
None
2026-06-24 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713374> (referer: https://www.zomato.com/)
2026-06-24 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713374>
None
2026-06-24 08:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713374> (referer: https://www.zomato.com/)
2026-06-24 08:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713374>
None
2026-06-24 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990> (referer: https://www.zomato.com/)
2026-06-24 08:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167990>
None
2026-06-24 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638> (referer: https://www.zomato.com/)
2026-06-24 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889638>
None
2026-06-24 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375> (referer: https://www.zomato.com/)
2026-06-24 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62713375>
None
2026-06-24 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889641> (referer: https://www.zomato.com/)
2026-06-24 08:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4889641>
None
2026-06-24 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167947> (referer: https://www.zomato.com/)
2026-06-24 08:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167947>
None
2026-06-24 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577803> (referer: https://www.zomato.com/)
2026-06-24 08:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577803>
None
2026-06-24 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976> (referer: https://www.zomato.com/)
2026-06-24 08:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167976>
None
2026-06-24 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655766> (referer: https://www.zomato.com/)
2026-06-24 08:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62655766>
None
2026-06-24 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454> (referer: https://www.zomato.com/)
2026-06-24 08:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62457454>
None
2026-06-24 08:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790> (referer: https://www.zomato.com/)
2026-06-24 08:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577790>
None
2026-06-24 08:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238> (referer: https://www.zomato.com/)
2026-06-24 08:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132238>
None
2026-06-24 08:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808> (referer: https://www.zomato.com/)
2026-06-24 08:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577808>
None
2026-06-24 08:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:04:53 [scrapy.extensions.logstats] INFO: Crawled 1089 pages (at 98 pages/min), scraped 665 items (at 81 items/min)
2026-06-24 08:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-24 08:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-24 08:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577814> (referer: https://www.zomato.com/)
2026-06-24 08:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577814>
None
2026-06-24 08:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-24 08:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-24 08:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648045> (referer: https://www.zomato.com/)
2026-06-24 08:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648045>
None
2026-06-24 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-24 08:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-24 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577802> (referer: https://www.zomato.com/)
2026-06-24 08:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577802>
None
2026-06-24 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577798> (referer: https://www.zomato.com/)
2026-06-24 08:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577798>
None
2026-06-24 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969> (referer: https://www.zomato.com/)
2026-06-24 08:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167969>
None
2026-06-24 08:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777> (referer: https://www.zomato.com/)
2026-06-24 08:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577777>
None
2026-06-24 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955> (referer: https://www.zomato.com/)
2026-06-24 08:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167955>
None
2026-06-24 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564> (referer: https://www.zomato.com/)
2026-06-24 08:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62479564>
None
2026-06-24 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786> (referer: https://www.zomato.com/)
2026-06-24 08:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577786>
None
2026-06-24 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167958> (referer: https://www.zomato.com/)
2026-06-24 08:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167958>
None
2026-06-24 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:03 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:04 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:04 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:05 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:05 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:05 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648044> (referer: https://www.zomato.com/)
2026-06-24 08:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62648044>
None
2026-06-24 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:06 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:07 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:08 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:09 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:05:10 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:11 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:12 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:20 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167946> (referer: https://www.zomato.com/)
2026-06-24 08:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167946>
None
2026-06-24 08:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4866397> (referer: https://www.zomato.com/)
2026-06-24 08:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4866397>
None
2026-06-24 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884435> (referer: https://www.zomato.com/)
2026-06-24 08:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884435>
None
2026-06-24 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497> (referer: https://www.zomato.com/)
2026-06-24 08:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497>
None
2026-06-24 08:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497> (referer: https://www.zomato.com/)
2026-06-24 08:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132497>
None
2026-06-24 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256> (referer: https://www.zomato.com/)
2026-06-24 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256>
None
2026-06-24 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132241> (referer: https://www.zomato.com/)
2026-06-24 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132241>
None
2026-06-24 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256> (referer: https://www.zomato.com/)
2026-06-24 08:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132256>
None
2026-06-24 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3639674> (referer: https://www.zomato.com/)
2026-06-24 08:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=3639674>
None
2026-06-24 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973> (referer: https://www.zomato.com/)
2026-06-24 08:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973>
None
2026-06-24 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167953> (referer: https://www.zomato.com/)
2026-06-24 08:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167953>
None
2026-06-24 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132496> (referer: https://www.zomato.com/)
2026-06-24 08:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132496>
None
2026-06-24 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475683> (referer: https://www.zomato.com/)
2026-06-24 08:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475683>
None
2026-06-24 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840575> (referer: https://www.zomato.com/)
2026-06-24 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840575>
None
2026-06-24 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475583> (referer: https://www.zomato.com/)
2026-06-24 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475583>
None
2026-06-24 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626425> (referer: https://www.zomato.com/)
2026-06-24 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626425>
None
2026-06-24 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884423> (referer: https://www.zomato.com/)
2026-06-24 08:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4884423>
None
2026-06-24 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840578> (referer: https://www.zomato.com/)
2026-06-24 08:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4840578>
None
2026-06-24 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167949> (referer: https://www.zomato.com/)
2026-06-24 08:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167949>
None
2026-06-24 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132257> (referer: https://www.zomato.com/)
2026-06-24 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132257>
None
2026-06-24 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973> (referer: https://www.zomato.com/)
2026-06-24 08:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167973>
None
2026-06-24 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4891674> (referer: https://www.zomato.com/)
2026-06-24 08:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4891674>
None
2026-06-24 08:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920404> (referer: https://www.zomato.com/)
2026-06-24 08:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920404>
None
2026-06-24 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577772> (referer: https://www.zomato.com/)
2026-06-24 08:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577772>
None
2026-06-24 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-24 08:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-24 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793> (referer: https://www.zomato.com/)
2026-06-24 08:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793>
None
2026-06-24 08:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167960> (referer: https://www.zomato.com/)
2026-06-24 08:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167960>
None
2026-06-24 08:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-24 08:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-24 08:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793> (referer: https://www.zomato.com/)
2026-06-24 08:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577793>
None
2026-06-24 08:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-24 08:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-24 08:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879072> (referer: https://www.zomato.com/)
2026-06-24 08:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4879072>
None
2026-06-24 08:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769> (referer: https://www.zomato.com/)
2026-06-24 08:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769>
None
2026-06-24 08:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956> (referer: https://www.zomato.com/)
2026-06-24 08:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167956>
None
2026-06-24 08:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769> (referer: https://www.zomato.com/)
2026-06-24 08:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577769>
None
2026-06-24 08:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:43 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:43 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132242> (referer: https://www.zomato.com/)
2026-06-24 08:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132242>
None
2026-06-24 08:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920397> (referer: https://www.zomato.com/)
2026-06-24 08:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4920397>
None
2026-06-24 08:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:47 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577771> (referer: https://www.zomato.com/)
2026-06-24 08:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577771>
None
2026-06-24 08:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:48 [scrapy.core.scraper] ERROR: Spider error processing <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
Traceback (most recent call last):
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/culinary-compass-spiders/venv/lib/python3.12/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py", line 221, in get_ads_group_id
    for grp_id in group_id_raw_data["data"]["multiple_ad_groups"]:
TypeError: 'NoneType' object is not iterable
2026-06-24 08:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475597> (referer: https://www.zomato.com/)
2026-06-24 08:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475597>
None
2026-06-24 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475600> (referer: https://www.zomato.com/)
2026-06-24 08:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475600>
None
2026-06-24 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475602> (referer: https://www.zomato.com/)
2026-06-24 08:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4475602>
None
2026-06-24 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626428> (referer: https://www.zomato.com/)
2026-06-24 08:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4626428>
None
2026-06-24 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132491> (referer: https://www.zomato.com/)
2026-06-24 08:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62132491>
None
2026-06-24 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167984> (referer: https://www.zomato.com/)
2026-06-24 08:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167984>
None
2026-06-24 08:05:53 [scrapy.extensions.logstats] INFO: Crawled 1183 pages (at 94 pages/min), scraped 725 items (at 60 items/min)
2026-06-24 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577801> (referer: https://www.zomato.com/)
2026-06-24 08:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577801>
None
2026-06-24 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577810> (referer: https://www.zomato.com/)
2026-06-24 08:05:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62577810>
None
2026-06-24 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167943> (referer: https://www.zomato.com/)
2026-06-24 08:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62167943>
None
2026-06-24 08:06:53 [scrapy.extensions.logstats] INFO: Crawled 1186 pages (at 3 pages/min), scraped 728 items (at 3 items/min)
2026-06-24 08:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/restaurant/get-all-minimal-lite> (referer: https://www.zomato.com/partners/login)
2026-06-24 08:07:43 [py.warnings] WARNING: /home/ubuntu/eggs/ZomatoAdsCampaignData/1782116920.egg/ZomatoAdsCampaignData/spiders/AdsCampaign.py:132: UserWarning: pandas only supports SQLAlchemy connectable (engine/connection) or database string URI or sqlite3 DBAPI2 connection. Other DBAPI2 objects are not tested. Please consider using SQLAlchemy.
  comp_response = pd.read_sql_query(comp_query, self.conn)

2026-06-24 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.zomato.com/merchant-gw/web/ads/platform/multiple-ad-groups> (referer: https://www.zomato.com/)
2026-06-24 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-24 08:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-24 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-24 08:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-24 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166179> (referer: https://www.zomato.com/)
2026-06-24 08:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166179>
None
2026-06-24 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-24 08:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-24 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180> (referer: https://www.zomato.com/)
2026-06-24 08:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=62166180>
None
2026-06-24 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4943174> (referer: https://www.zomato.com/)
2026-06-24 08:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.zomato.com/merchant-gw/web/ads/platform/single-ad-group?id=4943174>
None
2026-06-24 08:07:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-06-24 08:07:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 5697389,
 'downloader/request_count': 1198,
 'downloader/request_method_count/GET': 913,
 'downloader/request_method_count/POST': 285,
 'downloader/response_bytes': 12521666,
 'downloader/response_count': 1198,
 'downloader/response_status_count/200': 1198,
 'elapsed_time_seconds': 838.723509,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 6, 24, 8, 7, 52, 52744, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 734,
 'items_per_minute': None,
 'log_count/DEBUG': 1937,
 'log_count/ERROR': 171,
 'log_count/INFO': 23,
 'log_count/WARNING': 35,
 'memusage/max': 143560704,
 'memusage/startup': 130416640,
 'request_depth_max': 2,
 'response_received_count': 1198,
 'responses_per_minute': None,
 'scheduler/dequeued': 1198,
 'scheduler/dequeued/memory': 1198,
 'scheduler/enqueued': 1198,
 'scheduler/enqueued/memory': 1198,
 'spider_exceptions/KeyError': 145,
 'spider_exceptions/TypeError': 26,
 'start_time': datetime.datetime(2026, 6, 24, 7, 53, 53, 329235, tzinfo=datetime.timezone.utc)}
2026-06-24 08:07:52 [scrapy.core.engine] INFO: Spider closed (finished)