• 'pip install logparser' on host 'scrapyd-1:6800' and run command 'logparser'. Or wait until LogParser parses the log.
  • Fail to request logfile from http://scrapyd-1:6800/logs/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2 with extensions ['.log', '.log.gz', '.txt']
  • Using backup stats: LogParser v0.8.2, last updated at 2025-07-17 09:53:46, /var/lib/scrapydweb/data/stats/scrapyd-1_6800/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2.json

PROJECT (sourcing_v2), SPIDER (bca_login_check.gb)

  • Log analysis
  • Log categorization
  • View log
  • Crawler.stats
  • projectsourcing_v2
    spiderbca_login_check.gb
    jobc954a35a62f311f0808ee62340b0abf2
    first_log_time2025-07-17 09:52:50
    latest_log_time2025-07-17 09:53:38
    runtime0:00:48
    crawled_pages 1
    scraped_items 0
    shutdown_reasonN/A
    finish_reasonfinished
    log_critical_count0
    log_error_count1
    log_warning_count0
    log_redirect_count0
    log_retry_count0
    log_ignore_count0
    latest_crawl
    latest_scrape
    latest_log
    current_time
    latest_itemN/A

    • WARNING+

    • error_logs
      1 in total 

      2025-07-17 09:53:37 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1251, in adapt
    extracted: _SelfResultT | Failure = result.result()
                                        ^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/auth_check/bca_login_check.py", line 109, in on_login_page_load_success
    await page.wait_for_selector(selectors["email_input"], timeout=10000)
  File "/usr/local/lib/python3.11/dist-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector
    await self._impl_obj.wait_for_selector(
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_page.py", line 392, in wait_for_selector
    return await self._main_frame.wait_for_selector(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector
    await self._channel.send("waitForSelector", locals_to_params(locals()))
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_connection.py", line 59, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call
    raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 10000ms exceeded.
Call log:
waiting for locator("input[name=\"username\"]") to be visible

      INFO

      DEBUG

    • latest_crawl

      2025-07-17 09:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['playwright']

    • latest_stat

      2025-07-17 09:52:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)

    • scrapy_version

      2.11.2

    • telnet_console

      127.0.0.1:6023

    • telnet_password

      74ac44ebf9a1aecd

    • Head

      2025-07-17 09:52:50 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-07-17 09:52:50 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1090-azure-x86_64-with-glibc2.36
2025-07-17 09:52:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.test-cluster.alx.tech:443
2025-07-17 09:52:50 [urllib3.connectionpool] DEBUG: https://api.alx.test-cluster.alx.tech:443 "POST /car-purchase/debug/supplier-credential-verification-task HTTP/1.1" 204 0
2025-07-17 09:52:50 [scrapy.addons] INFO: Enabled addons:
[]
2025-07-17 09:52:50 [asyncio] DEBUG: Using selector: EpollSelector
2025-07-17 09:52:50 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-07-17 09:52:50 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-07-17 09:52:50 [scrapy.extensions.telnet] INFO: Telnet Password: 74ac44ebf9a1aecd
2025-07-17 09:52:50 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-07-17 09:52:50 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-07-17 09:52:50 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-07-17 09:52:50 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-07-17 09:52:50 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-07-17 09:52:50 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-07-17 09:52:50 [scrapy.middleware] INFO: Enabled item pipelines:
[]
2025-07-17 09:52:50 [scrapy.core.engine] INFO: Spider opened
2025-07-17 09:52:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-07-17 09:52:50 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-07-17 09:52:50 [scrapy-playwright] INFO: Starting download handler

2025-07-17 09:52:50 [scrapy-playwright] INFO: Starting download handler
2025-07-17 09:53:10 [scrapy-playwright] INFO: Launching browser firefox
2025-07-17 09:53:10 [scrapy-playwright] INFO: Browser firefox launched
2025-07-17 09:53:10 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-07-17 09:53:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-07-17 09:53:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/> (resource type: document)
2025-07-17 09:53:11 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.bca.co.uk/>
2025-07-17 09:53:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/> (resource type: document)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dynatrace/ruxitagentjs_ICA7NVfghqrux_10317250630095842.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/docroot/fonts/roboto/roboto.css> (resource type: stylesheet, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/css/website~2025-05-19-10-57-00-000~cache.css> (resource type: stylesheet, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/scripts/bluebird.min~2025-05-19-10-57-00-000~cache.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/scripts/jquery.min~2025-05-19-10-57-00-000~cache.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/scripts/iframeResizer.min~2025-05-19-10-57-00-000~cache.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/scripts/picturefill.min~2025-05-19-10-57-00-000~cache.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/website.bundle~2025-05-19-10-57-00-000~cache.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/scripts/fonts/mtiFontTrackingCode.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://assets.adobedtm.com/e28f204a9afaa64d3abd53e8425bd74c231b805a/satelliteLib-890bc7386f06c2b4e9f438bfbfdf700fe4efb037.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/dynatrace/ruxitagentjs_ICA7NVfghqrux_10317250630095842.js>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/docroot/fonts/roboto/roboto.css>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/css/website~2025-05-19-10-57-00-000~cache.css>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css2?family=Montserrat:ital,wght@0,100..900;1,100..900&display=swap> (resource type: stylesheet, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/scripts/bluebird.min~2025-05-19-10-57-00-000~cache.js>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/scripts/jquery.min~2025-05-19-10-57-00-000~cache.js>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/scripts/iframeResizer.min~2025-05-19-10-57-00-000~cache.js>
2025-07-17 09:53:12 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/website.bundle~2025-05-19-10-57-00-000~cache.js>
2025-07-17 09:53:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/scripts/picturefill.min~2025-05-19-10-57-00-000~cache.js>
2025-07-17 09:53:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/scripts/fonts/mtiFontTrackingCode.js>
2025-07-17 09:53:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css2?family=Montserrat:ital,wght@0,100..900;1,100..900&display=swap>
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fast.fonts.net/t/1.css?apiType=css&projectid=3699a6d6-1bf0-4c36-8ac5-9492541c3a69> (resource type: stylesheet, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://assets.adobedtm.com/e28f204a9afaa64d3abd53e8425bd74c231b805a/satelliteLib-890bc7386f06c2b4e9f438bfbfdf700fe4efb037.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/docroot/fonts/roboto/KFOmCnqEu92Fr1Mu4mxK.woff2> (resource type: font, referrer: https://www.bca.co.uk/docroot/fonts/roboto/roboto.css)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/docroot/fonts/roboto/KFOmCnqEu92Fr1Mu4mxK.woff2>
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fast.fonts.net/t/1.css?apiType=css&projectid=3699a6d6-1bf0-4c36-8ac5-9492541c3a69>
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/0.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/495.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/505.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/470.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/493.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/498.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/494.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['playwright']
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/0.7f7f737633b259786b0a.chunk.js>

    • Tail

      2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/498.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/494.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['playwright']
2025-07-17 09:53:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/0.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.test-cluster.alx.tech:443
2025-07-17 09:53:14 [urllib3.connectionpool] DEBUG: https://api.alx.test-cluster.alx.tech:443 "POST /car-purchase/debug/supplier-credential-verification-task HTTP/1.1" 400 140
2025-07-17 09:53:14 [bca_login_check.gb] INFO: Login page loaded. Entering credentials...
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/495.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/498.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/493.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/494.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/470.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/505.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/109.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/Main-Menu> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/MyBCA-Menu> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://auctionview.bca.co.uk/buyer/api/v1_0/FacetedSearchApi/VehicleTypes?cultureCode=en> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:678f27c8-9c5f-4a9a-af2f-982027f4ba8e/buy-with-bca.jpg> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:5423aec6-e32e-4472-82c2-0ae42e5274cf/sell-with-bca.jpg> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:678f27c8-9c5f-4a9a-af2f-982027f4ba8e/buy-with-bca.jpg>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/190.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:5423aec6-e32e-4472-82c2-0ae42e5274cf/sell-with-bca.jpg>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:61c4340d-85ae-4062-bc8d-8a15ca5e277c/Group%20309.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:25a196fa-0f28-4a99-9213-5e6070624c19/Group%20308.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:61c4340d-85ae-4062-bc8d-8a15ca5e277c/Group%20309.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:2535f31f-7e12-4933-9ffd-903c14a44925/DVLA-plates.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:25a196fa-0f28-4a99-9213-5e6070624c19/Group%20308.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:2535f31f-7e12-4933-9ffd-903c14a44925/DVLA-plates.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.imaging/x-large-half/dam/6750b3f3-3d74-4915-b532-d3d52271176c.png> (resource type: images, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.imaging/x-large-half/dam/038f6158-fac0-457c-99a4-e3ae6575ec54.png> (resource type: images, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:678f27c8-9c5f-4a9a-af2f-982027f4ba8e/buy-with-bca.jpg> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:678f27c8-9c5f-4a9a-af2f-982027f4ba8e/buy-with-bca.jpg>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:5423aec6-e32e-4472-82c2-0ae42e5274cf/sell-with-bca.jpg> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:5423aec6-e32e-4472-82c2-0ae42e5274cf/sell-with-bca.jpg>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:61c4340d-85ae-4062-bc8d-8a15ca5e277c/Group%20309.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:61c4340d-85ae-4062-bc8d-8a15ca5e277c/Group%20309.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:25a196fa-0f28-4a99-9213-5e6070624c19/Group%20308.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:25a196fa-0f28-4a99-9213-5e6070624c19/Group%20308.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:2535f31f-7e12-4933-9ffd-903c14a44925/DVLA-plates.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:2535f31f-7e12-4933-9ffd-903c14a44925/DVLA-plates.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/dam/jcr:5b3f63f4-09a0-4f53-aa1f-1a25c803446f/MyBCAHero-Desktop-4.png> (resource type: image, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.bca.co.uk/dam/jcr:5b3f63f4-09a0-4f53-aa1f-1a25c803446f/MyBCAHero-Desktop-4.png>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/docroot/fonts/roboto/KFOlCnqEu92Fr1MmEU9fBBc4.woff2> (resource type: font, referrer: https://www.bca.co.uk/docroot/fonts/roboto/roboto.css)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer-Legal> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer-Info> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.rest/delivery/menu-links/UK/Social-Links> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/109.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.bca.co.uk/dynatrace/rb_bf00386tfp?type=js3&sn=v_4_srv_4_sn_A32F8958EE383C13B0EC4D1F8D67B81B_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1&svrid=4&flavor=post&vi=UIJCDVVAOLMCTRCNUCMFGUCGBPUMKUWA-0&modifiedSince=1751888691657&bp=3&app=5d68a08db18e8bbb&crc=750987106&en=mpq4v9ub&end=1> (resource type: xhr, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.rest/delivery/menu-links/UK/Main-Menu>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.rest/delivery/menu-links/UK/MyBCA-Menu>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://auctionview.bca.co.uk/buyer/api/v1_0/FacetedSearchApi/VehicleTypes?cultureCode=en>
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/.resources/bca-frontend/chunks/183.7f7f737633b259786b0a.chunk.js> (resource type: script, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/190.7f7f737633b259786b0a.chunk.js>

2025-07-17 09:53:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.imaging/x-large-half/dam/6750b3f3-3d74-4915-b532-d3d52271176c.png>
2025-07-17 09:53:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.imaging/x-large-half/dam/038f6158-fac0-457c-99a4-e3ae6575ec54.png>
2025-07-17 09:53:17 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.bca.co.uk/dynatrace/rb_bf00386tfp?type=js3&sn=v_4_srv_4_sn_A32F8958EE383C13B0EC4D1F8D67B81B_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1&svrid=4&flavor=post&vi=UIJCDVVAOLMCTRCNUCMFGUCGBPUMKUWA-0&modifiedSince=1751888691657&bp=3&app=5d68a08db18e8bbb&crc=2397285783&en=mpq4v9ub&end=1> (resource type: xhr, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer>
2025-07-17 09:53:18 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/docroot/fonts/roboto/KFOlCnqEu92Fr1MmEU9fBBc4.woff2>
2025-07-17 09:53:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer-Legal>
2025-07-17 09:53:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.rest/delivery/menu-links/UK/Footer-Info>
2025-07-17 09:53:19 [bca_login_check.gb] DEBUG: Cookie banner not found or already accepted.
2025-07-17 09:53:19 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/.resources/bca-frontend/chunks/183.7f7f737633b259786b0a.chunk.js>
2025-07-17 09:53:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.bca.co.uk/login> (resource type: document, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:20 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://bcaiconsv2.z33.web.core.windows.net/svgs/regular/angle-down.svg> (resource type: fetch, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:20 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://bcaiconsv2.z33.web.core.windows.net/svgs/regular/angle-down.svg>
2025-07-17 09:53:22 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.bca.co.uk/dynatrace/rb_bf00386tfp?type=js3&sn=v_4_srv_4_sn_A32F8958EE383C13B0EC4D1F8D67B81B_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1&svrid=4&flavor=post&vi=UIJCDVVAOLMCTRCNUCMFGUCGBPUMKUWA-0&modifiedSince=1751888691657&bp=3&app=5d68a08db18e8bbb&crc=473191346&en=mpq4v9ub&end=1> (resource type: other, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:22 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.bca.co.uk/login> (location: https://login.bca.co.uk/connect/authorize?response_type=code&client_id=2A2FDCE3-9190-499A-B370-3907E8DD3CCF&redirect_uri=https%3A%2F%2Fwww.bca.co.uk&scope=openid%20profile%20email%20bcaapi&state=gqk7qhl889scqrdrm5g2735grm)
2025-07-17 09:53:22 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.bca.co.uk/dynatrace/rb_bf00386tfp?type=js3&sn=v_4_srv_4_sn_A32F8958EE383C13B0EC4D1F8D67B81B_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1&svrid=4&flavor=post&vi=UIJCDVVAOLMCTRCNUCMFGUCGBPUMKUWA-0&modifiedSince=1751888691657&bp=3&app=5d68a08db18e8bbb&crc=473191346&en=mpq4v9ub&end=1>
2025-07-17 09:53:22 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://login.bca.co.uk/connect/authorize?response_type=code&client_id=2A2FDCE3-9190-499A-B370-3907E8DD3CCF&redirect_uri=https%3A%2F%2Fwww.bca.co.uk&scope=openid%20profile%20email%20bcaapi&state=gqk7qhl889scqrdrm5g2735grm> (resource type: document, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:23 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://login.bca.co.uk/connect/authorize?response_type=code&client_id=2A2FDCE3-9190-499A-B370-3907E8DD3CCF&redirect_uri=https%3A%2F%2Fwww.bca.co.uk&scope=openid%20profile%20email%20bcaapi&state=gqk7qhl889scqrdrm5g2735grm> (location: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5)
2025-07-17 09:53:23 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5> (resource type: document, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:24 [scrapy-playwright] DEBUG: [Context=default] Response: <403 https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5>
2025-07-17 09:53:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=9608da1cf9bbef13> (resource type: script, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5&__cf_chl_rt_tk=h1pno1lI6do.2wgzF9S6skLjsToSUpe8AEI9X2L6gLs-1752746004-1.0.1.1-xPPOs3x5W9blUHviYi_ije7mYeCDTTT9ZZjTSaC8Zl4)
2025-07-17 09:53:24 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=9608da1cf9bbef13>
2025-07-17 09:53:24 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/turnstile/v0/b/a19380bcf0f6/api.js?onload=yuKrj2&render=explicit> (resource type: script)
2025-07-17 09:53:24 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1778492955:1752743567:vywKzvaS2pXwa9I-UhjvcavAp4UFw3hPXquWlJMKaUs/9608da1cf9bbef13/9UwGJRyPDBBDlLOISFt18m.9BLiDeNGuU7FYRPGtj8U-1752746004-1.2.1.1-FphahvoffFtuDZdUMuwINvgg531Am0BZyJ45yzJe02Vhn82O6ZKh9hMUZ5bbm3Fc> (resource type: xhr, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5)
2025-07-17 09:53:25 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1778492955:1752743567:vywKzvaS2pXwa9I-UhjvcavAp4UFw3hPXquWlJMKaUs/9608da1cf9bbef13/9UwGJRyPDBBDlLOISFt18m.9BLiDeNGuU7FYRPGtj8U-1752746004-1.2.1.1-FphahvoffFtuDZdUMuwINvgg531Am0BZyJ45yzJe02Vhn82O6ZKh9hMUZ5bbm3Fc>
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/turnstile/v0/b/a19380bcf0f6/api.js?onload=yuKrj2&render=explicit>
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/> (resource type: document)

2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/>
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/cmg/1> (resource type: image, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/cmg/1>
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/orchestrate/chl_api/v1?ray=9608da2b7d4afbd6&lang=auto> (resource type: script, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/orchestrate/chl_api/v1?ray=9608da2b7d4afbd6&lang=auto>
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/1832517276:1752743634:_DTvWfo8EA4Xb47AFffUjlC7LbBhZvmpS7Yc1Y0oEeE/9608da2b7d4afbd6/dCnpwVuZA7wmbx_R3ZoutPEPR0xBxR8yVsDADQaS7yY-1752746006-1.2.1.1-h6n.8JshMaZIk.YSkUSPVtIFxsSP_Zgc0F7Cjx3SYgMb2mXS9AACLQNRy57Z4JRn> (resource type: xhr, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:26 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/1832517276:1752743634:_DTvWfo8EA4Xb47AFffUjlC7LbBhZvmpS7Yc1Y0oEeE/9608da2b7d4afbd6/dCnpwVuZA7wmbx_R3ZoutPEPR0xBxR8yVsDADQaS7yY-1752746006-1.2.1.1-h6n.8JshMaZIk.YSkUSPVtIFxsSP_Zgc0F7Cjx3SYgMb2mXS9AACLQNRy57Z4JRn>
2025-07-17 09:53:27 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/pat/9608da2b7d4afbd6/1752746006776/f24db1f80af22444caef4da1c062af570e0b40afee30832dca440d67632abb7b/D8jVEuM3WgFKDbm> (resource type: fetch, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:27 [scrapy-playwright] DEBUG: [Context=default] Response: <401 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/pat/9608da2b7d4afbd6/1752746006776/f24db1f80af22444caef4da1c062af570e0b40afee30832dca440d67632abb7b/D8jVEuM3WgFKDbm>
2025-07-17 09:53:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/d/9608da2b7d4afbd6/1752746006779/9crEIpJSP2-e6cX> (resource type: image, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:28 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/d/9608da2b7d4afbd6/1752746006779/9crEIpJSP2-e6cX>
2025-07-17 09:53:28 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/1832517276:1752743634:_DTvWfo8EA4Xb47AFffUjlC7LbBhZvmpS7Yc1Y0oEeE/9608da2b7d4afbd6/dCnpwVuZA7wmbx_R3ZoutPEPR0xBxR8yVsDADQaS7yY-1752746006-1.2.1.1-h6n.8JshMaZIk.YSkUSPVtIFxsSP_Zgc0F7Cjx3SYgMb2mXS9AACLQNRy57Z4JRn> (resource type: xhr, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/wliod/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:28 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/1832517276:1752743634:_DTvWfo8EA4Xb47AFffUjlC7LbBhZvmpS7Yc1Y0oEeE/9608da2b7d4afbd6/dCnpwVuZA7wmbx_R3ZoutPEPR0xBxR8yVsDADQaS7yY-1752746006-1.2.1.1-h6n.8JshMaZIk.YSkUSPVtIFxsSP_Zgc0F7Cjx3SYgMb2mXS9AACLQNRy57Z4JRn>
2025-07-17 09:53:28 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1778492955:1752743567:vywKzvaS2pXwa9I-UhjvcavAp4UFw3hPXquWlJMKaUs/9608da1cf9bbef13/9UwGJRyPDBBDlLOISFt18m.9BLiDeNGuU7FYRPGtj8U-1752746004-1.2.1.1-FphahvoffFtuDZdUMuwINvgg531Am0BZyJ45yzJe02Vhn82O6ZKh9hMUZ5bbm3Fc> (resource type: xhr, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5)
2025-07-17 09:53:29 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1778492955:1752743567:vywKzvaS2pXwa9I-UhjvcavAp4UFw3hPXquWlJMKaUs/9608da1cf9bbef13/9UwGJRyPDBBDlLOISFt18m.9BLiDeNGuU7FYRPGtj8U-1752746004-1.2.1.1-FphahvoffFtuDZdUMuwINvgg531Am0BZyJ45yzJe02Vhn82O6ZKh9hMUZ5bbm3Fc>
2025-07-17 09:53:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5> (resource type: document, referrer: https://www.bca.co.uk/)
2025-07-17 09:53:31 [scrapy-playwright] DEBUG: [Context=default] Response: <403 https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5>
2025-07-17 09:53:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=9608da49fccaef13> (resource type: script, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5&__cf_chl_rt_tk=RHYD1McmDpMMCBd08S2bSjHF_gd5MXd0tOF7wDyth8c-1752746011-1.0.1.1-lFUjM_VjC5SZd9K5D1jwmtY7Q4OL4zqBUcsLLXpCQ3Y)
2025-07-17 09:53:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/orchestrate/chl_page/v1?ray=9608da49fccaef13>
2025-07-17 09:53:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/turnstile/v0/b/a19380bcf0f6/api.js?onload=yuKrj2&render=explicit> (resource type: script)
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/turnstile/v0/b/a19380bcf0f6/api.js?onload=yuKrj2&render=explicit>
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1062265519:1752743580:4VPIAhuWk4u7vkDKBhHCu7aXFKWgORrDTttDuo4xlSA/9608da49fccaef13/mvf0SRWXV9OKaF7yEYN6kedM8VOHNKDKsBv_5uK5mbY-1752746011-1.2.1.1-edpcuO6IH_xptYOyMFqyuK9SS2RlH1lgeQcTZ6zd9G5Cg6Z59Egfl2BY7aVIqfnM> (resource type: xhr, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5)
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1062265519:1752743580:4VPIAhuWk4u7vkDKBhHCu7aXFKWgORrDTttDuo4xlSA/9608da49fccaef13/mvf0SRWXV9OKaF7yEYN6kedM8VOHNKDKsBv_5uK5mbY-1752746011-1.2.1.1-edpcuO6IH_xptYOyMFqyuK9SS2RlH1lgeQcTZ6zd9G5Cg6Z59Egfl2BY7aVIqfnM>
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/> (resource type: document)
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/>
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/cmg/1> (resource type: image, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/cmg/1>
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/orchestrate/chl_api/v1?ray=9608da52cefdfbd6&lang=auto> (resource type: script, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/orchestrate/chl_api/v1?ray=9608da52cefdfbd6&lang=auto>
2025-07-17 09:53:33 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/769184971:1752743683:r5KI365jPVpo2Af7_1rnRNhwffeWxbI280T6iSs5t9Y/9608da52cefdfbd6/LG12ZtHkxG2lMDuSpynL4tbZjhXuRB8ZDueq8B.r0G4-1752746012-1.2.1.1-njTbFjQxaPHTzEm7Kt2SUTpmiMn0FhDU.wpup_8Ll2.OUtz0Zi4NGHqFQr.bZWT6> (resource type: xhr, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/769184971:1752743683:r5KI365jPVpo2Af7_1rnRNhwffeWxbI280T6iSs5t9Y/9608da52cefdfbd6/LG12ZtHkxG2lMDuSpynL4tbZjhXuRB8ZDueq8B.r0G4-1752746012-1.2.1.1-njTbFjQxaPHTzEm7Kt2SUTpmiMn0FhDU.wpup_8Ll2.OUtz0Zi4NGHqFQr.bZWT6>
2025-07-17 09:53:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/d/9608da52cefdfbd6/1752746013072/BAPdzDGlP1umdjH> (resource type: image, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:33 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/d/9608da52cefdfbd6/1752746013072/BAPdzDGlP1umdjH>
2025-07-17 09:53:34 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/pat/9608da52cefdfbd6/1752746013077/58149397b51b738f1b6646ea2b0763849dc2fc0cd14c53e69120dff2a79a8d32/H699C6055s8BEKm> (resource type: fetch, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:34 [scrapy-playwright] DEBUG: [Context=default] Response: <401 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/pat/9608da52cefdfbd6/1752746013077/58149397b51b738f1b6646ea2b0763849dc2fc0cd14c53e69120dff2a79a8d32/H699C6055s8BEKm>
2025-07-17 09:53:34 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/769184971:1752743683:r5KI365jPVpo2Af7_1rnRNhwffeWxbI280T6iSs5t9Y/9608da52cefdfbd6/LG12ZtHkxG2lMDuSpynL4tbZjhXuRB8ZDueq8B.r0G4-1752746012-1.2.1.1-njTbFjQxaPHTzEm7Kt2SUTpmiMn0FhDU.wpup_8Ll2.OUtz0Zi4NGHqFQr.bZWT6> (resource type: xhr, referrer: https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/turnstile/if/ov2/av0/rcv/ciz8n/0x4AAAAAAADnOjc0PNeA8qVm/light/fbE/new/normal/auto/)
2025-07-17 09:53:34 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://challenges.cloudflare.com/cdn-cgi/challenge-platform/h/b/flow/ov1/769184971:1752743683:r5KI365jPVpo2Af7_1rnRNhwffeWxbI280T6iSs5t9Y/9608da52cefdfbd6/LG12ZtHkxG2lMDuSpynL4tbZjhXuRB8ZDueq8B.r0G4-1752746012-1.2.1.1-njTbFjQxaPHTzEm7Kt2SUTpmiMn0FhDU.wpup_8Ll2.OUtz0Zi4NGHqFQr.bZWT6>
2025-07-17 09:53:34 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1062265519:1752743580:4VPIAhuWk4u7vkDKBhHCu7aXFKWgORrDTttDuo4xlSA/9608da49fccaef13/mvf0SRWXV9OKaF7yEYN6kedM8VOHNKDKsBv_5uK5mbY-1752746011-1.2.1.1-edpcuO6IH_xptYOyMFqyuK9SS2RlH1lgeQcTZ6zd9G5Cg6Z59Egfl2BY7aVIqfnM> (resource type: xhr, referrer: https://login.bca.co.uk/login?signin=b8deb4901d86b18ffc0952676e85e5b5)

2025-07-17 09:53:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://login.bca.co.uk/cdn-cgi/challenge-platform/h/b/flow/ov1/1062265519:1752743580:4VPIAhuWk4u7vkDKBhHCu7aXFKWgORrDTttDuo4xlSA/9608da49fccaef13/mvf0SRWXV9OKaF7yEYN6kedM8VOHNKDKsBv_5uK5mbY-1752746011-1.2.1.1-edpcuO6IH_xptYOyMFqyuK9SS2RlH1lgeQcTZ6zd9G5Cg6Z59Egfl2BY7aVIqfnM>
2025-07-17 09:53:37 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/twisted/internet/defer.py", line 1251, in adapt
    extracted: _SelfResultT | Failure = result.result()
                                        ^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/auth_check/bca_login_check.py", line 109, in on_login_page_load_success
    await page.wait_for_selector(selectors["email_input"], timeout=10000)
  File "/usr/local/lib/python3.11/dist-packages/playwright/async_api/_generated.py", line 7831, in wait_for_selector
    await self._impl_obj.wait_for_selector(
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_page.py", line 392, in wait_for_selector
    return await self._main_frame.wait_for_selector(**locals_to_params(locals()))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_frame.py", line 323, in wait_for_selector
    await self._channel.send("waitForSelector", locals_to_params(locals()))
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_connection.py", line 59, in send
    return await self._connection.wrap_api_call(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/playwright/_impl/_connection.py", line 514, in wrap_api_call
    raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.TimeoutError: Page.wait_for_selector: Timeout 10000ms exceeded.
Call log:
waiting for locator("input[name=\"username\"]") to be visible

2025-07-17 09:53:38 [scrapy.core.engine] INFO: Closing spider (finished)
2025-07-17 09:53:38 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (0 items) in: file:///var/lib/scrapyd/items/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2.jl
2025-07-17 09:53:38 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 169,
 'downloader/request_count': 1,
 'downloader/request_method_count/GET': 1,
 'downloader/response_bytes': 37057,
 'downloader/response_count': 1,
 'downloader/response_status_count/200': 1,
 'elapsed_time_seconds': 47.5839,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 7, 17, 9, 53, 38, 93093, tzinfo=datetime.timezone.utc),
 'log_count/DEBUG': 160,
 'log_count/ERROR': 1,
 'log_count/INFO': 18,
 'memusage/max': 111923200,
 'memusage/startup': 111923200,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 78,
 'playwright/request_count/aborted': 15,
 'playwright/request_count/method/GET': 67,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 8,
 'playwright/request_count/resource_type/document': 8,
 'playwright/request_count/resource_type/fetch': 11,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 15,
 'playwright/request_count/resource_type/images': 2,
 'playwright/request_count/resource_type/other': 1,
 'playwright/request_count/resource_type/script': 25,
 'playwright/request_count/resource_type/stylesheet': 4,
 'playwright/request_count/resource_type/xhr': 10,
 'playwright/response_count': 58,
 'playwright/response_count/method/GET': 49,
 'playwright/response_count/method/POST': 9,
 'playwright/response_count/resource_type/document': 8,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/images': 2,
 'playwright/response_count/resource_type/other': 1,
 'playwright/response_count/resource_type/script': 23,
 'playwright/response_count/resource_type/stylesheet': 4,
 'playwright/response_count/resource_type/xhr': 8,
 'response_received_count': 1,
 'scheduler/dequeued': 1,
 'scheduler/dequeued/memory': 1,
 'scheduler/enqueued': 1,
 'scheduler/enqueued/memory': 1,
 'spider_exceptions/TimeoutError': 1,
 'start_time': datetime.datetime(2025, 7, 17, 9, 52, 50, 509193, tzinfo=datetime.timezone.utc)}
2025-07-17 09:53:38 [scrapy.core.engine] INFO: Spider closed (finished)

    • Log

      /1/log/utf8/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2/?job_finished=True

    • Source

      http://scrapyd-1:6800/logs/sourcing_v2/bca_login_check.gb/c954a35a62f311f0808ee62340b0abf2.log

  • sourcelog
    last_update_time2025-07-17 09:53:38
    last_update_timestamp1752746018
    downloader/request_bytes169
    downloader/request_count1
    downloader/request_method_count/GET1
    downloader/response_bytes37057
    downloader/response_count1
    downloader/response_status_count/2001
    elapsed_time_seconds47.5839
    feedexport/success_count/FileFeedStorage1
    finish_reasonfinished
    finish_timedatetime.datetime(2025, 7, 17, 9, 53, 38, 93093, tzinfo=datetime.timezone.utc)
    log_count/DEBUG160
    log_count/ERROR1
    log_count/INFO18
    memusage/max111923200
    memusage/startup111923200
    playwright/context_count1
    playwright/context_count/max_concurrent1
    playwright/context_count/persistent/False1
    playwright/context_count/remote/False1
    playwright/page_count1
    playwright/page_count/max_concurrent1
    playwright/request_count78
    playwright/request_count/aborted15
    playwright/request_count/method/GET67
    playwright/request_count/method/POST11
    playwright/request_count/navigation8
    playwright/request_count/resource_type/document8
    playwright/request_count/resource_type/fetch11
    playwright/request_count/resource_type/font2
    playwright/request_count/resource_type/image15
    playwright/request_count/resource_type/images2
    playwright/request_count/resource_type/other1
    playwright/request_count/resource_type/script25
    playwright/request_count/resource_type/stylesheet4
    playwright/request_count/resource_type/xhr10
    playwright/response_count58
    playwright/response_count/method/GET49
    playwright/response_count/method/POST9
    playwright/response_count/resource_type/document8
    playwright/response_count/resource_type/fetch10
    playwright/response_count/resource_type/font2
    playwright/response_count/resource_type/images2
    playwright/response_count/resource_type/other1
    playwright/response_count/resource_type/script23
    playwright/response_count/resource_type/stylesheet4
    playwright/response_count/resource_type/xhr8
    response_received_count1
    scheduler/dequeued1
    scheduler/dequeued/memory1
    scheduler/enqueued1
    scheduler/enqueued/memory1
    spider_exceptions/TimeoutError1
    start_timedatetime.datetime(2025, 7, 17, 9, 52, 50, 509193, tzinfo=datetime.timezone.utc)