PlaywrightCrawler extract_links does not respect strategy

[phughesion-h3]

I was crawling a test site that I have hosted locally (localhost).

My PlaywrightCrawler subclass must add additional user_data to each request, so I extract and form each request manually.

new_requests = await context.extract_links(strategy='same-origin')
for new_request in new_requests:
        print(f"[LINK] Extracted link: {new_request.url}")

I start my crawl pointed at http://localhost, yet the crawler ends up crawling YouTube since there is a link to YouTube on my site.

[Mantisus]

Hey @phughesion-h3

Thanks for catching that.

Apparently, there was an error in splitting the original enqueue_links function into extract_links and add_requests. Since the strategy is applied in add_requests. And is completely ignored in extract_links now

new_requests = await context.extract_links()
await context.add_requests(new_requests, strategy='same-origin')