[2ch.su/org] Cloudflare challenge

[DWolf19]

[2ch][error] ChallengeError: Cloudflare challenge (403 Forbidden)

[DWolf19]

When I try
gallery-dl https://2ch.su/e/res/ --user-agent browser --cookies-from-browser

[2ch][error] ChallengeError: Cloudflare challenge (403 Forbidden)

On .org
[gallery-dl][error] Unsupported URL https://2ch.org/e/res/

[0xvd]

it works
i opened your url in my browser but it says 404 Not Found nginx but if i remove res then it works

[gallery-dl][debug] Version 1.30.10
[gallery-dl][debug] Python 3.12.10 - Windows-11-10.0.26200-SP0
[gallery-dl][debug] requests 2.32.5 - urllib3 2.5.0
[gallery-dl][debug] Configuration Files []
[gallery-dl][debug] Starting DownloadJob for 'https://2ch.su/e/'
[2ch][debug] Using _2chBoardExtractor for 'https://2ch.su/e/'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): 2ch.su:443
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/index.json HTTP/1.1" 200 None
[2ch][debug] Using _2chThreadExtractor for 'https://2ch.su/e/res/268534.html'
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/res/268534.json HTTP/1.1" 200 None
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/src/268534/14951894374800.gif HTTP/1.1" 200 1142234
.\gallery-dl\2ch\e\268534 Официальный прикрепленный тред _request_\14951894374800 14945922408810.gif
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/src/268534/17628570161550.jpg HTTP/1.1" 200 157017
.\gallery-dl\2ch\e\268534 Официальный прикрепленный тред _request_\17628570161550 posjeta-stricu-i-strini.jpg
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/src/268534/17628658945400.jpg HTTP/1.1" 200 144865
.\gallery-dl\2ch\e\268534 Официальный прикрепленный тред _request_\17628658945400 IMG20251110195310125.jpg
[urllib3.connectionpool][debug] https://2ch.su:443 "GET /e/src/268534/17628661287490.webm HTTP/1.1" 200 8697770
.\gallery-dl\2ch\e\268534 Официальный прикрепленный тред _request_\17628661287490 15787924056942 (2).webm

[0xvd]

@mikf So there option of --impersonate like yt-dlp have so it will make perfect TLS, etc not full solving but it works. Gallery-dl Have ?

[mikf]

On .org
[gallery-dl][error] Unsupported URL https://2ch.org/e/res/

7676534

--impersonate like yt-dlp

No, not yet.

[DWolf19]

I juat test and it works, gallery-dl -v https://2ch.su/e/res/** --user-agent browser --cookies-from-browser
I don't know why it doesn't before

[DWolf19]

Now it breaks in the middle of the downloads and still even after refreshing the page for cloudflare
ChallengeError: Cloudflare challenge (403 Forbidden)

[0xvd]

so https://2ch.su/e/ == https://2ch.su/e/res or both are different urls.

[mikf]

$ gallery-dl -E https://2ch.su/e/
Category / Subcategory
  "2ch" / "board"

$ gallery-dl -E https://2ch.su/e/res
[gallery-dl][error] Unsupported URL 'https://2ch.su/e/res'

$ gallery-dl -E https://2ch.su/a/res/6202876.html
Category / Subcategory
  "2ch" / "thread"

[DWolf19]

Okay I just found out why it stopped or maybe fail from the start
When using --user-agent browser it will open 127.0.0.1 for user agent and my browser has auto discard tab. It works again after re-open.
For 2ch.su/e/res I just don't share the rest of the numbers here, that should be obvious.

[mikf]

The result for --user-agent browser is cached for 24h, by the way.

[DWolf19]

This site throws a "Cloudflare challenge" every 20 minutes or so.