[site change] poipiku

[GOGOsu]

English is not my native language, sorry for my weird grammar.

gallery-dl got 403's for poipiku downloads.

gallery-dl https://poipiku.com/2/12192962.html
[downloader.http][warning] '403 Forbidden' for 'https://cdn.poipiku.com/000000002/012192962_BkX6X00re.png'
[download][error] Failed to download 12192962_1.png

I checked the site, and found that the URL formats for both preview images and original images are changed. The URL for a preview image is now https://cdn.poipiku.com/000000002/012192962_BkX6X00re.png_640.jpg , and for a original image, it now contains a s3-like key https://cdn.poipiku.com/000000002/012192962_BkX6X00re.png?Expires=1234567&Signature=xxxxx&Key-Pair-Id=xxxxx .

[mikf]

So downloading original images will now require

• Being logged in
• An extra request to /f/ShowIllustDetailF.jsp for each file per post

[twomfwp]

How to add the extra request?

[mikf]

Wait until this is implemented.

[mikf]

Fixed in 0aac996

Downloading original images now requires authenticated cookies (POIPIKU_LK in particular). Otherwise it will show a warning and download only thumbnail images.

[GOGOsu]

The fixed version can download original images correctly if conditions are met, but if not, like when the password is incorrect or when a following status is not detected, the extractor skips the post silently, without a warning.

The response from /f/ShowIllustDetailF.jsp is {"result":0,"html":"","error_code":-3} when anything goes wrong. It doesn't have a result_num used in the ifs for warings at https://github.com/mikf/gallery-dl/blob/0aac99673d9f6ac721e9d24c7380d4f4957be966/gallery_dl/extractor/poipiku.py#L92C1-L92C46 .

It also has no human readable error message in html, not even in error_code (I tried multiple conditions in different posts, like an incorrect password, not following the author etc, get all -3).

Maybe we should change the warning condition to check error_code, and output a generic warning message? Or fire a request to ShowAppendFileF to get the warning text if error_code looks bad?

[twomfwp]

I still have the 403 error even though i updated

[mikf]

I tried to improve the error message situation in d49b819, but it might be too strict and prevent "favorite only" / "retweet only" downloads.

[GOGOsu]

I checked the new code and yes the new _discard_post prevents "favorite only" downloads even it is favored. It also cannot detect the post type if the author selected "show first image" when posting, like this one: https://poipiku.com/12496605/12296030.html (it's sfw)

In the new code, if I cannot extract originals from _show_illust_detail, it use _show_append_file to get a proper warning. So I'm wondering if we could just remove the _discard_post precheck and leave the warning and discarding job to _show_append_file ?

I created a pull request #8374 with edits above, please take a look.