[Fanbox] The filter doesn't work when posts are skipped.

[a84r7a3rga76fg]

I've configured gallery-dl to abort when it reaches a post older than October.

--filter "date >= datetime(2025, 10, 1) or abort()"

But when it skips posts, which I presume it's doing because they're paywalled posts and I'm not an active subscriber, gallery-dl never aborts. When it reached the post 10657504, it should've aborted, but it kept going till the oldest post.

[gallery-dl][debug] Version 1.31.0-dev:2025.11.15 - Executable (dev/windows)
[gallery-dl][debug] Python 3.13.9 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.32.5 - urllib3 2.5.0
[gallery-dl][debug] Configuration Files ['C:\\Users\\UserAccount1\\gallery-dl\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://www.pixiv.net/fanbox/creator/62133'
[fanbox][debug] Using FanboxRedirectExtractor for 'https://www.pixiv.net/fanbox/creator/62133'
[fanbox][debug] cookies: Loading cookies from '~/gallery-dl/cookies/cookies-fanbox-cc.txt'
[fanbox][debug] Sleeping 1.84 seconds (extractor)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): www.pixiv.net:443
[urllib3.connectionpool][debug] https://www.pixiv.net:443 "HEAD /fanbox/creator/62133 HTTP/1.1" 302 0
[fanbox][debug] Using FanboxCreatorExtractor for 'https://atahuta.fanbox.cc/'
[fanbox][debug] cookies: Loading cookies from '~/gallery-dl/cookies/cookies-fanbox-cc.txt'
[fanbox][warning] cookies: fanbox.cc/FANBOXSESSID will expire in less than 1 hour
[fanbox][debug] Sleeping 1.99 seconds (extractor)
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): api.fanbox.cc:443
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.paginateCreator?creatorId=atahuta HTTP/1.1" 200 412
[fanbox][debug] Sleeping 1.83 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.listCreator?creatorId=atahuta&firstPublishedDatetime=2025-11-14%2020%3A01%3A07&firstId=10902042&sort=newest&limit=10 HTTP/1.1" 200 1620
[fanbox][debug] Sleeping 1.92 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.info?postId=10902042 HTTP/1.1" 403 None
[fanbox][warning] Skipping post 10902042 (HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.info?postId=10902042')
[fanbox][debug] Sleeping 1.59 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.info?postId=10792268 HTTP/1.1" 403 None
[fanbox][warning] Skipping post 10792268 (HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.info?postId=10792268')
[fanbox][debug] Sleeping 1.60 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.info?postId=10657504 HTTP/1.1" 403 None
[fanbox][warning] Skipping post 10657504 (HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.info?postId=10657504')
[fanbox][debug] Sleeping 1.78 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.info?postId=10559617 HTTP/1.1" 403 None
[fanbox][warning] Skipping post 10559617 (HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.info?postId=10559617')
[fanbox][debug] Sleeping 1.45 seconds (request)
[urllib3.connectionpool][debug] https://api.fanbox.cc:443 "GET /post.info?postId=10483367 HTTP/1.1" 403 None
[fanbox][warning] Skipping post 10483367 (HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.info?postId=10483367')
[fanbox][debug] Sleeping 1.56 seconds (request)
...

[mikf]

--filter triggers only for file results. Furthermore, there is no date or really any data for these 403 Forbidden posts available anyway, meaning there is nothing to filter by or run code on.

[a84r7a3rga76fg]

So there is no way to filter posts without files?

Edit: I think all Fanbox posts with an ID less than 10660000 are from before October 2025. Can gallery-dl abort based on post ID?

[mikf]

The only piece of information available to gallery-dl about a 403 Forbidden post is currently the Skipping post <ID> logging message, and that's not really enough to selectively stop.

There is https://gdl-org.github.io/docs/configuration.html#extractor-actions, but that can't do more than apply regex patterns.

[a84r7a3rga76fg]

The thing I wanna do is get all of the post IDs before October 2025 for any creator. Is that not possible with gallery-dl?

[mikf]

No, not really.

Just write your own script that queries

https://api.fanbox.cc/post.paginateCreator?creatorId=atahuta

with

{
    "Accept" : "application/json, text/plain, */*",
    "Origin" : "https://www.fanbox.cc",
    "Referer": "https://www.fanbox.cc/",
    "Sec-Fetch-Dest": "empty",
    "Sec-Fetch-Mode": "cors",
    "Sec-Fetch-Site": "same-site",
}

as headers and parse its results.

I guess you could also run gallery-dl with --write-pages and inspect the files it creates.

[a84r7a3rga76fg]

I'll use their API. Thanks.

[a84r7a3rga76fg]

I closed the issue too soon... How do you get the API to accept the URL with the creator ID? It doesn't accept "https://www.pixiv.net/fanbox/creator/62133".

[mikf]

Follow the Pixiv redirect and you'll get atahuta as "ID"

edit: Use the URL from #8643 (comment)

[mikf]

I've also (locally) updated gallery-dl's fanbox code so it still returns some metadata for restricted posts, although it still won't be able to interact with --filter.

[a84r7a3rga76fg]

How do I get the Pixiv redirect to work in a Python script? Since gallery-dl accepts input URLs like https://www.pixiv.net/fanbox/creator/62133, can gallery-dl output the ID atahuta or save the ID to a text file?

[mikf]

$ gallery-dl -g https://www.pixiv.net/fanbox/creator/62133
https://atahuta.fanbox.cc/

Redirect that to a file with >>