[Fanbox] Cloudflare challenges

[biggestsonicfan]

Looks like Fanbox recently updated to add cloudflare challenges? I'm using my cookies from browser with the same browser type and user agent.

EDIT: Only way I've gotten anything to work is by a Japanese VPN

[drunk-moe]

Refresh your cookies and double check your user agent. Just happened to me, got my UA from the requested headers in the network panel and rexported my cookies and it works fine now. A bit annoying but what can you do?

Also - not using any sort of VPN or anything. It worked fine for me once I grabbed my cookies again and used the same User Agent my browser was using.

[biggestsonicfan]

Strangely, it was the "browser": "firefox" key that was the culprit. Removing that resolved my issue.

[mikf]

Removing that resolved my issue.

browser overrides user-agent when present.

[bugreporter2334]

drunk-moe's method is not quite working for me. spoofing my browser's user agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36 and using the same FANBOXSESSID from the cookies still gives me the error
[fanbox][warning] Cloudflare challenge
[fanbox][error] HttpError: '403 Forbidden' for 'https://api.fanbox.cc/post.listCreator?creatorId=[creator]&limit=10'
refreshing the page on my browser does not give a cloudfare challenge.

edit:
gallery-dl version for posterity (windows):

$ gallery-dl --version
1.27.1

relevant portions of my config:

    "extractor":
    {
        "base-directory": "./gallery-dl/",
        "parent-directory": false,
        "postprocessors": null,
        "archive": null,
        "cookies": null,
        "cookies-update": true,
        "proxy": null,
        "skip": true,

        "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36",
        "retries": 4,
        "timeout": 30.0,
        "verify": true,
        "fallback": true,

        "sleep": 0,
        "sleep-request": 0,
        "sleep-extractor": 0,

        "path-restrict": "auto",
        "path-replace": "_",
        "path-remove": "\\u0000-\\u001f\\u007f",
        "path-strip": "auto",
        "extension-map": {
            "jpeg": "jpg",
            "jpe" : "jpg",
            "jfif": "jpg",
            "jif" : "jpg",
            "jfi" : "jpg"
        },

        "fanbox":
        {
            "cookies": 
            {
              "FANBOXSESSID": "<sessionid>"
            },
            "postprocessors": 
            [{
              "name": "metadata",
              "event": "post",
              "mode": "json",
              "filename": "{id}.json",
              "directory": "posts"
            }]
        },

[ZenoArrows]

I've also suddenly started encountering these none of the methods described so far resolve it unfortunately.

[biggestsonicfan]

"FANBOXSESSID": "<sessionid>"

You are missing both the cf_clearance and __cf_bm cloudflare cookies.

[ZenoArrows]

You are missing both the cf_clearance and __cf_bm cloudflare cookies.

I've tried that also with the user agent set to be the same as my browser, but it still seems to be able to distinguish between my browser and gallery-dl.

[biggestsonicfan]

My reply was for @bugreporter2334, I can't see your config file if you don't post it.

[bugreporter2334]

"FANBOXSESSID": "<sessionid>"

You are missing both the cf_clearance and __cf_bm cloudflare cookies.

Yep, works now with these two cookies. Here's the syntax:

"fanbox":
        {
            "cookies": 
            {
              "FANBOXSESSID": "fanbox cookie",
              "cf_clearance": "cf cookie1",
              "__cf_bm": "cf cookie 2"
            },
            "postprocessors": 
            [{
              "name": "metadata",
              "event": "post",
              "mode": "json",
              "filename": "{id}.json",
              "directory": "posts"
            }]
        },

On Chrome you can extract them from the same Application tab that you normally get your Fanbox cookies from.

[bossanovaorca]

"fanbox": {
  "cookies": ["firefox", null, null, null, ".fanbox.cc"],
},

I currently retrieve my cookies from my browser. do I need to change this method for it to retrieve the cloudflare cookies properly or am I using it incorrectly?

[mikf]

You are using it correctly, but you need to use the user-agent of your browser as well.

"fanbox": {
  "cookies": ["firefox", null, null, null, ".fanbox.cc"],
  "user-agent": "..."
},

Extracting cookies from a browser profile can only get cookies that have been written to disk. Sometimes it takes a while for your browser to update its cookies database file.

[tryoutuser]

i've got this error instead :

[2024-07-02 23:09:03][warning] cookies: not enough values to unpack (expected 7, got 6)
[2024-07-02 23:09:03][warning] no 'FANBOXSESSID' cookie set

i'm using gallery-dl latest v1.27.1.
my config for fanbox :

        "fanbox":
        {
            "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36",
            "cookies": "%APPDATA%\\gallery-dl\\fanbox.txt",
            "cookies-update": false,
            "base-directory": "I:\\Server\\Server 1\\home\\user\\gallery-dl\\kemonoparty\\",
            "verify": false,
            "archive": "%APPDATA%\\gallery-dl\\fanbox.sqlite3",
            "archive-format": "{user['userId']}_{id}_{num:02d}_{filename}",
            "embeds": false,
            "filename": "{id}_{title}_{num:02d}_{filename}.{extension}",
            "directory": ["fanbox", "{user['userId']}"]
        },

inside my cookies text file :

# Netscape HTTP Cookie File
# http://curl.haxx.se/rfc/cookie_spec.html
# This file was generated by EditThisCookie
.fanbox.cc	TRUE	/	TRUE	1719936563	__cf_bm <redacted>
.fanbox.cc        TRUE       /       TRUE        1751445568    cf_clearance <redacted>
.fanbox.cc	TRUE	/	TRUE	1722524401	agreement_master_terms_of_use_202408	1
.fanbox.cc	TRUE	/	TRUE	1722526763	FANBOXSESSID	<redacted>
.fanbox.cc	TRUE	/	TRUE	1725825006	p_ab_d_id	187055155
.fanbox.cc	TRUE	/	TRUE	1725825006	p_ab_id	5
.fanbox.cc	TRUE	/	TRUE	1725825006	p_ab_id_2	3
.fanbox.cc	TRUE	/	TRUE	1751481237	privacy_policy_agreement	7
.fanbox.cc	TRUE	/	TRUE	1754494763	privacy_policy_notification	0
www.fanbox.cc	FALSE	/	TRUE	0	d_prefs	<redacted>

and i'm connected to softether VPN volunteer servers that is not the public-vpn.*number*.ad.ne.jp ones.

[mikf]

@tryoutuser
Values in a cookies.txt file must be separated by tab characters and not spaces like it is the case for your cf_clearance line. Replace it with the following and it should load:

.fanbox.cc	TRUE	/	TRUE	1751445568	cf_clearance	<redacted>