Error on huge Pixiv gallery list.

[gphg]

I executed this command to download whole gallery from a tag (basically search keyword):

gallery-dl https://www.pixiv.net/tags/プリキュア/artworks

I got this error:

[pixiv][error] API request failed: {'user_message': '', 'message': '{"offset":["Offset must be no more than 5000"]}', 'reason': '', 'user_message_details': {}}

---

Rest of the this message may not related to the issue.

I have this config:

{
	"extractor": {
		"pixiv": {
			"username": "CLASSIFIED",
			"password": "CLASSIFIED",
			"directory": ["{category}", "search", "{search[word]}", "{user[id]} {user[name]}"]
		}
	}
}

I'm having difficult on organizing which blacklisted artist. I set directory configuration under Pixiv as above. The problem is it applied to the normal other url too, eg: https://www.pixiv.net/artworks/<artworks_id> and https://www.pixiv.net/users/<user_id>.

Invalid non search url will output like this:

* .\gallery-dl\pixiv\search\None\{user[id]} {user[name]}\{id}_p{num}.{extension}

How do I apply above configuration only for search url?

[hrxn]

You can specify the settings in your config for each subcategory in a given extractor, so given your config example above,
you can do this for searches only:

{
    "extractor": {
	            "pixiv": {
                        "search":
                        {
			    "username": "CLASSIFIED",
		 	    "password": "CLASSIFIED",
			     "directory": ["{category}", "search", "{search[word]}", "{user[id]} {user[name]}"]
                        },
                        <config level for pixiv here, i.e. applies to all subcategories>
                    }
    }
}

[mikf]

Regarding your first error: The Pixiv Mobile API only allows searches to go 5000 posts deep and you get the error you posted when trying to go any further than that. Nothing that can really be done except maybe a better error message. Downloading from Pixiv doesn't need a password anymore, by the way.

[AlttiRi]

BTW, is it not possible to list posts in reverse order? To download from the last position 5000 posts, and 5000 posts from the start one. 10000 total.