[Weibo] support for avatar

[skymatr1x]

https://weibo.com/u/USERID?tabtype=album?tabtype=album are divided into two sections: "albums" and "all photo".

there's a "profile pictures" album under "albums", which has all profile pictures uploaded by the user.

all images uploaded as profile pictures are excluded from the "all photos" section. and "include": album doesn't download any photos in the "profile pictures" album.

i also checked the files downloaded with "feed" before it stopped working, profile pictures are not included either.

gallery-dl is able to download the profile pictures by providing the direct link of it (https://wx1.sinaimg.cn/large/ID.jpg, https://wx4.sinaimg.cn/large/ID.jpg)

btw, "article" is a supported value in docs, but output shows [weibo][warning] Invalid include 'article'.

[mikf]

Could you provide a specific example of what exactly you mean?

I imagine you want to download something like the "subalbum" from https://weibo.com/1758989602?tabtype=album, i.e. what you get when clicking the first image, but I'm not at all sure. (相册 is apparently "Photo Album")

[skymatr1x]

interesting, all the profiles i've come across have the "profile pictures" (头像) album under "Photo Album".

here's one: https://weibo.com/u/2142058927?tabtype=album

the url doesn't change in the address bar when clicking through the different albums. and the direct link is found by clicking open the photo, then click "original" (原图).

btw, i found https://weibo.com/u/1295950295?tabtype=article to have the article tab (which seems rare nowadays), but it's broken like "feed". i'm just curious whether "article" has been removed as a supported value, or if it's a bug that output shows it to be Invalid include.

[mikf]

I've added initial support for weibo "subalbums": b1a708b

You can download a subalbum by adding -<identifier> to a ?tabtype=album URL, e.g.
https://weibo.com/u/2142058927?tabtype=album-头像 or
https://weibo.com/u/2142058927?tabtype=album-4

You'll probably need to adjust your directory & filename settings for them, since there is much less available metadata than for regular status results.

[skymatr1x]

thank you! appending user urls with ?tabtype=album-头像 works great, i'm able to add {subalbum[pic_title]} to the directory config to create a folder for each subalbum. though this method is a bit more hands on and require adjusting the directory config between profile and subalbum downloads, then i noticed the new weibo.album.subalbums option.

i added weibo.album.subalbums: true to config, and i'm getting this error in the middle of the download:

[weibo][error] An unexpected error occurred: KeyError - 'pid'. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[weibo][debug] 
Traceback (most recent call last):
  File "/Users/USER/.local/pipx/venvs/gallery-dl/lib/python3.13/site-packages/gallery_dl/job.py", line 158, in run
    msg = self.dispatch(extractor)
  File "/Users/USER/.local/pipx/venvs/gallery-dl/lib/python3.13/site-packages/gallery_dl/job.py", line 209, in dispatch
    for msg, url, kwdict in messages:
                            ^^^^^^^^
  File "/Users/USER/.local/pipx/venvs/gallery-dl/lib/python3.13/site-packages/gallery_dl/extractor/weibo.py", line 420, in items_subalbum
    file["filename"] = file["pid"]
                       ~~~~^^^^^^^
KeyError: 'pid'

i also noticed that all files (including the ones of "include": ["album"] and not subalbums) started using filename metadata for filenames rather than the usual status id (i don't have custom filename format in config). i guess this is to accommodate the lack of "id" metadata of subalbums, maybe it's better to default only subalbum files to use "filename" as filenames, and have other subcategory files maintain the standard default "id" filename?

how should i edit the directory config so each subalbum has its own folder under the album subcatogory when downloading profile? (appending {subalbum[pic_title]} to weibo.directory only works with subalbum specified urls)

[mikf]

i added weibo.album.subalbums: true to config, and i'm getting this error in the middle of the download:

Probably due to some currently unsupported and different post type (GIFs?).
Could you provide a reproducible example URL?

i guess this is to accommodate the lack of "id" metadata of subalbums,

Exactly. There is no status post and/or status_id for subalbum files.

maybe it's better to default only subalbum files to use "filename" as filenames, and have other subcategory files maintain the standard default "id" filename?

But that's already the default. Only (sub)album files use filename/pid as their name, while everything else stays the same as before.

how should i edit the directory config so each subalbum has its own folder under the album subcatogory when downloading profile? (appending {subalbum[pic_title]} to weibo.directory only works with subalbum specified urls)

You could do {subalbum[pic_title]|''} (empty directories are omitted)
or use subcategory specific settings, i.e. set weibo.album.directory as well as the general weibo.directory.

edit:
I should also mention, that you can make it download subalbums-only by using https://weibo.com/u/USER?tabtype=album-only as URL.

So https://weibo.com/u/USER?tabtype=album for regular main-album results and https://weibo.com/u/USER?tabtype=album-only for subalbums.

Or https://weibo.com/u/USER?tabtype=album-all for main album + subalbums.

[skymatr1x]

Could you provide a reproducible example URL?

config "include": ["album"] and "subalbums": true with https://weibo.com/u/2142058927 downloaded 152 jpg then get this error with https://weibo.com:443 "GET /ajax/profile/getImageWall? and aborted the command. is getImageWall an unsupported type?

the downloaded files here used "filename" as file names even they're under albums and not subalbums.

"subalbums": true seem to be downloading album as subalbum files (using "filename" as file names and writing less metadata). "subalbums": false returns to usual (using "id" as filenames for album files and having more complete json metadata).

But that's already the default. Only (sub)album files use filename/pid as their name, while everything else stays the same as before.

i think "subalbums": true changed how this works.

I should also mention, that you can make it download subalbums-only by using https://weibo.com/u/USER?tabtype=album-only as URL.

thanks, great to know!

[mikf]

I've added a workaround/fix for the KeyError: 'pid' case (baafc64)
as well as a "subalbums" include option (adca123)