How to stop gallery-dl from looping after downloading all Facebook photos?

[wankio]

So I just tested with this profile:
https://www.facebook.com/photo/?fbid=101377563356622&set=pb.100004531353465.-2207520000

Today I noticed that it keeps looping. Once it reaches the oldest picture (the URL above), it clicks Next and loops back to the beginning, starting again from the newest photos and going from newest to oldest.

You can use this URL to continue from where you left off (with &setextract added):

However, when it reaches the end of the gallery (all photos are already downloaded), it still clicks Next, which causes the loop. As a result, it goes through the entire gallery again, skipping but still processing thousands of already downloaded images.

[mikf]

The facebook code explicitly handles loops and stops when encountering a photo it had seen previously:

gallery-dl/gallery_dl/extractor/facebook.py

Lines 303 to 308 in d36a441

	elif photo["next_photo_id"] in all_photo_ids:
	if photo["next_photo_id"] != photo["id"]:
	self.log.debug(
	"Detected a loop in the set, it's likely finished. "
	"Extraction is over."
	)

You can use something like --filter "int(id) > int(next_photo_id) or abort()" to stop when it clicks "Next" on the last photo, but that already happens automatically if you've seen the first one.

[wankio]

Hmm that weird, because i run gallery-dl with and without facebook cookies, when limit reached, i just switch to logged/non-logged and use continue url with gallery-dl, and repeat until complete, maybe it cause the problems
also for years ago, i'm testing with Esuit and noticed with/without logged will also affect what photos showing to you,
eg, with logged -> most photos show/downloaded, without logged, it will missing photos but the download limit rate can easily bypass

[mikf]

I've added an option and functionality that hopefully prevents this behavior: 375ab40
https://gdl-org.github.io/docs/configuration.html#extractor-facebook-loop