[reddit] Add "pinned" extractor option similar to twitter's

[serveral1]

To avoid the over consumption of API requests sent to reddit I set reddit's extractor skip option to abort with a tied archive. However if an user has a pinned post on their profile, the crawl will just stop at the beginning of the task because it encounters the pinned post first, in a behavior quite similar to having twitter's extractor option of pinned set to true with the same archive and skip options.
Setting the skip option to it's default behavior obviously solves the issue, however, I have to manually stop the crawl in order to stop more redundant API requests from being sent.

[yunan-adil]

I just got a bunch of CSS syntax when tried to scraping a subreddit and at the end of the line it says :

You've been blocked by network security. If you think you've been blocked by mistake, file a ticket below and we'll look into it. File a ticket

Is this related problem or just my account got flagged or something ?

Edit : Added a screenshot

[serveral1]

I just got a bunch of CSS syntax when tried to scraping a subreddit and at the end of the line it says :

You've been blocked by network security. If you think you've been blocked by mistake, file a ticket below and we'll look into it. File a ticket

Is this related problem or just my account got flagged or something ?

Edit : Added a screenshot

Different issue.

[mikf]

However if an user has a pinned post on their profile, the crawl will just stop at the beginning of the task because it encounters the pinned post first

https://gdl-org.github.io/docs/configuration.html#extractor-skip-filter

"skip-filter": "not pinned"

or set a higher limit for abort:

"skip": "abort:10"

---

blocked by network security

#8838

[serveral1]

https://gdl-org.github.io/docs/configuration.html#extractor-skip-filter

"skip-filter": "not pinned"

Ah, I forgot about the skip filters. I'm guessing twitter's pinned condition is handled differently hence why it needs a separate extractor option?

[mikf]

Kind of. Twitter's pinned Tweets get "moved" to their actual position in a user's timeline instead of getting completely ignored.

[hrxn]

Is it called pinned or stickied? Or has there been a site change somewhat recently?

I was checking my own config for reddit, and I had this in it:

            "skip-filter": "not locals().get('stickied')",

[mikf]

Seems like both exist:

$ gallery-dl --print "{pinned} - {stickied}" https://www.reddit.com/r/lavaporn/
False - False
False - False
False - False

[Tady03]

We really need this option bc if an user has a post pinned w their Patreon-link gallery-dl scoops their Patreon first before the Reddit-page.
But other than that we could use an update workaround to not be blocked by network-security when scraping profiles :(

[mikf]

We really need this option bc if an user has a post pinned w their Patreon-link gallery-dl scoops their Patreon first before the Reddit-page.

-o blacklist=patreon or maybe -o whitelist=imgur,redgifs
https://gdl-org.github.io/docs/configuration.html#extractor-blacklist-whitelist