report broken links for curl lynx links and other terminal browser . try to read all search results in terminal . expanded project scope #180
Description
report broken links for curl lynx links and other terminal browser . try to read all search results in terminal . expanded project scope
I want to extend the purpose of this repo to also include url handling . trying to read all search results
I hope I can convince you that many terminal search users need this service . a working tmux environment with sessions and windows is jarred by a failed net experience . many web sites are broken in a pure terminal environment
many people are interested in solving that problem rather than starting an X server for no real reason when every thing else works in the terminal except reading web sites
reading text should be exactly what terminal is made for . but many web sites are broken and don't display the page content properly or at all
this is not directly related to search but but next step . clicking on any search result and trying to read the page
I hope this is close enough related that both search and url handler can be hosted together as one packet . one bundle
this repo your repo is the most visible now . and the best place to organise this
the following describes my url handler and several other issues. I could post separate issues but I merged them all into this message
if I could use discussion feature from gh command I would post separate discussion . but I can only access issues from gh command and merge all my messages into one long message . and post this whole file as one issue
my url handler need improvement and promotion and coordination
I have found many links in john-peterson/ddgr@url that are broken in the terminal
here is a quote from that file
# add any broken links you find here
broken=(
https://answers.microsoft.com/en-us/windows/forum/all/ssh-login-to-microsoft-account-linked-windows/69ea0428-5b06-401c-bb86-e45228709e0b
https://youtrack.jetbrains.com/issue/GO-7100/Support-commenting-in-go.mod-file
https://developer.arm.com/Architectures/Valhall
https://android.stackexchange.com/questions/232387/
https://www.nvidia.com/en-us/geforce/forums/legacy-products/12/182006/add-touch-screen-mapping-for-streaming-pc-games/
https://x.com/RobbyKraft/status/971534867426144257
https://forums.linuxmint.com/viewtopic.php?t=374298
https://www.linuxquestions.org/questions/linux-software-2/how-to-override-xrandr-minimum-screen-size-%5Bsolved%5D-4175599058/
)
I am trying to find solutions to view all pages in terminal with minimal resources
some work with fake agent
curl -sL --http2 -A Gecko $u | lynx -stdin -dump | $pager
or cookies
links -http.fake-user-agent=Gecko -enable-cookies=1 -save-cookies=1 https://myhttpheader.com
some load page content with script and need patches to elinks java script support
https://github.com/rkd77/elinks
many people still prefer to avoid wasting resources when they only need text . chrome or firefox through browsh or carbonyl require one gig memory
cloud flare is the biggest problem because they equate terminal users with scammers . and don't allow a single request from the terminal . reasonably they could allow a small amount of requests with out problem
cloud flare text based clearance cookie work around
if this link return a message it means cloud flare is host . trace file path is the same for all domains that use cloud flare
curl https://stackoverflow.com/cdn-cgi/trace
for some unexplained reason some sites don't allow a single unverified request . making it impossible to read from a terminal
they don't like work around because scammers use it . this project was deleted
https://github.com/LOBYXLYX/Cloudflare-Bypass
when I tried it I received a clearance cookie but could still not access stack exchange even with curl impersonate . I opened an issue about this but before I could read the answers they deleted the entire project
I need to obtain a cloud flare clearance from a text terminal
the following is an idea about community response from terminal community . trying to organise and talk with interest parties
ask stack exchange for a few terminal requests for private use
stack exchange began using cloud flare this year and choose strict access
usually this happens because the board of directors demand it that don't understand how computers work
they don't allow a single request with out verification . making it impossible to read with out a massive browser that use almost one gig memory
I am planning to ask the stack exchange community forum for help with this. it should be possible to read it again
they host vim stack exchange but you can't read it from the terminal . this makes no sense and is probably because their owner don't understand anything about computers which is often the case
cloud flare text based challenge
I wish they could create a text based challenge also. so I can use a text terminal and prove I'm not a scammer
some one has to invent a text based challenge that can't be beaten by computer
currently they draw a graphics program with a check box like a small video game . that require real time rendering and beat text terminals
petition.org for all web master to fix lynx access
I am planning to post a message on petition.org for all web master to try their site in lynx . it is the classical way to read the web and still the best
hopefully they will notice it and fix it
the following is a community request for discussion and assistance beyond ddgr and more broader terminal search from Bing or google
from an official API preferably or an explanation why such is missing
I would prefer to post this in discussion instead of issues . but I only use the CLI not the GUI . gh command has no discussion access . I have to use issue only
instead of another unrelated issue I post all my messages in this issue
looking for Bing az search command
Bing is the only major engine that still has API support . if you know the az command to authorise it let me know
I can only use the az command not the web site azure console
I don't like to use the web site I like to find the terminal command instead it's easier when I find it . the hardest part is finding it because graphical interface is more popular because animals can understand it easier with less effort
when will google search return to terminal
I supported google in the longest from
john-peterson/googler@jan25 but they disabled non java script search last month with the new ai launch in java script
the new google search ai is the same as I am feeling lucky from 1999 . they display the top result and call it ai . there is nothing new about that . just a market gimmick with no substance
they used to allow a small amount of requests from text terminal but not right now
if some one can draft a message on google issues tracker they might be able to bring it back
it was down for a month in 2019 but they restored it when some one reported it . apparently they don't employ any programmer that works from the terminal that would notice this
some one that works for google must prefer vim and terminal search . maybe they left the company or was never hired because of disagreement with management . I suspect they had an argument about this and the text guy lost the argument
I am working on java script support in elinks . maybe one day it might be able to retrieve google results from java script
# when will google search API return
the only google service I can't use from terminal is search because there is no API . all their other services have terminal access why is search different
ten years ago they had a search API I don't know why they closed it
I would happily pay for search API but they refuse service instead . I always ask companies to try to charge for service instead of deny service
if you already use gcloud command all google API access is authorise and auto matically billed to your account
just a few lines of code does every thing you need . with out a GUI . perfect on the go when you only have a phone
this works in python and you can do every thing you need with out a GUI
service = build('blogger', 'v3')
but not this it doesn't work anymore . it would be the easiest way to search any way you want
service = build('search', 'v1')
why I don't understand why. it reminds me of the angry soup guy from seinfeld . when he is angry he refuse to sell soup . and he is angry all the time . why are they so angry just relax every thing will be fine
can I still configure custom search for all web programmatically
I know how to authorise my own search engine
gcloud services enable customsearch
a=https://www.googleapis.com/auth; gcloud auth application-default login --scopes=$a/cloud-platform,$a/cse
but I don't know the command after this to enable global web search and custom engine
the GUI method is always most popular and mention many times . but I can't use it I am blocked from GUI because I can't risk losing my account with additional security that lock me out of my own accounts . and I hate GUI any way I don't know why it is popular
I travel all the time and need to be able to log in any where in the world even if I lose my phone so I can only use pass word security
if it is still possible to search the whole web this way . some people have said it's nearly impossible they don't want this . they don't want API access to search for some business reasons they have not talked about
I can't use the gcp or azure web site because I travel all the time
you might wonder why I insist to ask about CLI over and over if there is a GUI solution . this is the reason
I avoid the web site as far as possible and I can't use it because the GUI requests enhanced security . I can only use pass word security for my main accounts . other wise I could lose access
gcloud and az command still works and it's the only access I have . no browser at all