You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Getting great results overall but I am running into an issue when using a file as input.
If I run linkchecker directly against a url, I get a very long response that takes hours to run as it recurses over decades of content on the site
linkchecker -o csv --check-extern -D all https://ashoka.org > dotorg_link.csv
However if I run against a file with the same URL, I get one result - no recursion (even for other links on the page). I have tried using a text file and a html file as the input. I have tried specifying the -r parameter as -1 or as 5 or not including the r parametrer and it makes no difference.
Any suggestions appreciated! I'm contemplating adding a password protected page to the site that includes all the links I want to recurse over, but hoping to avoid that.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Getting great results overall but I am running into an issue when using a file as input.
If I run linkchecker directly against a url, I get a very long response that takes hours to run as it recurses over decades of content on the site
linkchecker -o csv --check-extern -D all https://ashoka.org > dotorg_link.csvHowever if I run against a file with the same URL, I get one result - no recursion (even for other links on the page). I have tried using a text file and a html file as the input. I have tried specifying the -r parameter as -1 or as 5 or not including the r parametrer and it makes no difference.
linkchecker -o csv --check-extern -r -1 -D checking langtest_html.htm > dotorg_langtest.csvThe file just contains two lines
Is it possible to enable recursion when running from a file input?
I found an old thread that seemed to indicate using a html file would address this, but that made no different vs using a text file
I ran with -D all and it clearly shows recursion = 0
Any suggestions appreciated! I'm contemplating adding a password protected page to the site that includes all the links I want to recurse over, but hoping to avoid that.
Thanks
Gorav
Beta Was this translation helpful? Give feedback.
All reactions