screamingfrog for website crawling auditing with a UI

Someone blogged about screamingfrog, I would still run it in a vm.

sudo apt install xdg-utils zenity libgconf-2-4 libgtk2.0-0 libnss3 libasound2

sudo dpkg -i screamingfrogseospider_18.5_all.deb

screamingfrogseospider

You have to multi-select rows in the top list to get the bottom list to do its join for lots of them (eg the 404s)

Producing lovely csv data:

Type	From	To	Anchor Text
Hyperlink	https://fergus-art.space/My-Art-Book.html	https://fergus-art.space/Art%20Book/Omakau%20Monday%201951.html	Omakau. Monday. 1951.
Hyperlink	https://fergus-art.space/About-me-5.html	https://fergus-art.space/Art%20Book/index.htm	Bouncing With Billie
Hyperlink	https://fergus-art.space/About-me-5.html	https://fergus-art.space/Art%20Book/index.htm	Bouncing with Billie.
Hyperlink	https://fergus-art.space/About-me-4.html	https://fergus-art.space/Art%20Book/index.htm
Hyperlink	https://fergus-art.space/About-me-4.html	https://fergus-art.space/Art%20Book/index.htm	Bouncing with Billie
Hyperlink	https://fergus-art.space/About-me-3.html	https://fergus-art.space/Art%20Book/index.htm	Bouncing with Billie
Hyperlink	https://fergus-art.space/About-me-3.html	https://fergus-art.space/Art%20Book/index.htm
Hyperlink	https://fergus-art.space/About-me-3.html	https://fergus-art.space/Art%20Book/index.htm	Bouncing with Billie
Hyperlink	https://fergus-art.space/About-me-5.html	https://fergus-art.space/Art%20Book/Kathryn.html	poem
Hyperlink	https://fergus-art.space/My-Art-Book.html	https://fergus-art.space/Art%20Book/A%20long%20gaunt%20Colin%20McCahon%20towered%20above.html	A long gaunt Colin McCahon towered above...
Hyperlink	https://fergus-art.space/My-Art-Book.html	https://fergus-art.space/Art%20Book/We%20could%20never%20have%20been%20friends.html	We could never have been friends...
Image	https://fergus-art.space/My-Art-Book-Hataitai-Beach.html	https://fergus-art.space/Art%20Book/Hataitai%20Beach.jpg