[kiberphant0m]

I recently put together a web crawler that I think might be useful for anyone needing to explore and analyze URLs. The tool is designed to crawl through web pages, extract and categorize URLs, and handle redirects. It searches a wide variety of different things including urls attached to buttons, quote blocks, commas, network utility from chrome and much more.

Can get 200+ urls from a domain in about a minute. Fastest available tool using pure recon on a domain (no api integration)

Script can be found here: 

Hidden Content

You must register or login to view this content.

Instructions:

Upload golang file
Make sure golang is installed by using:
go build url-scan.go
chmod 777 *
./url-scan -url="https://hackerone.com/" -output="output-hackerone.txt" -inscope="hackerone.com"

url=url you wish to scan for more urls.
output=output anything u want it to be
inscope=does not crawl third party urls for more urls.... specify -outscope="" if  you wish to scan and discover urls on the third party website as well i do not recommend since its quite literally useless but you do you.

If it says to go get something when attempting to build it follow the instructions it outputs to you....

NOTE:

This can be ran on windows by going to microsoft store and installing ubuntu on windows application. 

Or you can install golang with command prompt and run it that way.

This forum account is currently banned. Ban Length: (Permanent)
Ban Reason: Attempted Scamming /Thread-SELLING-VZW-Network-Sim-Swapping-Service | https://breachforums.hn/Forum-Ban-Appeals if you feel this is incorrect.Prove your ability to provide these services.

[kiberphant0m]

thanks you for share great tool

Glad you enjoy it...

This forum account is currently banned. Ban Length: (Permanent)
Ban Reason: Attempted Scamming /Thread-SELLING-VZW-Network-Sim-Swapping-Service | https://breachforums.hn/Forum-Ban-Appeals if you feel this is incorrect.Prove your ability to provide these services.

[balboa]

wanna see the scripts, thanks

[YSL]

might try this out, thanks for the share.

[EndOfTheFile]

Link redirects to a 404 :\

[Abu_Al_Sahrif]

thanks bro)))very much

[KazuyaMishi]

gonna try this out

Edit: showing as 404

[tcpfuck]

the link been renewed?

EDIT: unfortunately still 404!

[888]

The link in this thread is dead. Please reply to the PM you were sent to get your thread moved back to the Software section.