url harvester

[Diogenes]

Anyone know any software that will harvest urls from a webpage and put the into a excel or text file?

D.

 

[Aplusmedia]

so you basically want a software that will grab all the domain names from a given URL ?

or do you want to grab the whole url(including the http://)?

is a cgi script ok?

 

[Diogenes]

Yes anything that will get the job done. From the web i could just cut and paste all the urls into a file.

D.

 

[alphacomsoft]

If you already have web page source (e.g. in Internet Explorer call View -> Source), save it into file, then use Available Domains Pro to import from that file (Domains -> Import from File command)
You can even choose which TLDs to accept and which to reject.

 

[Diogenes]

Excellent tool!

D.

 

[gariben]

DNChecker EDM does that.

Can grab any links from any webpage or documents, excel, txt files, etc...

also generates expiry date, ip server, email address, and all the whois information.

http://www.dnchecker.com/edm.htm

 

[Gail]

check out the link harvesting tool at MeatSnack works really fast and you hardly know it is running.