PaulDotCom mailing list archives
Re: Web App Crawlers
From: Ryan Sears <rdsears () mtu edu>
Date: Fri, 8 Apr 2011 23:58:14 -0400 (EDT)
Use an intercepting proxy to crawl your site. I personally recommend the Zed Attack Proxy (which is a fork of the famous paros proxy), WebScarab, or the Burp Suite. Or you could use Harvestman (http://code.google.com/p/harvestman-crawler/) but it takes a bit to set up. Just my $.02 Ryan ----- Original Message ----- From: "Michael Chesmore [DAS]" <Michael.Chesmore () iowa gov> To: "PaulDotCom Security Weekly Mailing List" <pauldotcom () mail pauldotcom com>, "PaulDotCom Security Weekly Mailing List" <pauldotcom () pdc-mail pauldotcom com> Sent: Friday, April 8, 2011 9:39:21 AM GMT -05:00 US/Canada Eastern Subject: Re: [Pauldotcom] Web App Crawlers I think Hostmap is still available.. We used it in the past but I am not sure how far it will drill down...maybe there is a switch to tell it that ...check out the man page for it. Mike From: pauldotcom-bounces () mail pauldotcom com [mailto:pauldotcom-bounces () mail pauldotcom com] On Behalf Of Williams, Marn PENC:EX Sent: Thursday, April 07, 2011 3:52 PM To: 'PaulDotCom Security Weekly Mailing List' Subject: Re: [Pauldotcom] Web App Crawlers Try Nmap. Search for info on http://seclists.org ________________________________ From: pauldotcom-bounces () pdc-mail pauldotcom com [mailto:pauldotcom-bounces () pdc-mail pauldotcom com] On Behalf Of Michael Lubinski Sent: April 7, 2011 9:55 AM To: PaulDotCom Security Weekly Mailing List Subject: [Pauldotcom] Web App Crawlers I am trying to find all of the web apps currently hosted in an organization. What is a good crawler I could use? This is from the defensive side of things, its a network that I have full control over. _______________________________________________ Pauldotcom mailing list Pauldotcom () mail pauldotcom com http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom Main Web Site: http://pauldotcom.com _______________________________________________ Pauldotcom mailing list Pauldotcom () mail pauldotcom com http://mail.pauldotcom.com/cgi-bin/mailman/listinfo/pauldotcom Main Web Site: http://pauldotcom.com
Current thread:
- Web App Crawlers Michael Lubinski (Apr 07)
- Re: Web App Crawlers Williams, Marn PENC:EX (Apr 07)
- Re: Web App Crawlers Denis Hancock (Apr 08)
- Re: Web App Crawlers Chesmore, Michael [DAS] (Apr 08)
- Re: Web App Crawlers Ron Gula (Apr 11)
- <Possible follow-ups>
- Re: Web App Crawlers Ryan Sears (Apr 08)
- Re: Web App Crawlers Williams, Marn PENC:EX (Apr 07)