Website history
- Internet Archive (Wayback Machine)
- CachedView: The Google Cache Browser for any page on the Internet.
- Way backpac (Tool): This is a tool that allows you to download the entire Wayback Machine archive for a given web page.
- Archive.today
- WebCite: Only archive history is avaiable.
- Library of Congress
- UK web archive
- Stanford Web Archive Portal
- oldweb.today: Retrieve archived web pages from the different public internet archives. You can also display archived websites using different web browsers.
- UK Government web archive
- Trove
Website monitoring services
Alert services
- Google alert
- Talk walker
- Visual ping
- Follow that page
- Watch that page
- Update Scanner:A Firefox extension that Monitors web pages for updates.
RSS Tools And Services
Websites mirroring tools
- HTTrack: Copy website for offline view.
- GNU Wget: Retrieve files using HTTP, HTTPS, FTP and FTPS internet protocols.
- BlackWidow: Download complete site or part of it and can download any kind of files- including YouTube videos embedded within it.
Link extractor
- Link Extractor
- Free URL Extractor
- Link Gopher: This is a Firefox add-on that extracts all links from web pages, including the embedded one and display them in a new web page.
Check target website backlinks
To see all linked websites to a specific domain name, type the following in Google: site:* darknessgate.com (There should be a space between the asterisk and the domain name).
Identify technologies used
- Built with: Give detailed technical information about the technology used to build target website.
- Wappalyzer
- dnslytics: To Find domains sharing the same Google Analytics ID.
IT devices Default Credentials
Vulnerabilities Database
Web Scraping Tools
- Common Crawl: maintain an open repository of web crawl data that can be accessed and analyzed by anyone.
- theHarvester: This is a tool for gathering subdomain names, e-mail addresses, virtual hosts, open ports/ banners, and employee names from different public sources like: Google, Bing, LinkedIn, Twitter, Yahoo, pgp and more.
- 80legs: (Commercial) Web Scraping Tools and Cloud-Based Web Crawling.
- agenty: Cloud-based agents for data scraping, text extraction, ocr, categorization, change detection, sentiment analysis and more…
- apify: is a web scraping and automation platform for developers.
- artoo.js: is a piece of JavaScript code meant to be run in your browser’s console to provide you with some scraping utilities.
- scrapy:An open source and collaborative framework for extracting the data you need from websites.
- datatoolbar
- DEiXTo
- Email extractor
Website certification search
Statistics & analytics Tools
Website Reputation Checker
WHOIS Lookup
- ICANN
- AFRINIC
- APNIC
- LACNIC
- Domain Big Data
- Whoisology
- Robtext
- Who
- Revrse
- Operative Framework
- URL Scan
Subdomain Discovery
- Using Google search operator:Type site:target.com -inurl:www and Google will show all related subdomain names of the target. Example:site:yahoo.com -inurl:www
- Virus Total
- DNSdumpster
- Gobuster
- Bluto
- PentTest Tools
- Sublist3r
- SecurityTrails: Sub-domain discovery and different online footprinting tests (associated domains, IPs, and SSL)
IP address tracking
IP Geolocation information
Information about IP (Internet Protocol)
- Onyphe
- CIDR REPORT for IPv4
- IP to ASN
- Reverse DNS Lookup
- Reverse IP lookup
- CIDR REPORT for IPv6
- IP Address Tools
- ExoneraTor