What is SEO Spider Tool?
Webbee SEO Spider is an ultimate web auditor that crawls and audits your website with respect to major search engine’s guidelines. It gathers meta data, keywords, schema, headings and internal links from HTML and organize them in tabular form for user ease.

What Webbee SEO Spider Tool is Capable of?
Webbee, a powerful SEO Crawler Software, can accomplish following tasks.

User can have all HTML data like URL status codes, content type of webpage, title, meta description, all headings and their occurrences, Google Analytics code, schema (microdata), canonical URLs, meta robot tags and internal and external links.
Webbee also crawls all the keywords used in titles, h1 and anchor texts and audit them to check if they are overlapping with any other webpage or not.
User can easily extract all the keywords from competitor’s website.
How competitors have implemented schema and what types; webbee crawl it and sort it into tree form for easy understanding.
Whatever the length of your sitemap is, webbee will crawl it in seconds and provide you URLs with their last modified date, change frequency and crawl priority in tabular form.
It crawls all, internal and external, links; sort them and gives users the option to check which page has links coming from other internal webpages.
Meta data and their duplication can be checked with Webbee SEO Spider.
If you have a huge list and wants to check only the status codes; webbee has “Header Status Code” for you in this regard. This mode is super-fast as it gets only the status code from URL.
If you want to allow or disallow some of the URLs or directories from crawling then custom robots.txt feature is waiting for you. Use custom robots.txt for crawling and get a perfect crawl!
Google Webmaster Tool allow you to download only 1000 404 (not found) URLs from panel. But, Webbee spider has Google API implemented that lets the user download all 404 URL list directly from your webmaster account, even a hundred thousand.
It has awesome download features that allow user to download all the reports with just one click. All the reports in your system!
It crawls all the images from website and sorts them in 2 different sections; with alt tags and without alt tags.