instal the new version for windows Screaming Frog SEO Spider 19.0

Now before I go into what you’re going to want to look at in terms of all the different errors, let me just go over the first row. Generally, you’re going to be filtering by HTML since you just want to see the pages that are on the website so you don’t really care too much about the images or the PDFs, you can do that if you’re trying to see if they have certain things on the website like pdfs but for the most part, you’re going to filter by HTML so you can see all of the HTML pages on the website.

Now there’s a bunch of different filters that you can use: What you’ll see when you begin is all of the URLs show up on your crawl, these are all the different things on the website. To put things into perspective, let’s use my website,, and press start. If you select 'Explore All Subdomains,' the spider will crawl any links it discovers to other subdomains on your site. You must update the parameters in the Spider Configuration menu to crawl more subdomains. Any further subdomains encountered by the spider will be treated as external links. Screaming Frog only crawls the subdomain you enter by default. To get started crawling your entire site, including all subdomains, you'll need to make a few minor changes to the spider setup.

This makes file sizes and data exports a little easier to control. When crawling larger sites, it's sometimes best to limit the crawler to a subset of URLs in order to gather a decent representative sample of data. It's a good idea to examine what kind of information you're looking for, how big the site is, and how much of the site you'll need to crawl in order to get it all before starting a crawl. However, in this guide, I will be using the free version since we don’t really need the paid version because a lot of the things can be done without having Google Analytics or Google Search Console integrated. The problem with not being able to do those things is that you’re going to have a harder time being able to pull all the analytics into the crawl. One thing to take note of with the free version is the fact that you can’t do Google Analytics Integration and Search Console Integration. You can purchase a license to remove the 500 URL crawl limit, expand the setup options, and gain access to more advanced capabilities.

Then, double-click the SEO Spider installation file you have downloaded and follow the installer's instructions. Simply click the download button to get started: Download Now. It runs on Windows, Mac OS X, and Ubuntu. To get started, download and install the SEO Spider, which is free and allows you to crawl up to 500 URLs at once.

Instal the new version for windows Screaming Frog SEO Spider 19.0