![]() With the crawl depth removed, the SEO Spider will now crawl the list of URLs, and any links it finds on them (internal and external, and resources). ![]() 3) Choose To Only Crawl & Store External Links However, we need to crawl the external URLs from the URLs in the list, so remove the crawl depth under ‘Configuration > Spider > Limits’ by unticking the configuration. ![]() 2) Remove The Crawl Depthīy default in list mode the crawl depth is ‘0’, meaning only the URLs in your list will be crawled. When you have your list of relevant prospects you wish to check for external broken links, fire up the Screaming Frog SEO Spider & switch the mode from ‘Spider’ to ‘List’. However, as we get asked this question an awful lot, I wanted to explain how you can use the Screaming Frog SEO Spider tool to help scale the process, in particular for the first method listed above. I don’t want to dig to deep into the entire process, you can read a fantastic guide over here on Moz by Russ Jones.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |