Crawler
This tab acts as a triggering point for on demand crawling.
The crawler is being used to identify all your website's pages. Once the crawling process is complete, the identified pages can be viewed via RSSeo! Pages tab.
By default it offers general control buttons - Start, Pause and Continue along with on progress status:
- Current URL
- Level
- Pages Scanned on the current Level
- Remaining pages for this level
- Total Pages
Option to skip links that have rel="nofollow" when crawling.
Note:
Since version 1.20, RSSeo! Crawler has been been improved and besides the existing "loopback connections" based crawler we have added the option of crawling pages through AJAX.
3 persons found this article helpful.
You Should Also Read
What can RSSeo! do for your site ? HOT |
Keywords Replacements HOT |
Redirects |
