|
The "Crawler Options" section allows you to configure crawling ("resources parsing") aspects of N-Stalker's spider engine:
Crawler Options
|
This panel allows you to configure all aspects of resource parsing, including parser restrictions and javascript engine's behavior.
|
File Extension Options
|
This panel allows you to configure file extensions that should be excluded from spider's engine and that should be interpreted as a "downloadable resource".
|
|
