. . .
thumbnails during index procedure 2.8 Prevent indexing of known malware and pishing pages 2.9 Follow and create sitemap files 2.10 Use private sitemap instead of global sitemap. 2.11 Create sitemap file 3. Using the indexer from command line 3.1 All options 3.2 Multithreaded indexing 4. Keeping pages, words and files from being indexed 4.1
. . .
taken, User IP, Country, Host name (Latest100) - Index log offering: File-name, index date and delete option - sitemap log offering: sitemap.xml output sitemap list offering file/page suffixes - IDS log offering: IP, host, query, impact, involved tags, date and time of intrusion. - Flood attempts log offering: IP, query, date and time of
. . .
include string list. Multithreaded indexing: Explained in chapter: 2.6 Multithreaded indexing. Follow and create sitemap files. See below for details . Word stemming. See below for details . 2.2 Allow other hosts in same domain This Admin selectable option allows to index other hosts with the same domain name and it also ignores TLD, SLD and
. . .
individual key. To be signed up at Google. More details are described in the readme.pdf documentation. 2.9 Follow sitemap file To be activated in Admin settings, Sphider-plus will use the links found in sitemap.xml or sitemap.xml.gz files. This significantly increases the speed for index and re-index, because the links will not have to be
. . .
link table - Links with a 'last modified' date, which is newer than Sphider's 'last indexed' date in database. sitemaps are always expected in the root folder of the site to be indexed and must be named sitemap.xml or sitemap.xml.gz If 'Follow sitemap.xml' is activated and a valid sitemap was found, the log output Links found: 0 - New links: