2 simple tools for log data analysis

Config.js

To configure the Log Browser open the config.js file in the downloaded package.
Look at it:
/***** username & password if required ***/
var username=" "
var password=" "

/*** proxy address if required ***/
var proxy=""

/*** default logdata URL ***/
logSrc="http://www.fh54.de/LogSuite/home/4Log%20Browser/LogBrowserDemo/07_2005.txt"

profiles=new Array("default","RRST","nytingale")

/*** define possible entry sequences ***/
entries=new Array()
entries["default"]=new Array("ip","host","date","time","method","url","referrer","browser")
entries["RRST"]=new Array("host","empty1","empty2","date","empty3","empty4","url","empty5",
"empty6","empty7","referrer","browser")
entries["nytingale"]=new Array("host","empty1","empty2","date","empty3","empty4","url",
"empty5","empty6","empty7",
"referrer","browser")

/*** define possible domain patterns to exclude from referrers list***/
domains=new Array();
domains["default"]="fh54.de"
domains["RRST"]="railroadstudio.de"
domains["nytingale"]="nytingalemusic.de"

/*** robot patterns; add more robot patterns if known ***/
robots=new Array("googlebot","msnbot","slurp","seekbot","crawler","digext","teoma","looksmart")

/*** add more or delete some file types to exclude from dataset ***/
excludeFileTypes=new Array (".gif",".jpg",".jpeg",".png",".css",".js ",".ico",".swf",".vbs");

/*** define useless page patterns to exclude from data set ***/
excludeFiles=new Array()
excludeFiles["default"]=new Array()
excludeFiles["RRST"]=new Array("/robots.txt")
excludeFiles["nytingale"]=new Array("/seiten/rand", "/border","/anfang")

//set this value to less if the browser fails to process data
var capacity=300
Leave the parameters username and password blank if you don't have to log in to get logfiles.
Leave the parameter proxy empty if you don't use a proxy server.
If you only use the Simple Log Writer for one site, you can leave the rest as is.

You can also create different profiles.
The profiles are a way to access data from different servers with different logfile structures.
If you only use the Simple Log Writer for one site, you don't need to create any profiles and can just leave the "default" profile.
Otherwise, you have to define the array elements for 3 arrays: entries, domais, excludeFiles.
The array "entries" defines the sequence of entries that are written into log file.
Each server uses a certain logfile format (like NSCA, Microsoft IIS, Apache etc.), which means that they have different sequences of entries.
You have to find out at what positions the following entries are located: IP (if any), host (if any), date, time (if any), requested URL, referrer(if any) and client browser. All other entries are irrelevant, they should be marked with "empty" + a different number.

Example:
One row from server logdata:

krsn-d9b991b2.pool.mediaways.net - - [01/Jun/2005:10:43:16 +0200] "GET /bilder/button/gast.gif HTTP/1.1" 200 1299 "http://www.nytingalemusic.de/seiten/rando.php" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)"
The entries are always separated by spaces. Split this string into parts separated by spaces. You can see that the first part is a host. The 2nd and 3th are irrelevant ("empty"), the 4th is the date and time, the 5th is the timezone and therefore irrelevant ("empty"), the 6th is method and therefore "empty", the 7th is the requested URL, the 8th is the protocol and therefore "empty", the 9th is status and therefore "empty", the 10th is kilobyte amount and therefore "empty"), the 11th is referrer, the 12th is the client browser.
Therefore, the entries sequence for this logfile is:

"host","empty1","empty2","date","empty3","empty4","url","empty5","empty6","empty7","referrer","browser".

It is important to label the entries with these exact names, otherwise they cannot be recognized and the data cannot be properly processed.