Recalling the lambda notation…

Finally I made the last code modifications to SquidLook installer.  The upgrade from MySAR is to do, yet. But it’s not too difficult, I think to use ‘ALTER TABLE’ commands.

SquidLook 1.0 beta1 is approaching soon…

 I’ve drawn the squidLook logo. The big one:

and the small one:

Squidlook-importer.php is the script that do the big work: importing the Squid log files.
It is based from the old mysar-importer.php.
The original author, Giannis Stollis, pointed me about the slowness of the importer. He was working on Mysar 3.0 with an entirelly C compiled importer to get things faster, but he dropped out.
I saw the code and optimized it a bit. I've taken some simple but powerful tactics.
Given that the importer uses many, many, many SQL queries, so the bottleneck is those Mysql calls.
So:

• Cache all small tables: for example, users table, can be entirelly cached into memory: it is good for organizations up to 80.000 employers.
• Buffered inserts: multiple inserts done in one time is much, much, much faster than multiple single inserts. Simple do this:

Sorry for the code not indented: I must discover how to enable this in wordpress...

I found the plugin for the code at http://blog.igeek.info/wp-plugins/igsyntax-hiliter/ ! It's awesome

Finally I uploaded first sources of SquidLook in Google Code SVN repositories.
I except to release the first 1.0 package soon.

Stay tuned.

SquidLook is a new project, managed by me, useful to analyze squid log.

It's based on mysar, in which I modified in many parts and optimized it.

The project page is at: http://code.google.com/p/squidlook/

I haven't uploaded any sources, but I'll do it soon.

Stay tuned!