[Linux-disciples] In-memory object for multidimensional queries

[Stephen R Laniel]

Suppose I want to loop through an Apache logfile in a
Perl/Python script, read each line into some data structure,
then do complicated queries on it -- e.g., "Find me all the
requests for my site from Microsoft.com that happened
between March 1 and March 5, with more than 5000 and less
than 500000 bytes sent over the wire."

This will all be in memory; I don't need all the
architecture that comes with MySQL, namely ACID-compliance.
Indeed, I don't even need anything to touch the disk, except
in the event that there's too much sitting in memory at one
time.

What does one use for this? Is there some very lightweight
data structure that allows for SQL queries?

-- 
Stephen R. Laniel
steve at laniels.org
Cell: +(617) 308-5571
http://laniels.org/
PGP key: http://laniels.org/slaniel.key