Earlier this month, AOL made major tech headlines news with the deliberate release of some three months of search query data covering more than a half million user search queries and results.
Totalling about 500MB in compressed format, the database can be easily found on the Internet whether via direct download or through Bittorrent. Likewise, instructions on how to best get the data into usable form and creating a search form to parse the data are quickly coming available.
Elliot provides instructions for importing into MySQL:
mysql> CREATE TABLE aoldata (anonid int unsigned not null, query
varchar(255), querytime datetime, itemrank int unsigned, clickurl
varchar(255), PRIMARY KEY(anonid, query))
followed by:
LOAD DATA LOCAL INFILE ‘user-ct-test-collection-01.txt’
INTO TABLE aoldata
FIELDS TERMINATED BY ‘\t’
LINES TERMINATED BY ‘\n’
(anonid, query, querytime, itemrank, clickurl);
- 2120 reads
Post new comment