Poster of Linux kernelThe best gift for a Linux geek
make_combined_log.pl

make_combined_log.pl

Section: User Commands (1) Updated: User
Local index Up
 

NAME

make_combined_log.pl - make combined logfile from SQL database  

SYNOPSIS

make_combined_log.pl <days> <virtual host>

 

DESCRIPTION

This perl script extracts the httpd access data from a MySQL database and formats it properly for parsing by 3rd-party log analysis tools.

The script is intended to be run out by cron. Its commandline arguments tell it how many days' worth of access records to extract, and which virtual_host you are interested in (because many people log several virthosts to one MySQL db.) This permits you to run it daily, weekly, every 9 days -- whatever you decide.

 

NOTE

By "days" I mean "chunks of 24 hours prior to the moment this script is run." So if you run it at 4:34 p.m. on the 12th, it will go back through 4:34 p.m. on the 11th.

 

KNOWN ISSUES

Because GET and POST are not discriminated in the MySQL log, we'll just assume that all requests are GETs. This should have negligible effect on any analysis software. This could be remedied IF you stored the full HTTP request in your database instead of just the URI, but that's going to cost you a LOT of space really quickly...

Because this is somewhat of a quick hack it doesn't do the most robust error checking in the world. Run it by hand to confirm your usage before putting it in crontab.

 

AUTHOR

Edward Rudd <eddie@omegaware.com>

 

MAN PAGE CREATED BY

Michael A. Toth <lirul.lists@gmail.com> - based on comments of script  

COMMENTS

This man page was written using xml2man (1) by the same author.


 

Index

NAME
SYNOPSIS
DESCRIPTION
NOTE
KNOWN ISSUES
AUTHOR
MAN PAGE CREATED BY
COMMENTS

This document was created by man2html, using the manual pages.
Time: 21:14:47 GMT, April 16, 2011