MacOS 下基于 Awstats 的tomcat 日志分析

ref[使用awstats监控Tomcat日志] http://3179137.blog.51cto.com/3169137/1718572
ref1[Linux 日志分析工具之awstats详解]http://freeloda.blog.51cto.com/2033581/1346412/

源码

$cd Download
$wget https://sourceforge.net/projects/awstats/files/AWStats/7.6/awstats-7.6.zip
$unzip awstats-7.6.zip
// awstats在配置时默认会安装在 /Library/WebServer/awstats 目录
$sudo su -
...
# mv awstats-7.6 /Library/WebServer/awstats

awstats_configure.pl 文件

配置

#cd /Library/WebServer/awstats
#perl tools/awstats_configure.pl 
//填conf\httpd.conf的位置: tomcat .policy
// 随便取个 profie name

修改 tomcat 日志格式

// 具体的信息可以参考 ref, 或者 tomcat 官网

#vi /usr/local/apache-tomcat-8.5.8/conf/server.xml
156         <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs"
157                prefix="localhost_access_log" suffix=".txt"
158                pattern="%h %l %u %t &quot;%r&quot; %s %b" />
159        -->
160 
161        <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs"
162                 prefix="localhost_access_log" suffix=".txt"
163                 pattern="%h %u %t &quot;%r&quot; %s %b %{Referer}i &quot;%{User-Agent}i&quot;;" />

该步骤会在awstats/wwwroot/cgi-bin 目录下 生成 awstats.iceSite.conf 文件

修改 awstats 配置文件

#cd /Library/WebServer/awstats/wwwroot/cgi-bin
# vi awstats.iceSite.conf 
// 找到相应的属性进行默认值修改
LogFile="/usr/local/apache-tomcat-8.5.8/logs/localhost_access_log.%YYYY-%MM-%DD.txt"
LogFormat ="%host %logname %time1 %methodurl %code %bytesd %referer %uaquot"
DirIcons="./icon"
AllowToUpdateStatsFromBrowser=1

修改可执行属性

#pwd
/Library/WebServer/awstats
#chmod +x /Library/WebServer/awstats/tools/*.pl 

awstats 数据库文件默认文件夹

mkdir -m 755 /var/lib/awstats

运行读取本地的 tomcat .txt log信息

#pwd
/Library/WebServer/awstats
#mkdir resWeb && cd resWeb
#perl wwwroot/cgi-bin/awstats.pl  -update -config=iceSite
Create/Update database for config "wwwroot/cgi-bin/awstats.iceSite.conf" by AWStats version 7.6 (build 20161204)
From data in log file "/usr/local/apache-tomcat-8.5.8/logs/localhost_access_log.2017-06-16.txt"...
Phase 1 : First bypass old records, searching new record...
Searching new records from beginning of log file...
Phase 2 : Now process new records (Flush history on disk after 20000 hosts)...
Jumped lines in file: 0
Parsed lines in file: 51
 Found 0 dropped records,
 Found 0 comments,
 Found 0 blank records,
 Found 41 corrupted records, // 未改数据格式之前的认为是corrupted的记录
 Found 0 old records,
 Found 10 new qualified records.

生成网页

perl tools/awstats_buildstaticpages.pl -update -config=iceSite -awstatsprog=/Library/WebServer/awstats/wwwroot/cgi-bin/awstats.pl

打开 awstats.iceSite.html 网页即可查看

动态日志监控(…)