Request-log-analyzer,redmine日志分析工具，rails日志分析工具、mongrel日志分析工具
Request-log-analyzer
This is a simple command line tool to analyze request log files in various formats to produce a performance report. Its purpose is to find what actions are best candidates for optimization.
-
Analyzes log files. Currently supports: Amazon S3, Apache, Delayed::Job, Merb, Mysql, PostgreSQL, Rack, Rails and more.
-
Combines multiple files and decompresses compressed files, which comes in handy if you are using logrotate.
-
Uses several metrics, including cumulative request time, mean request time, process blockers, database and rendering time, HTTP methods and statuses, Rails action cache statistics, etc.) (Sample output: github.com/wvanbergen/request-log-analyzer/wiki/sample-output )
-
Low memory footprint and reasonably fast, so it is safe to run on a production server.
-
MIT licensed
See the project wiki at github.com/wvanbergen/request-log-analyzer/wiki for documentation and additional information.
unix下安装方法
Installation & basic usage
Install request-log-analyzer as a Ruby gem (you might need to run this command as root by prepending sudo to it):
$ gem install request-log-analyzer
To analyze a Rails log file and produce a performance report, run request-log-analyzer like this:
windows下安装方法
因为本地windows本地不能使用gem远程下载
第一步、下载zip文件，复制到redmine安装目录下的vendor\rails\
第二步、允许 ruby redmine安装目录下的vendor\rails\\bin\request-log-analyzer --option redmine安装目录\log\production.log，可以使用--file log-analyzer.txt输出到具体的文件上去
第三步、查看具体的导出文件，分析的结果还是比较清晰的
Request-log-analyzer summary report -------------------------------------------------------------------------------- Version 1.12.1 - written by Willem van Bergen and Bart ten Brinke Website: http://github.com/wvanbergen/request-log-analyzer Request summary -------------------------------------------------------------------------------- Parsed lines: 18747 Skipped lines: 0 Parsed requests: 9374 Skipped requests: 0 First request: 2012-03-05 18:06:06 Last request: 2012-03-06 17:38:05 Total time analyzed: 1 days Request distribution per hour -------------------------------------------------------------------------------- 0:00 | 0 hits/day | 1:00 | 0 hits/day | 2:00 | 0 hits/day | 3:00 | 0 hits/day | 4:00 | 0 hits/day | 5:00 | 0 hits/day | 6:00 | 0 hits/day | 7:00 | 0 hits/day | 8:00 | 102 hits/day | = 9:00 | 1434 hits/day | ======== 10:00 | 202 hits/day | = 11:00 | 158 hits/day | = 12:00 | 2 hits/day | 13:00 | 6012 hits/day | =================================== 14:00 | 342 hits/day | == 15:00 | 137 hits/day | = 16:00 | 173 hits/day | = 17:00 | 731 hits/day | ==== 18:00 | 21 hits/day | 19:00 | 0 hits/day | 20:00 | 21 hits/day | 21:00 | 2 hits/day | 22:00 | 37 hits/day | 23:00 | 0 hits/day | Most requested -------------------------------------------------------------------------------- AccountController#login.html [GET] | 3655 hits | 39.0% | ====== MessagesController#show.html [GET] | 3296 hits | 35.2% | ===== ProjectsController#show.html [GET] | 520 hits | 5.5% | = IssuesController#show.html [GET] | 467 hits | 5.0% | = IssuesController#index.html [GET] | 173 hits | 1.8% | AttachmentsController#show.html [GET] | 169 hits | 1.8% | MyController#page.html [GET] | 162 hits | 1.7% | WelcomeController#index.html [GET] | 126 hits | 1.3% | IssuesController#update.html [PUT] | 118 hits | 1.3% | AccountController#login.html [POST] | 79 hits | 0.8% | IssuesController#new.html [GET] | 71 hits | 0.8% | IssuesController#create.html [POST] | 57 hits | 0.6% | GanttsController#show.html [GET] | 57 hits | 0.6% | IssuesController#new.html [POST] | 49 hits | 0.5% | AutoCompletesController#issues.html [POST] | 48 hits | 0.5% | TimelogController#new.html [GET] | 37 hits | 0.4% | ApplicationController#index.html [GET] | 36 hits | 0.4% | ProjectsController#index.html [GET] | 34 hits | 0.4% | TimelogController#create.html [POST] | 31 hits | 0.3% | IssuesController#index.html [POST] | 25 hits | 0.3% | HTTP methods -------------------------------------------------------------------------------- GET | 8922 hits | 95.2% | ================================================= POST | 309 hits | 3.3% | == PUT | 142 hits | 1.5% | = DELETE | 1 hits | 0.0% | HTTP statuses returned -------------------------------------------------------------------------------- 200 | 5226 hits | 56.0% | ============================== 302 | 4107 hits | 44.0% | ======================== 403 | 2 hits | 0.0% | 406 | 2 hits | 0.0% | Rails action cache hits -------------------------------------------------------------------------------- No hit | 9374 hits | 100.0% | ================================================== -------------------------------------------------------------------------------- Request dura | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- IssuesContro | 467 | 5m10s | 0.66s | 0.60s | 0.00s | 7.45s | 0.22s-2.26s AccountContr | 3655 | 4m55s | 0.08s | 0.13s | 0.02s | 2.12s | 0.03s-0.50s TimesheetCon | 8 | 3m58s | 29.78s | 1m04s | 4.59s | 3m07s | 4.59s-3m10s IssuesContro | 173 | 3m03s | 1.06s | 0.65s | 0.00s | 4.83s | 0.31s-3.17s IssuesContro | 118 | 2m28s | 1.25s | 1.14s | 0.11s | 9.30s | 0.19s-4.10s MessagesCont | 3296 | 1m23s | 0.03s | 0.12s | 0.00s | 4.41s | 0.00s-0.30s GanttsContro | 57 | 1m22s | 1.44s | 1.12s | 0.28s | 5.52s | 0.30s-4.82s MyController | 162 | 1m20s | 0.49s | 0.38s | 0.00s | 1.95s | 0.12s-1.80s IssuesContro | 57 | 1m07s | 1.18s | 1.33s | 0.12s | 9.47s | 0.14s-3.38s ProjectsCont | 520 | 56.26s | 0.11s | 0.25s | 0.00s | 2.34s | 0.00s-0.77s WelcomeContr | 126 | 54.32s | 0.43s | 0.57s | 0.00s | 3.28s | 0.00s-2.49s Knowledgebas | 16 | 43.80s | 2.74s | 1.60s | 0.70s | 5.36s | 0.70s-5.40s TimeEntryRep | 2 | 43.61s | 21.80s | 2.18s | 20.27s | 23.34s | 20.23s-23.39s ProjectsCont | 34 | 38.50s | 1.13s | 0.75s | 0.00s | 3.73s | 0.00s-3.78s TimeEntryRep | 4 | 34.34s | 8.59s | 14.87s | 0.39s | 30.86s | 0.39s-31.26s IssuesContro | 71 | 31.71s | 0.45s | 0.39s | 0.14s | 2.27s | 0.16s-1.69s IssuesContro | 25 | 29.94s | 1.20s | 1.01s | 0.20s | 4.34s | 0.20s-4.38s TimesheetCon | 8 | 24.42s | 3.05s | 1.34s | 1.03s | 4.42s | 1.03s-4.45s TimelogContr | 21 | 18.74s | 0.89s | 0.94s | 0.17s | 3.42s | 0.17s-3.44s IssuesContro | 1 | 15.12s | 15.12s | 0.00s | 15.12s | 15.12s | 14.89s-15.38s -------------------------------------------------------------------------------- Request dura | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- TimesheetCon | 8 | 3m58s | 29.78s | 1m04s | 4.59s | 3m07s | 4.59s-3m10s TimeEntryRep | 2 | 43.61s | 21.80s | 2.18s | 20.27s | 23.34s | 20.23s-23.39s IssuesContro | 1 | 15.12s | 15.12s | 0.00s | 15.12s | 15.12s | 14.89s-15.38s TimeEntryRep | 4 | 34.34s | 8.59s | 14.87s | 0.39s | 30.86s | 0.39s-31.26s TimesheetCon | 8 | 24.42s | 3.05s | 1.34s | 1.03s | 4.42s | 1.03s-4.45s Knowledgebas | 16 | 43.80s | 2.74s | 1.60s | 0.70s | 5.36s | 0.70s-5.40s ActivitiesCo | 1 | 1.95s | 1.95s | 0.00s | 1.95s | 1.95s | 1.92s-1.99s IssuesContro | 1 | 1.89s | 1.89s | 0.00s | 1.89s | 1.89s | 1.86s-1.92s GanttsContro | 57 | 1m22s | 1.44s | 1.12s | 0.28s | 5.52s | 0.30s-4.82s IssuesContro | 118 | 2m28s | 1.25s | 1.14s | 0.11s | 9.30s | 0.19s-4.10s ProjectsCont | 4 | 4.98s | 1.25s | 0.51s | 0.69s | 1.91s | 0.69s-1.92s IssuesContro | 25 | 29.94s | 1.20s | 1.01s | 0.20s | 4.34s | 0.20s-4.38s IssuesContro | 57 | 1m07s | 1.18s | 1.33s | 0.12s | 9.47s | 0.14s-3.38s ProjectsCont | 34 | 38.50s | 1.13s | 0.75s | 0.00s | 3.73s | 0.00s-3.78s IssuesContro | 173 | 3m03s | 1.06s | 0.65s | 0.00s | 4.83s | 0.31s-3.17s DocumentsCon | 1 | 1.05s | 1.05s | 0.00s | 1.05s | 1.05s | 1.04s-1.08s MyController | 1 | 1.03s | 1.03s | 0.00s | 1.03s | 1.03s | 1.03s-1.06s TimelogContr | 21 | 18.74s | 0.89s | 0.94s | 0.17s | 3.42s | 0.17s-3.44s MembersContr | 1 | 0.84s | 0.84s | 0.00s | 0.84s | 0.84s | 0.83s-0.86s ContextMenus | 3 | 2.23s | 0.74s | 0.56s | 0.11s | 1.14s | 0.11s-1.15s -------------------------------------------------------------------------------- View renderin | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- IssuesControl | 463 | 3m59s | 0.52s | 0.55s | 0.14s | 7.38s | 0.17s-1.99s AccountContro | 3655 | 2m42s | 0.04s | 0.10s | 0.00s | 1.81s | 0.00s-0.40s IssuesControl | 171 | 2m21s | 0.82s | 0.51s | 0.17s | 3.69s | 0.22s-2.15s GanttsControl | 57 | 1m16s | 1.33s | 1.12s | 0.20s | 5.28s | 0.23s-4.74s MyController# | 160 | 1m05s | 0.41s | 0.33s | 0.09s | 1.81s | 0.09s-1.49s WelcomeContro | 78 | 37.85s | 0.49s | 0.44s | 0.12s | 2.23s | 0.14s-1.92s Knowledgebase | 16 | 31.55s | 1.97s | 1.39s | 0.52s | 5.28s | 0.51s-5.31s ProjectsContr | 31 | 25.56s | 0.82s | 0.62s | 0.25s | 3.09s | 0.25s-3.12s TimeEntryRepo | 4 | 21.44s | 5.36s | 9.87s | 0.05s | 20.16s | 0.05s-20.23s IssuesControl | 25 | 19.10s | 0.76s | 0.76s | 0.06s | 3.55s | 0.06s-3.55s TimesheetCont | 8 | 18.67s | 2.33s | 0.85s | 1.34s | 4.22s | 1.33s-4.24s ProjectsContr | 77 | 17.27s | 0.22s | 0.24s | 0.05s | 1.53s | 0.06s-0.89s IssuesControl | 71 | 14.73s | 0.21s | 0.18s | 0.06s | 1.03s | 0.08s-0.70s TimelogContro | 21 | 13.69s | 0.65s | 0.77s | 0.11s | 2.83s | 0.11s-2.83s TimesheetCont | 8 | 12.36s | 1.54s | 1.01s | 0.42s | 2.98s | 0.42s-3.02s TimelogContro | 24 | 5.72s | 0.24s | 0.35s | 0.03s | 1.53s | 0.03s-1.53s IssuesControl | 49 | 3.77s | 0.08s | 0.13s | 0.00s | 0.61s | 0.00s-0.61s TimelogContro | 37 | 3.66s | 0.10s | 0.11s | 0.03s | 0.61s | 0.03s-0.61s ProjectsContr | 4 | 2.91s | 0.73s | 0.14s | 0.58s | 0.91s | 0.57s-0.92s SearchControl | 12 | 2.78s | 0.23s | 0.22s | 0.02s | 0.73s | 0.02s-0.74s -------------------------------------------------------------------------------- View renderin | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- TimeEntryRepo | 4 | 21.44s | 5.36s | 9.87s | 0.05s | 20.16s | 0.05s-20.23s TimesheetCont | 8 | 18.67s | 2.33s | 0.85s | 1.34s | 4.22s | 1.33s-4.24s Knowledgebase | 16 | 31.55s | 1.97s | 1.39s | 0.52s | 5.28s | 0.51s-5.31s TimesheetCont | 8 | 12.36s | 1.54s | 1.01s | 0.42s | 2.98s | 0.42s-3.02s GanttsControl | 57 | 1m16s | 1.33s | 1.12s | 0.20s | 5.28s | 0.23s-4.74s ActivitiesCon | 1 | 1.25s | 1.25s | 0.00s | 1.25s | 1.25s | 1.24s-1.29s ProjectsContr | 31 | 25.56s | 0.82s | 0.62s | 0.25s | 3.09s | 0.25s-3.12s IssuesControl | 171 | 2m21s | 0.82s | 0.51s | 0.17s | 3.69s | 0.22s-2.15s IssuesControl | 25 | 19.10s | 0.76s | 0.76s | 0.06s | 3.55s | 0.06s-3.55s ProjectsContr | 4 | 2.91s | 0.73s | 0.14s | 0.58s | 0.91s | 0.57s-0.92s MessagesContr | 3 | 2.08s | 0.69s | 0.55s | 0.06s | 1.05s | 0.06s-1.06s TimelogContro | 21 | 13.69s | 0.65s | 0.77s | 0.11s | 2.83s | 0.11s-2.83s MyController# | 1 | 0.55s | 0.55s | 0.00s | 0.55s | 0.55s | 0.54s-0.56s IssuesControl | 463 | 3m59s | 0.52s | 0.55s | 0.14s | 7.38s | 0.17s-1.99s DocumentsCont | 1 | 0.50s | 0.50s | 0.00s | 0.50s | 0.50s | 0.50s-0.51s WelcomeContro | 78 | 37.85s | 0.49s | 0.44s | 0.12s | 2.23s | 0.14s-1.92s MyController# | 160 | 1m05s | 0.41s | 0.33s | 0.09s | 1.81s | 0.09s-1.49s ArticlesContr | 2 | 0.66s | 0.33s | 0.18s | 0.20s | 0.45s | 0.20s-0.46s ContextMenusC | 3 | 0.88s | 0.29s | 0.38s | 0.05s | 0.73s | 0.05s-0.74s TimelogContro | 24 | 5.72s | 0.24s | 0.35s | 0.03s | 1.53s | 0.03s-1.53s -------------------------------------------------------------------------------- Database tim | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- TimesheetCon | 8 | 2m15s | 16.88s | 41.80s | 0.62s | 1m60s | 0.62s-2m01s AccountContr | 3655 | 1m44s | 0.03s | 0.06s | 0.00s | 0.91s | 0.00s-0.28s IssuesContro | 467 | 32.05s | 0.07s | 0.12s | 0.00s | 0.88s | 0.00s-0.54s TimeEntryRep | 2 | 28.53s | 14.27s | 0.86s | 13.66s | 14.88s | 13.52s-14.89s MessagesCont | 3296 | 28.06s | 0.01s | 0.02s | 0.00s | 0.34s | 0.00s-0.05s IssuesContro | 118 | 24.32s | 0.21s | 0.54s | 0.00s | 4.92s | 0.05s-1.89s IssuesContro | 173 | 21.08s | 0.12s | 0.27s | 0.00s | 2.38s | 0.00s-0.92s ProjectsCont | 520 | 16.31s | 0.03s | 0.11s | 0.00s | 1.92s | 0.00s-0.35s IssuesContro | 57 | 16.17s | 0.28s | 0.59s | 0.02s | 4.05s | 0.02s-1.72s TimeEntryRep | 4 | 12.75s | 3.19s | 4.97s | 0.33s | 10.62s | 0.33s-10.79s MyController | 162 | 12.62s | 0.08s | 0.16s | 0.00s | 1.14s | 0.00s-0.76s IssuesContro | 71 | 12.00s | 0.17s | 0.32s | 0.02s | 1.84s | 0.02s-1.35s ProjectsCont | 34 | 10.65s | 0.31s | 0.31s | 0.00s | 1.34s | 0.00s-1.35s AttachmentsC | 169 | 5.44s | 0.03s | 0.08s | 0.00s | 0.95s | 0.00s-0.27s TimesheetCon | 8 | 5.02s | 0.63s | 0.65s | 0.22s | 2.03s | 0.22s-2.05s Knowledgebas | 16 | 4.62s | 0.29s | 0.38s | 0.03s | 1.20s | 0.03s-1.21s IssuesContro | 25 | 4.47s | 0.18s | 0.46s | 0.02s | 2.25s | 0.02s-2.26s WelcomeContr | 126 | 4.03s | 0.03s | 0.20s | 0.00s | 2.20s | 0.00s-0.06s AutoComplete | 48 | 3.79s | 0.08s | 0.19s | 0.00s | 1.06s | 0.00s-1.08s GanttsContro | 57 | 3.67s | 0.06s | 0.10s | 0.00s | 0.52s | 0.00s-0.44s -------------------------------------------------------------------------------- Database tim | Hits | Sum | Mean | StdDev | Min | Max | 95 %tile -------------------------------------------------------------------------------- TimesheetCon | 8 | 2m15s | 16.88s | 41.80s | 0.62s | 1m60s | 0.62s-2m01s TimeEntryRep | 2 | 28.53s | 14.27s | 0.86s | 13.66s | 14.88s | 13.52s-14.89s TimeEntryRep | 4 | 12.75s | 3.19s | 4.97s | 0.33s | 10.62s | 0.33s-10.79s IssuesContro | 1 | 0.70s | 0.70s | 0.00s | 0.70s | 0.70s | 0.70s-0.72s MembersContr | 1 | 0.69s | 0.69s | 0.00s | 0.69s | 0.69s | 0.69s-0.71s TimesheetCon | 8 | 5.02s | 0.63s | 0.65s | 0.22s | 2.03s | 0.22s-2.05s IssuesContro | 1 | 0.55s | 0.55s | 0.00s | 0.55s | 0.55s | 0.54s-0.56s ProjectsCont | 4 | 1.91s | 0.48s | 0.50s | 0.08s | 1.17s | 0.08s-1.19s MyController | 1 | 0.47s | 0.47s | 0.00s | 0.47s | 0.47s | 0.47s-0.48s ContextMenus | 3 | 1.06s | 0.35s | 0.55s | 0.03s | 0.98s | 0.03s-0.99s ProjectsCont | 34 | 10.65s | 0.31s | 0.31s | 0.00s | 1.34s | 0.00s-1.35s Knowledgebas | 16 | 4.62s | 0.29s | 0.38s | 0.03s | 1.20s | 0.03s-1.21s IssuesContro | 57 | 16.17s | 0.28s | 0.59s | 0.02s | 4.05s | 0.02s-1.72s IssuesContro | 118 | 24.32s | 0.21s | 0.54s | 0.00s | 4.92s | 0.05s-1.89s SearchContro | 12 | 2.22s | 0.18s | 0.45s | 0.00s | 1.58s | 0.00s-1.58s IssuesContro | 25 | 4.47s | 0.18s | 0.46s | 0.02s | 2.25s | 0.02s-2.26s IssuesContro | 71 | 12.00s | 0.17s | 0.32s | 0.02s | 1.84s | 0.02s-1.35s TimelogContr | 21 | 3.36s | 0.16s | 0.29s | 0.00s | 1.03s | 0.00s-1.04s ActivitiesCo | 1 | 0.12s | 0.12s | 0.00s | 0.12s | 0.12s | 0.12s-0.13s IssuesContro | 173 | 21.08s | 0.12s | 0.27s | 0.00s | 2.38s | 0.00s-0.92s Process blockers (> 1 sec duration) -------------------------------------------------------------------------------- IssuesController#update.html [PUT] | 75 hits | 18.9% | === IssuesController#index.html [GET] | 68 hits | 17.2% | === IssuesController#show.html [GET] | 60 hits | 15.2% | == GanttsController#show.html [GET] | 31 hits | 7.8% | = IssuesController#create.html [POST] | 25 hits | 6.3% | = WelcomeController#index.html [GET] | 15 hits | 3.8% | = MyController#page.html [GET] | 14 hits | 3.5% | = ProjectsController#index.html [GET] | 14 hits | 3.5% | = KnowledgebaseController#index.html [GET] | 12 hits | 3.0% | AccountController#login.html [GET] | 10 hits | 2.5% | IssuesController#index.html [POST] | 10 hits | 2.5% | MessagesController#show.html [GET] | 8 hits | 2.0% | TimesheetController#index.html [GET] | 8 hits | 2.0% | TimesheetController#report.html [POST] | 8 hits | 2.0% | ProjectsController#show.html [GET] | 7 hits | 1.8% | IssuesController#new.html [GET] | 6 hits | 1.5% | TimelogController#index.html [GET] | 6 hits | 1.5% | ProjectsController#settings.html [GET] | 3 hits | 0.8% | TimeEntryReportsController#report.html [GET] | 2 hits | 0.5% | IssuesController#new.html [POST] | 2 hits | 0.5% | Failed requests -------------------------------------------------------------------------------- ActionController::RoutingError | 36 hits | 100.0% | ============================ Need an expert to analyze your application? Mail to [email protected] or visit us at http://railsdoctors.com. -------------------------------------------------------------------------------- Thanks for using request-log-analyzer!