awk 统计访问时间超过1000毫秒的接口


日志格式如下：

2013-01-10 15:21:44:815 INFO [catalina-exec-115] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=23ms, servletPath=/requestResumeInfo/findResume.json, clientIP=10.10.10.22, input={"data":"3721","client_id":"20007","view_id":"64670"}, output={"status":0,"message":"OK","data":{"res_id":3721,"sysResumeDto":{"res_id":3721,"user_id":4963,"delflag":"0","res_caption":"中文简历_20130110","res_tel":"13808080808","res_email":"13808080808@138.com","res_langkind":"0","res_edulevel":"050","res_workyear":2004,"res_nowsalary":7500,"res_format":"0","res_category":"1","res_wantdq":"010,020,050","res_wantindustry":"000","res_wantjobtitle":"020010","res_wantsalary":0,"res_salmonths":12,"res_birth_year":1976,"res_industry":"000","res_jobtitle":"020010","res_dq":"010"(... more 1671 chars ignored)
2013-01-10 15:21:44:825 INFO [catalina-exec-138] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=2ms, servletPath=/requestResumeInfo/findUserCId.json, clientIP=10.10.10.22, input={"data":"10660","client_id":"20007","view_id":"638"}, output={"status":0,"message":"OK","data":13498}
2013-01-10 15:21:44:844 INFO [catalina-exec-24] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=21ms, servletPath=/requestResumeInfo/findResume.json, clientIP=10.10.10.22, input={"data":"150051","client_id":"20007","view_id":"103584"}, output={"status":0,"message":"OK","data":{"res_id":150051,"sysResumeDto":{"res_id":150051,"user_id":291836,"delflag":"0","res_caption":"中文简历_20130110","res_tel":"13808080808","res_email":"13808080808@138.com","res_langkind":"0","res_edulevel":"040","res_workyear":2005,"res_nowsalary":0,"res_format":"0","res_category":"1","res_wantdq":"020,060020,070030","res_wantindustry":"190","res_wantjobtitle":"020020","res_wantsalary":0,"res_salmonths":12,"res_birth_year":1981,"res_industry":"190","res_jobtitle":"120110","res_(... more 3026 chars ignored)
2013-01-10 15:21:44:846 INFO [catalina-exec-117] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=51ms, servletPath=/requestResumeInfo/findResumesByUserCId.json, clientIP=10.10.10.22, input={"data":"269551?","client_id":"20004","view_id":"269551"}, output={"status":0,"message":"OK","data":[{"res_id":129684,"sysResumeDto":{"res_id":129684,"user_id":269551,"delflag":"0","res_caption":"中文简历_20130110","res_tel":"13808080808","res_email":"13808080808@138.com","res_langkind":"0","res_edulevel":"050","res_workyear":1984,"res_nowsalary":0,"res_format":"0","res_category":"1","res_wantdq":"100,020","res_wantindustry":"350,120,240","res_wantjobtitle":"010040,090010,090030","res_wantsalary":0,"res_salmonths":12,"res_birth_year":1983,"res_industry":"350","res_jobtitle":"(... more 6099 chars ignored)
2013-01-10 15:21:44:854 INFO [catalina-exec-112] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=3ms, servletPath=/requestResumeInfo/findUserCId.json, clientIP=10.10.10.22, input={"data":"9310","client_id":"20007","view_id":"638"}, output={"status":0,"message":"OK","data":0}
2013-01-10 15:21:44:854 INFO [catalina-exec-109] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=26ms, servletPath=/requestResumeInfo/findResume.json, clientIP=10.10.10.22, input={"data":"63961","client_id":"20007","view_id":"140828"}, output={"status":0,"message":"OK","data":{"res_id":63961,"sysResumeDto":{"res_id":63961,"user_id":85396,"delflag":"0","res_caption":"中文简历_20130110","res_tel":"13808080808","res_email":"13808080808@138.com","res_langkind":"0","res_edulevel":"030","res_workyear":2003,"res_nowsalary":0,"res_format":"0","res_category":"1","res_wantdq":"010","res_wantindustry":"080","res_wantjobtitle":"170070,170140","res_wantsalary":0,"res_salmonths":12,"res_birth_year":1979,"res_industry":"080","res_jobtitle":"170070","res_dq":"010",(... more 2709 chars ignored)
2013-01-10 15:21:44:868 INFO [catalina-exec-59] com.lietou.common.filter.AbstractIOLogger | status=0, eclipse=17ms, servletPath=/requestResumeInfo/findResume.json, clientIP=10.10.10.22, input={"data":"4874","client_id":"20007","view_id":"32150"}, output={"status":0,"message":"OK","data":{"res_id":4874,"sysResumeDto":{"res_id":4874,"user_id":6112,"delflag":"0","res_caption":"中文简历_20130110","res_tel":"13808080808","res_email":"13808080808@138.com","res_langkind":"0","res_edulevel":"040","res_wo

测试命令如下：

cat eventInfo.log |sed 's/ms,//g' |awk '{ if (substr($8,9) -100 >0 ) print}'|awk '{print $9}'|sort|uniq -c|sort -nr|head

测试结果如下：

 2712 servletPath=/requestResumeInfo/findResumesByUserCId.json,
  2626 servletPath=/requestResumeInfo/findResume.json,
  2457 servletPath=/requestResumeInfo/findResumes.json,
  1084 servletPath=/requestResumeInfo/findSysResume.json,
    577 servletPath=/requestResumeInfo/findResumeRefreshTime.json,
    340 servletPath=/requestResumeInfo/findResumeIdsByUserCId.json,
    131 servletPath=/requestResumeInfo/findResumeContact.json,
    93 servletPath=/requestResumeInfo/findOtherResIdById.json,
    66 servletPath=/requestResumeInfo/modifyResumeCategory.json,
    61 servletPath=/requestResumeInfo/autoRefreshResumes.json,

相关内容