java web应用在tomcat上部署,服务器宕机,求高手分析原因
java web应用在tomcat上部署,服务器宕机,求高手分析原因
以下是所有错误日志的详细信息,因长度限制,删除了部分无用的日志内容,红色的地方作了重点标记,应用中用到了以下主要的技术:
activeMQ、redis缓存、spring配置org.apache.activemq.ActiveMQConnectionFactory消息侦听,开了一个定时任务org.springframework.scheduling.quartz.SchedulerFactoryBean,lucene搜索。
应用会在用户发表博客或公告等内容时,会同时会将该博客或公告内容发送一条消息到同一个activeMQ消息队列,消息侦听接收到消息时,会创建相应的博客或公告索引。
定时任务是确保消息队列出现问题时,以一定的周期查询数据库博客或公告记录,如果该记录的索引标记为未创建,则创建未索引的博客或公告。其他内容不再详述。
错误日志的详细内容如下:
D:\软件\springToolSuite\springToolSuite\springToolSuite\sts\hs_err_pid8160.log
#
# An unexpected error has been detected by Java Runtime Environment:
#
# Internal Error (os_windows.cpp:3666), pid=8160, tid=1764
# Error: guarantee(_ParkHandle != 0,"Invariant")
#
# Java VM: Java HotSpot(TM) Client VM (11.0-b15 mixed mode windows-x86)
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x0b6a9400 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3836" [_thread_blocked, id=7896, stack(0x0c920000,0x0c970000)]
0x0b61c800 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=5676, stack(0x0d000000,0x0d050000)]
0x0b447400 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=4896, stack(0x0ce20000,0x0ce70000)]
0x0b6afc00 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3834" [_thread_in_native, id=8120, stack(0x0cb00000,0x0cb50000)]
0x0b7ae800 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3835" [_thread_in_native, id=3372, stack(0x0cab0000,0x0cb00000)]
0x0b3fa400 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=8180, stack(0x0d0a0000,0x0d0f0000)]
0x0b8e9800 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3833" [_thread_in_native, id=2816, stack(0x0c8d0000,0x0c920000)]
0x0b5a5c00 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=7068, stack(0x0d0f0000,0x0d140000)]
0x0b54b400 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=5980, stack(0x0cf60000,0x0cfb0000)]
0x0b593800 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3832" [_thread_in_native, id=6384, stack(0x0cec0000,0x0cf10000)]
0x0bc0f400 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3831" [_thread_in_native, id=6840, stack(0x0cba0000,0x0cbf0000)]
0x0b3a0800 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=3108, stack(0x0d050000,0x0d0a0000)]
0x0b950400 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=7584, stack(0x0ca60000,0x0cab0000)]
0x0b6b4c00 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3830" [_thread_in_native, id=5476, stack(0x0ca10000,0x0ca60000)]
0x0b8d4c00 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3829" [_thread_in_native, id=2084, stack(0x0c9c0000,0x0ca10000)]
0x0b2bc400 JavaThread "ActiveMQ Session Task-1" [_thread_blocked, id=2452, stack(0x0cfb0000,0x0d000000)]
0x0b494400 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3828" [_thread_blocked, id=4736, stack(0x0ce70000,0x0cec0000)]
0x0b61c400 JavaThread "ActiveMQ Transport: tcp:///10.22.7.127:61616@3827" [_thread_blocked, id=2212, stack(0x0cb50000,0x0cba0000)]
0x0b53d800 JavaThread "TP-Monitor" daemon [_thread_blocked, id=1076, stack(0x0cdd0000,0x0ce20000)]
0x0b6cd400 JavaThread "TP-Processor4" daemon [_thread_in_native, id=4152, stack(0x0cd80000,0x0cdd0000)]
0x0b6cc000 JavaThread "TP-Processor3" daemon [_thread_blocked, id=204, stack(0x0cd30000,0x0cd80000)]
0x0b54cc00 JavaThread "TP-Processor2" daemon [_thread_blocked, id=4744, stack(0x0cce0000,0x0cd30000)]
0x0b91e800 JavaThread "TP-Processor1" daemon [_thread_blocked, id=6952, stack(0x0cc90000,0x0cce0000)]
0x0b9b3400 JavaThread "http-80-Acceptor-0" daemon [_thread_in_native, id=6264, stack(0x0cc40000,0x0cc90000)]
0x0b5d5400 JavaThread "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon [_thread_blocked, id=220, stack(0x0cbf0000,0x0cc40000)]
0x0b76fc00 JavaThread "blogJMSTestListenerContainer-10" [_thread_blocked, id=4488, stack(0x0c830000,0x0c880000)]
0x0b76e000 JavaThread "blogJMSTestListenerContainer-9" [_thread_blocked, id=4112, stack(0x0c7e0000,0x0c830000)]
0x0b76c800 JavaThread "blogJMSTestListenerContainer-8" [_thread_blocked, id=8064, stack(0x0c790000,0x0c7e0000)]
0x0b505800 JavaThread "blogJMSTestListenerContainer-7" [_thread_blocked, id=7212, stack(0x0c740000,0x0c790000)]
0x0b504400 JavaThread "blogJMSTestListenerContainer-6" [_thread_blocked, id=6020, stack(0x0c6f0000,0x0c740000)]
0x0b502c00 JavaThread "blogJMSTestListenerContainer-5" [_thread_blocked, id=7948, stack(0x0c6a0000,0x0c6f0000)]
0x0ba60400 JavaThread "blogJMSTestListenerContainer-4" [_thread_blocked, id=7712, stack(0x0c650000,0x0c6a0000)]
0x0ba5f400 JavaThread "blogJMSTestListenerContainer-3" [_thread_blocked, id=5696, stack(0x0c600000,0x0c650000)]
0x0b649c00 JavaThread "blogJMSTestListenerContainer-2" [_thread_blocked, id=4084, stack(0x0c5b0000,0x0c600000)]
0x0ba61800 JavaThread "blogJMSTestListenerContainer-1" [_thread_blocked, id=5700, stack(0x0c560000,0x0c5b0000)]
0x0b648400 JavaThread "Timer-1" daemon [_thread_blocked, id=7160, stack(0x0c510000,0x0c560000)]
0x0b64b800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_QuartzSchedulerThread" [_thread_blocked, id=4452, stack(0x0c4c0000,0x0c510000)]
0x0b643c00 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-9" [_thread_blocked, id=7604, stack(0x0c470000,0x0c4c0000)]
0x0b642800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-8" [_thread_blocked, id=7568, stack(0x0c420000,0x0c470000)]
0x0b641400 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-7" [_thread_blocked, id=6796, stack(0x0c3d0000,0x0c420000)]
0x0b66d800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-6" [_thread_blocked, id=6836, stack(0x0c380000,0x0c3d0000)]
0x0b66c400 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-5" [_thread_blocked, id=808, stack(0x0c330000,0x0c380000)]
0x0b66ac00 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-4" [_thread_blocked, id=7364, stack(0x0c2e0000,0x0c330000)]
0x0b671800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-3" [_thread_blocked, id=2568, stack(0x0c290000,0x0c2e0000)]
0x0b670800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-2" [_thread_blocked, id=7924, stack(0x0c240000,0x0c290000)]
0x0b619800 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-1" [_thread_blocked, id=5568, stack(0x0c1f0000,0x0c240000)]
0x0b736400 JavaThread "org.springframework.scheduling.quartz.SchedulerFactoryBean#0_Worker-0" [_thread_blocked, id=4724, stack(0x0c1a0000,0x0c1f0000)]
0x0b8ad000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon [_thread_blocked, id=7372, stack(0x0c150000,0x0c1a0000)]
0x0b8f2c00 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon [_thread_blocked, id=6692, stack(0x0c100000,0x0c150000)]
0x0b906800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon [_thread_blocked, id=7536, stack(0x0c0b0000,0x0c100000)]
0x0b8a6800 JavaThread "Timer-0" daemon [_thread_blocked, id=2828, stack(0x0c060000,0x0c0b0000)]
0x0b3b6400 JavaThread "GC Daemon" daemon [_thread_blocked, id=7316, stack(0x0b810000,0x0b860000)]
0x0ad83400 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=6380, stack(0x0b150000,0x0b1a0000)]
0x0ad82400 JavaThread "CompilerThread0" daemon [_thread_blocked, id=6544, stack(0x0b100000,0x0b150000)]
0x0ad73c00 JavaThread "JDWP Command Reader" daemon [_thread_in_native, id=7048, stack(0x0b0b0000,0x0b100000)]
0x0ad72000 JavaThread "JDWP Event Helper Thread" daemon [_thread_blocked, id=4664, stack(0x0b060000,0x0b0b0000)]
=>0x0ad6fc00 JavaThread "JDWP Transport Listener: dt_socket" daemon [_thread_in_vm, id=1764, stack(0x0b010000,0x0b060000)]
0x0ad64400 JavaThread "Attach Listener" daemon [_thread_blocked, id=1628, stack(0x0af10000,0x0af60000)]
0x0ad76c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=1744, stack(0x0aec0000,0x0af10000)]
0x0ad4d400 JavaThread "Finalizer" daemon [_thread_blocked, id=7916, stack(0x0ae70000,0x0aec0000)]
0x0ad48800 JavaThread "Reference Handler" daemon [_thread_blocked, id=5260, stack(0x0ae20000,0x0ae70000)]
0x00a97c00 JavaThread "main" [_thread_in_native, id=2544, stack(0x00b30000,0x00b80000)]
Other Threads:
0x0ad45000 VMThread [stack: 0x0add0000,0x0ae20000] [id=6284]
0x0ad8e400 WatcherThread [stack: 0x0b1a0000,0x0b1f0000] [id=4904]
VM state:synchronizing (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00a96ad0] UNKNOWN - owner thread: 0x0ad45000
Heap
def new generation total 4544K, used 1137K [0x02c30000, 0x03110000, 0x03110000)
eden space 4096K, 16% used [0x02c30000, 0x02cdc448, 0x03030000)
from space 448K, 100% used [0x030a0000, 0x03110000, 0x03110000)
to space 448K, 0% used [0x03030000, 0x03030000, 0x030a0000)
tenured generation total 60544K, used 55719K [0x03110000, 0x06c30000, 0x06c30000)
the space 60544K, 92% used [0x03110000, 0x06779e78, 0x0677a000, 0x06c30000)
compacting perm gen total 33536K, used 33361K [0x06c30000, 0x08cf0000, 0x0ac30000)
the space 33536K, 99% used [0x06c30000, 0x08cc4680, 0x08cc4800, 0x08cf0000)
No shared spaces configured.
Dynamic libraries:
0x00400000 - 0x00424000 C:\Program Files\Java\jdk1.6.0_10\jre\bin\javaw.exe
0x7c920000 - 0x7c9b6000 C:\WINDOWS\system32\ntdll.dll
......
--------------- S Y S T E M ---------------
OS: Windows XP Build 2600 Service Pack 3
.... java tomcat 服务器 web activeMQ
[解决办法]
permgen最大值多少?是不是开了太多连接?
[解决办法]
只找到jdk7的代码:
http://cr.openjdk.java.net/~aph/6929067-jdk7-webrev-4/hotspot/src/os/windows/vm/os_windows.cpp.html
应该是这个地方出错:
3869 int os::PlatformEvent::park (jlong Millis) {
3870 guarantee (_ParkHandle != NULL , "Invariant") ;