root@java02:~$ cat /tmp/jvm-19078/hs_error.log # # There is insufficient memory for the Java Runtime Environment to continue. # Cannot create GC thread. Out of system resources. # Possible reasons: # The system is out of physical RAM or swap space # In 32 bit mode, the process size limit was hit # Possible solutions: # Reduce memory load on the system # Increase physical memory or swap space # Check if swap backing store is full # Use 64 bit Java on a 64 bit OS # Decrease Java heap size (-Xmx/-Xms) # Decrease number of Java threads # Decrease Java thread stack sizes (-Xss) # Set larger code cache with -XX:ReservedCodeCacheSize= # This output file may be truncated or incomplete. # # Out of Memory Error (gcTaskThread.cpp:46), pid=19078, tid=139625024362240 # # JRE version: (7.0_95) (build ) # Java VM: OpenJDK 64-Bit Server VM (24.95-b01 mixed mode linux-amd64 compressed oops) # Derivative: IcedTea 2.6.4 # Distribution: CentOS release 6.7 (Final), package rhel-2.6.4.0.el6_7-x86_64 u95-b00 # Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again # --------------- T H R E A D --------------- Current thread (0x000000000064b800): JavaThread "Unknown thread" [_thread_in_vm, id=19078, stack(0x00007ffd3087a000,0x00007ffd3097a000)] Stack: [0x00007ffd3087a000,0x00007ffd3097a000], sp=0x00007ffd309738f0, free space=998k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [libjvm.so+0x95ebad] V [libjvm.so+0x4a0e00] V [libjvm.so+0x55bd1a] V [libjvm.so+0x55ad07] V [libjvm.so+0x808379] V [libjvm.so+0x931840] V [libjvm.so+0x934e38] V [libjvm.so+0x5b3275] V [libjvm.so+0x91d649] V [libjvm.so+0x60fb2f] JNI_CreateJavaVM+0x6f C [libjli.so+0x2f77] C [libjli.so+0x8a83] C [libjli.so+0x2574] C [libjli.so+0x50a8] JLI_Launch+0x478 C [jmap+0x773] --------------- P R O C E S S --------------- Java Threads: ( => current thread ) Other Threads: =>0x000000000064b800 (exited) JavaThread "Unknown thread" [_thread_in_vm, id=19078, stack(0x00007ffd3087a000,0x00007ffd3097a000)] VM state:not at safepoint (not fully initialized) VM Mutex/Monitor currently owned by a thread: None GC Heap History (0 events): No events Deoptimization events (0 events): No events Internal exceptions (0 events): No events Events (0 events): No events Dynamic libraries: 00400000-00401000 r-xp 00000000 ca:01 277075 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/bin/jmap 00600000-00601000 rw-p 00000000 ca:01 277075 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/bin/jmap 00640000-00682000 rw-p 00000000 00:00 0 [heap] b8e00000-ba300000 rw-p 00000000 00:00 0 ba300000-c3400000 rw-p 00000000 00:00 0 c3400000-c3980000 rw-p 00000000 00:00 0 c3980000-ebc00000 rw-p 00000000 00:00 0 ebc00000-ec000000 rw-p 00000000 00:00 0 ec000000-100000000 rw-p 00000000 00:00 0 7efcf5eee000-7efcf5ef9000 rw-p 00000000 00:00 0 7efcf5ef9000-7efcf5f41000 rw-p 00000000 00:00 0 7efcf5f41000-7efcf5f44000 rw-p 00000000 00:00 0 7efcf5f44000-7efcf6085000 rw-p 00000000 00:00 0 7efcf6085000-7efcf6090000 rw-p 00000000 00:00 0 7efcf6090000-7efcf60d8000 rw-p 00000000 00:00 0 7efcf60d8000-7efcf60db000 rw-p 00000000 00:00 0 7efcf60db000-7efcf621c000 rw-p 00000000 00:00 0 7efcf621c000-7efcf621e000 rw-p 00000000 00:00 0 7efcf621e000-7efcf62be000 rw-p 00000000 00:00 0 7efcf62be000-7efcf62bf000 rw-p 00000000 00:00 0 7efcf62bf000-7efcf652f000 rwxp 00000000 00:00 0 7efcf652f000-7efcf92bf000 rw-p 00000000 00:00 0 7efcf92bf000-7efcf92c7000 r-xp 00000000 ca:01 286203 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libzip.so 7efcf92c7000-7efcf94c6000 ---p 00008000 ca:01 286203 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libzip.so 7efcf94c6000-7efcf94c7000 rw-p 00007000 ca:01 286203 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libzip.so 7efcf94c7000-7efcf95c5000 r--s 00000000 ca:01 395558 /var/db/nscd/passwd 7efcf95c5000-7efcf95ee000 r-xp 00000000 ca:01 286180 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libjava.so 7efcf95ee000-7efcf97ee000 ---p 00029000 ca:01 286180 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libjava.so 7efcf97ee000-7efcf97f0000 rw-p 00029000 ca:01 286180 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libjava.so 7efcf97f0000-7efcf97fd000 r-xp 00000000 ca:01 286202 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libverify.so 7efcf97fd000-7efcf99fd000 ---p 0000d000 ca:01 286202 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libverify.so 7efcf99fd000-7efcf99ff000 rw-p 0000d000 ca:01 286202 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/libverify.so 7efcf99ff000-7efcf9a06000 r-xp 00000000 ca:01 264893 /lib64/librt-2.12.so 7efcf9a06000-7efcf9c05000 ---p 00007000 ca:01 264893 /lib64/librt-2.12.so 7efcf9c05000-7efcf9c06000 r--p 00006000 ca:01 264893 /lib64/librt-2.12.so 7efcf9c06000-7efcf9c07000 rw-p 00007000 ca:01 264893 /lib64/librt-2.12.so 7efcf9c07000-7efcf9c1d000 r-xp 00000000 ca:01 280903 /lib64/libgcc_s-4.4.7-20120601.so.1 7efcf9c1d000-7efcf9e1c000 ---p 00016000 ca:01 280903 /lib64/libgcc_s-4.4.7-20120601.so.1 7efcf9e1c000-7efcf9e1d000 rw-p 00015000 ca:01 280903 /lib64/libgcc_s-4.4.7-20120601.so.1 7efcf9e1d000-7efcf9ea0000 r-xp 00000000 ca:01 264873 /lib64/libm-2.12.so 7efcf9ea0000-7efcfa09f000 ---p 00083000 ca:01 264873 /lib64/libm-2.12.so 7efcfa09f000-7efcfa0a0000 r--p 00082000 ca:01 264873 /lib64/libm-2.12.so 7efcfa0a0000-7efcfa0a1000 rw-p 00083000 ca:01 264873 /lib64/libm-2.12.so 7efcfa0a1000-7efcfa189000 r-xp 00000000 ca:01 265755 /usr/lib64/libstdc++.so.6.0.13 7efcfa189000-7efcfa389000 ---p 000e8000 ca:01 265755 /usr/lib64/libstdc++.so.6.0.13 7efcfa389000-7efcfa390000 r--p 000e8000 ca:01 265755 /usr/lib64/libstdc++.so.6.0.13 7efcfa390000-7efcfa392000 rw-p 000ef000 ca:01 265755 /usr/lib64/libstdc++.so.6.0.13 7efcfa392000-7efcfa3a7000 rw-p 00000000 00:00 0 7efcfa3a7000-7efcfaed1000 r-xp 00000000 ca:01 286207 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/server/libjvm.so 7efcfaed1000-7efcfb0d0000 ---p 00b2a000 ca:01 286207 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/server/libjvm.so 7efcfb0d0000-7efcfb194000 rw-p 00b29000 ca:01 286207 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/jre/lib/amd64/server/libjvm.so 7efcfb194000-7efcfb1c0000 rw-p 00000000 00:00 0 7efcfb1c0000-7efcfb1d5000 r-xp 00000000 ca:01 265291 /lib64/libz.so.1.2.3 7efcfb1d5000-7efcfb3d4000 ---p 00015000 ca:01 265291 /lib64/libz.so.1.2.3 7efcfb3d4000-7efcfb3d5000 r--p 00014000 ca:01 265291 /lib64/libz.so.1.2.3 7efcfb3d5000-7efcfb3d6000 rw-p 00015000 ca:01 265291 /lib64/libz.so.1.2.3 7efcfb3d6000-7efcfb560000 r-xp 00000000 ca:01 264865 /lib64/libc-2.12.so 7efcfb560000-7efcfb760000 ---p 0018a000 ca:01 264865 /lib64/libc-2.12.so 7efcfb760000-7efcfb764000 r--p 0018a000 ca:01 264865 /lib64/libc-2.12.so 7efcfb764000-7efcfb765000 rw-p 0018e000 ca:01 264865 /lib64/libc-2.12.so 7efcfb765000-7efcfb76a000 rw-p 00000000 00:00 0 7efcfb76a000-7efcfb76c000 r-xp 00000000 ca:01 264871 /lib64/libdl-2.12.so 7efcfb76c000-7efcfb96c000 ---p 00002000 ca:01 264871 /lib64/libdl-2.12.so 7efcfb96c000-7efcfb96d000 r--p 00002000 ca:01 264871 /lib64/libdl-2.12.so 7efcfb96d000-7efcfb96e000 rw-p 00003000 ca:01 264871 /lib64/libdl-2.12.so 7efcfb96e000-7efcfb97b000 r-xp 00000000 ca:01 277125 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/lib/amd64/jli/libjli.so 7efcfb97b000-7efcfbb7a000 ---p 0000d000 ca:01 277125 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/lib/amd64/jli/libjli.so 7efcfbb7a000-7efcfbb7b000 rw-p 0000c000 ca:01 277125 /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64/lib/amd64/jli/libjli.so 7efcfbb7b000-7efcfbb92000 r-xp 00000000 ca:01 264889 /lib64/libpthread-2.12.so 7efcfbb92000-7efcfbd92000 ---p 00017000 ca:01 264889 /lib64/libpthread-2.12.so 7efcfbd92000-7efcfbd93000 r--p 00017000 ca:01 264889 /lib64/libpthread-2.12.so 7efcfbd93000-7efcfbd94000 rw-p 00018000 ca:01 264889 /lib64/libpthread-2.12.so 7efcfbd94000-7efcfbd98000 rw-p 00000000 00:00 0 7efcfbd98000-7efcfbdb8000 r-xp 00000000 ca:01 264853 /lib64/ld-2.12.so 7efcfbddf000-7efcfbde9000 rw-p 00000000 00:00 0 7efcfbde9000-7efcfbe9f000 rw-p 00000000 00:00 0 7efcfbe9f000-7efcfbea7000 rw-s 00000000 ca:01 277343 /tmp/hsperfdata_spushnik/19078 7efcfbea7000-7efcfbea8000 ---p 00000000 00:00 0 7efcfbea8000-7efcfbfad000 rw-p 00000000 00:00 0 7efcfbfb2000-7efcfbfb5000 rw-p 00000000 00:00 0 7efcfbfb5000-7efcfbfb6000 r--p 00000000 00:00 0 7efcfbfb6000-7efcfbfb7000 rw-p 00000000 00:00 0 7efcfbfb7000-7efcfbfb8000 r--p 0001f000 ca:01 264853 /lib64/ld-2.12.so 7efcfbfb8000-7efcfbfb9000 rw-p 00020000 ca:01 264853 /lib64/ld-2.12.so 7efcfbfb9000-7efcfbfba000 rw-p 00000000 00:00 0 7ffd3087a000-7ffd3087d000 ---p 00000000 00:00 0 7ffd3087e000-7ffd3097a000 rw-p 00000000 00:00 0 [stack] 7ffd3097e000-7ffd3097f000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] VM Arguments: jvm_args: -Dapplication.home=/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.95.x86_64 -Xms8m -Dsun.jvm.hotspot.debugger.useProcDebugger -Dsun.jvm.hotspot.debugger.useWindbgDebugger java_command: sun.tools.jmap.JMap -heap -F 16145 -dump:format=b,file=/tmp/heap_file Launcher Type: SUN_STANDARD Environment Variables: PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin USERNAME=spushnik SHELL=/bin/bash Signal Handlers: SIGSEGV: [libjvm.so+0x95f6a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGBUS: [libjvm.so+0x95f6a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGFPE: [libjvm.so+0x7e6b40], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGPIPE: [libjvm.so+0x7e6b40], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGXFSZ: [libjvm.so+0x7e6b40], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGILL: [libjvm.so+0x7e6b40], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGUSR2: [libjvm.so+0x7e8210], sa_mask[0]=0x00000000, sa_flags=0x10000004 SIGHUP: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGINT: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGTERM: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGQUIT: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGTRAP: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 --------------- S Y S T E M --------------- OS:CentOS release 6.7 (Final) uname:Linux 2.6.32-573.12.1.el6.x86_64 #1 SMP Tue Dec 15 21:19:08 UTC 2015 x86_64 libc:glibc 2.12 NPTL 2.12 rlimit: STACK 10240k, CORE 0k, NPROC 1024, NOFILE 4096, AS infinity load average:0.01 0.04 0.00 /proc/meminfo: MemTotal: 3973948 kB MemFree: 34712 kB Buffers: 322484 kB Cached: 1129012 kB SwapCached: 3896 kB Active: 1058884 kB Inactive: 1184076 kB Active(anon): 398088 kB Inactive(anon): 517532 kB Active(file): 660796 kB Inactive(file): 666544 kB Unevictable: 1447600 kB Mlocked: 1447600 kB SwapTotal: 2097116 kB SwapFree: 2035576 kB Dirty: 156 kB Writeback: 0 kB AnonPages: 2235740 kB Mapped: 161776 kB Shmem: 96044 kB Slab: 168448 kB SReclaimable: 125172 kB SUnreclaim: 43276 kB KernelStack: 23296 kB PageTables: 13788 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 4084088 kB Committed_AS: 4193252 kB VmallocTotal: 34359738367 kB VmallocUsed: 17732 kB VmallocChunk: 3435971