Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DaaLoadTest_daa1_special_5m crash vmState=0x00000000 Compiled_method=java/util/Formatter.format #18079

Open
pshipton opened this issue Sep 5, 2023 · 8 comments
Open

DaaLoadTest_daa1_special_5m crash vmState=0x00000000 Compiled_method=java/util/Formatter.format #18079

pshipton opened this issue Sep 5, 2023 · 8 comments
Labels
comp:jit segfault Issues that describe segfaults / JVM crashes test failure
Milestone
Release 0.51 (Jav...

Comments

@pshipton
Copy link
Member

pshipton commented Sep 5, 2023

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_special.system_ppc64le_linux_Release_testList_3/65
DaaLoadTest_daa1_special_5m_8 -Xgcpolicy:gencon -Xshareclasses -Xjit -Xnocompressedrefs

DLT 06:56:26.953 - Completed 20.0%. Number of tests started=885 (+289)
DLT stderr Unhandled exception
DLT stderr Type=Segmentation error vmState=0x00000000
DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
DLT stderr Handler1=00007FFFB69949F0 Handler2=00007FFFB68BD440
DLT stderr R0=0000000000000006 R1=00007FFF1E77B6F0 R2=0000000000000000 R3=00007FFFA81F5F40
DLT stderr R4=00007FFF3914F4F0 R5=0000000000000000 R6=0000000000000041 R7=FFFFFFFFFFFFFFFF
DLT stderr R8=0000000000000041 R9=0000000000756013 R10=0000000000000007 R11=0000000000000000
DLT stderr R12=00007FFF39BCF8E0 R13=00007FFF1E7868E0 R14=00007FFEB4007350 R15=00007FFFB0800000
DLT stderr R16=00007FFF1D040038 R17=FFFFFFFFFFFFFFFF R18=00007FFF3914FA48 R19=00007FFFA81F5FB0
DLT stderr R20=0000000000000000 R21=0000000000000000 R22=00007FFF3944AE20 R23=00000000002E3D1F
DLT stderr R24=00007FFFA81F5FD0 R25=00007FFF39BCF8C8 R26=000000000000003F R27=00007FFF3944AE40
DLT stderr R28=0000000000000007 R29=0000000000000000 R30=0000000000000007 R31=0000000000000000
DLT stderr NIP=00007FFF1F248F30 MSR=800000000280F033 ORIG_GPR3=00007FFF1F245734 CTR=00007FFF1EE65180
DLT stderr LINK=00007FFF1F248EE4 XER=0000000000000000 CCR=0000000082004824 SOFTE=0000000000000001
DLT stderr TRAP=0000000000000300 DAR=0000000000000008 dsisr=0000000040000000 RESULT=0000000000000000
DLT stderr FPR0 fffffe8b18f9aaf0 (f: 419015424.000000, d: -nan)
DLT stderr FPR1 c2774e7065510000 (f: 1699807232.000000, d: -1.601604e+12)
DLT stderr FPR2 c1d7dda232800000 (f: 847249408.000000, d: -1.601604e+09)
DLT stderr FPR3 3fc5d527743d6f55 (f: 1950183296.000000, d: 1.705674e-01)
DLT stderr FPR4 4000000000000000 (f: 0.000000, d: 2.000000e+00)
DLT stderr FPR5 3f7510e1255f0394 (f: 626983808.000000, d: 5.143051e-03)
DLT stderr FPR6 3fc5528670f6093a (f: 1895172352.000000, d: 1.665810e-01)
DLT stderr FPR7 3f9f9d7b16b58740 (f: 380995392.000000, d: 3.087418e-02)
DLT stderr FPR8 bf167722fa601c5f (f: 4200602624.000000, d: -8.569861e-05)
DLT stderr FPR9 3fc555555555553e (f: 1431655680.000000, d: 1.666667e-01)
DLT stderr FPR10 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
DLT stderr FPR11 bf66bd24acae58da (f: 2897107200.000000, d: -2.775737e-03)
DLT stderr FPR12 3ec11da84192e48b (f: 1100145792.000000, d: 2.040368e-06)
DLT stderr FPR13 416312d000000000 (f: 0.000000, d: 1.000000e+07)
DLT stderr FPR14 3f1152fe6142af77 (f: 1631760256.000000, d: 6.608656e-05)
DLT stderr FPR15 be6b626f1975a68f (f: 427140736.000000, d: -5.100762e-08)
DLT stderr FPR16 3f11566aaf25de2c (f: 2938494464.000000, d: 6.613756e-05)
DLT stderr FPR17 bebbb7c504f41aab (f: 83106472.000000, d: -1.652113e-06)
DLT stderr FPR18 3e15f303794517e0 (f: 2034571264.000000, d: 1.277616e-09)
DLT stderr FPR19 bebbbd41c5d26bf1 (f: 3318901760.000000, d: -1.653390e-06)
DLT stderr FPR20 3e66376972bea4d0 (f: 1925096704.000000, d: 4.138137e-08)
DLT stderr FPR21 3e48c28772093484 (f: 1913205888.000000, d: 1.152972e-08)
DLT stderr FPR22 3e48c28772000000 (f: 1912602624.000000, d: 1.152972e-08)
DLT stderr FPR23 3fc67dae64a5e000 (f: 1688592384.000000, d: 1.757105e-01)
DLT stderr FPR24 3e49cbf6cf239a70 (f: 3475216896.000000, d: 1.201254e-08)
DLT stderr FPR25 3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
DLT stderr FPR26 bfc8968000000000 (f: 0.000000, d: -1.920929e-01)
DLT stderr FPR27 bf90c68c14bcc46f (f: 347915360.000000, d: -1.638240e-02)
DLT stderr FPR28 3fc67dae7d686772 (f: 2103994240.000000, d: 1.757105e-01)
DLT stderr FPR29 bf90c68c14bcc46f (f: 347915360.000000, d: -1.638240e-02)
DLT stderr FPR30 3c35a5290aa07607 (f: 178288128.000000, d: 1.173386e-18)
DLT stderr FPR31 0000000000989680 (f: 10000000.000000, d: 4.940656e-317)
DLT stderr 
DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
DLT stderr Target=2_90_20230902_88 (Linux 4.18.0-486.el8.ppc64le)
DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dbc00000 RAM)
DLT stderr ----------- Stack Backtrace -----------
DLT stderr  (0x00007FFF1F248F30 [<unknown>+0x0])
DLT stderr runJavaThread+0x340 (0x00007FFFB69695B0 [libj9vm29.so+0x195b0])
DLT stderr javaProtectedThreadProc+0xf0 (0x00007FFFB6A06690 [libj9vm29.so+0xb6690])
DLT stderr omrsig_protect+0x358 (0x00007FFFB68BE848 [libj9prt29.so+0x3e848])
DLT stderr javaThreadProc+0x64 (0x00007FFFB6A018A4 [libj9vm29.so+0xb18a4])
DLT stderr thread_wrapper+0x1a8 (0x00007FFFB68513E8 [libj9thr29.so+0x113e8])
DLT stderr start_thread+0xf8 (0x00007FFFB7339678 [libpthread-2.28.so+0x9678])
DLT stderr clone+0x74 (0x00007FFFB71E8738 [libc-2.28.so+0x138738])
DLT stderr ---------------------------------------
@JasonFengJ9
Copy link
Member

JasonFengJ9 commented Nov 18, 2023 •
edited
Loading

JDK11 ppc64le_linux(cent8le-svl-rt1-1)

java version "11.0.21" 2023-10-17
IBM Semeru Runtime Certified Edition 11.0.21.0-rc2 (build 11.0.21+9)
Eclipse OpenJ9 VM 11.0.21.0-rc2 (build v0.41.0-release-a803f004b, JRE 11 Linux ppc64le-64-Bit Compressed References 20231116_717 (JIT enabled, AOT enabled)
OpenJ9   - a803f004b
OMR      - 5eee6ad9d
JCL      - 6f4cc08025 based on jdk-11.0.21+9)

[2023-11-16T23:25:39.138Z] variation: Mode687
[2023-11-16T23:25:39.138Z] JVM_OPTIONS:  -XX:+UseCompressedOops -Xjit -Xgcpolicy:gencon -Xaggressive 

[2023-11-16T23:30:28.068Z] DLT 15:30:25.459 - Completed 93.4%. Number of tests started=4561 (+392)
[2023-11-16T23:30:35.160Z] DLT stderr Unhandled exception
[2023-11-16T23:30:35.160Z] DLT stderr Type=Segmentation error vmState=0x00000000
[2023-11-16T23:30:35.160Z] DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2023-11-16T23:30:35.160Z] DLT stderr Handler1=00007FFF9CCB6120 Handler2=00007FFF9CBDD480
[2023-11-16T23:30:35.160Z] DLT stderr R0=0000000000000004 R1=00007FFF7830B6F0 R2=000000000065B9AA R3=00000000FF20E300
[2023-11-16T23:30:35.160Z] DLT stderr R4=FFFFFFFFFFFFFFFF R5=0000000088FAAD38 R6=00000000FF20E2F0 R7=FFFFFFFFFFFFFFFF
[2023-11-16T23:30:35.160Z] DLT stderr R8=0000000000000000 R9=0000000000000000 R10=00000000020E0001 R11=0000000088D266C0
[2023-11-16T23:30:35.160Z] DLT stderr R12=00007FFF7BF72100 R13=00007FFF783168E0 R14=000000000057BAD0 R15=0000000000571200
[2023-11-16T23:30:35.160Z] DLT stderr R16=00007FFF797E0038 R17=0000000000000006 R18=0000000088D1D010 R19=00000000FF20E348
[2023-11-16T23:30:35.160Z] DLT stderr R20=0000000000000004 R21=0000000000000002 R22=0000000088E89660 R23=0000000000000002
[2023-11-16T23:30:35.160Z] DLT stderr R24=0000000088D266C0 R25=0000000088FAAD38 R26=0000000000000003 R27=00000000FF20E360
[2023-11-16T23:30:35.160Z] DLT stderr R28=0000000088FAAD48 R29=0000000000000000 R30=0000000000000003 R31=0000000000000002
[2023-11-16T23:30:35.160Z] DLT stderr NIP=00007FFF7C538168 MSR=800000000280F033 ORIG_GPR3=00007FFF97CACBC4 CTR=00007FFF7BF72100
[2023-11-16T23:30:35.160Z] DLT stderr LINK=00007FFF7C538120 XER=0000000000000000 CCR=0000000082004484 SOFTE=0000000000000001
[2023-11-16T23:30:35.160Z] DLT stderr TRAP=0000000000000300 DAR=0000000000000004 dsisr=0000000040000000 RESULT=0000000000000000
[2023-11-16T23:30:35.160Z] DLT stderr FPR0 3fe8000000000000 (f: 0.000000, d: 7.500000e-01)
[2023-11-16T23:30:35.160Z] DLT stderr FPR1 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR2 3f85d669c0000000 (f: 3221225472.000000, d: 1.066287e-02)
[2023-11-16T23:30:35.160Z] DLT stderr FPR3 3fee666660000000 (f: 1610612736.000000, d: 9.500000e-01)
[2023-11-16T23:30:35.160Z] DLT stderr FPR4 40120216a0000000 (f: 2684354560.000000, d: 4.502039e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR6 3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
[2023-11-16T23:30:35.160Z] DLT stderr FPR7 3fc526e57720db08 (f: 1998641920.000000, d: 1.652495e-01)
[2023-11-16T23:30:35.160Z] DLT stderr FPR8 ff20ab28ff20ac20 (f: 4280331264.000000, d: -2.286149e+304)
[2023-11-16T23:30:35.160Z] DLT stderr FPR9 ff20ad80ff20aee8 (f: 4280332032.000000, d: -2.287405e+304)
[2023-11-16T23:30:35.160Z] DLT stderr FPR10 c7e4150d00000000 (f: 0.000000, d: -2.135509e+38)
[2023-11-16T23:30:35.160Z] DLT stderr FPR11 ff20ae38ff20ab80 (f: 4280331264.000000, d: -2.287790e+304)
[2023-11-16T23:30:35.160Z] DLT stderr FPR12 40c8f30000000000 (f: 0.000000, d: 1.277400e+04)
[2023-11-16T23:30:35.160Z] DLT stderr FPR13 3fee8913bf922631 (f: 3214026240.000000, d: 9.542330e-01)
[2023-11-16T23:30:35.160Z] DLT stderr FPR14 0000000000000001 (f: 1.000000, d: 4.940656e-324)
[2023-11-16T23:30:35.160Z] DLT stderr FPR15 4072d07adcbbbd22 (f: 3703291136.000000, d: 3.010300e+02)
[2023-11-16T23:30:35.160Z] DLT stderr FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.160Z] DLT stderr 
[2023-11-16T23:30:35.160Z] DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
[2023-11-16T23:30:35.160Z] DLT stderr Target=2_90_20231116_717 (Linux 4.18.0-511.el8.ppc64le)
[2023-11-16T23:30:35.160Z] DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc60000 RAM)
[2023-11-16T23:30:35.160Z] DLT stderr ----------- Stack Backtrace -----------
[2023-11-16T23:30:35.160Z] DLT stderr  (0x00007FFF7C538168 [<unknown>+0x0])
[2023-11-16T23:30:35.160Z] DLT stderr runJavaThread+0x340 (0x00007FFF9CC8A850 [libj9vm29.so+0x1a850])
[2023-11-16T23:30:35.160Z] DLT stderr javaProtectedThreadProc+0xf0 (0x00007FFF9CD27930 [libj9vm29.so+0xb7930])
[2023-11-16T23:30:35.160Z] DLT stderr omrsig_protect+0x358 (0x00007FFF9CBDE888 [libj9prt29.so+0x3e888])
[2023-11-16T23:30:35.160Z] DLT stderr javaThreadProc+0x64 (0x00007FFF9CD22B04 [libj9vm29.so+0xb2b04])
[2023-11-16T23:30:35.160Z] DLT stderr thread_wrapper+0x1a8 (0x00007FFF9CB713E8 [libj9thr29.so+0x113e8])
[2023-11-16T23:30:35.160Z] DLT stderr start_thread+0xf8 (0x00007FFF9D6C9718 [libpthread.so.0+0x9718])
[2023-11-16T23:30:35.160Z] DLT stderr clone+0x74 (0x00007FFF9D56B578 [libc.so.6+0x13b578])
[2023-11-16T23:30:35.160Z] DLT stderr ---------------------------------------
[2023-11-16T23:30:35.160Z] DLT stderr JVMDUMP039I Processing dump event "gpf", detail "" at 2023/11/16 15:30:33 - please wait.
[2023-11-16T23:30:35.160Z] DLT stderr JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_4/aqa-tests/TKG/output_17001685147693/DaaLoadTest_all_special_5m_22/20231116-152539-DaaLoadTest/results/core.20231116.153033.2052624.0001.dmp' in response to an event
[2023-11-16T23:30:35.161Z] DLT stderr JVMDUMP010I System dump written to /home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_4/aqa-tests/TKG/output_17001685147693/DaaLoadTest_all_special_5m_22/20231116-152539-DaaLoadTest/results/core.20231116.153033.2052624.0001.dmp
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200: Object neither in heap nor stack-allocated in thread load-1
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	O-Slot=00007FFF7830B850
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	O-Slot value=0000000000000010
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	PC=00007FFF7C538168
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	framesWalked=1
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	arg0EA=000000000057C0E8
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	walkSP=000000000057BAA8
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	literals=0000000000000000
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	jitInfo=00007FFF78AC7D38
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	method=0000000000498CB8 (java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;) (JIT)
[2023-11-16T23:30:35.161Z] DLT stderr 0000000000571200:	stack=0000000000577690-000000000057CEC0
[2023-11-16T23:30:35.161Z] DLT stderr Unhandled exception
[2023-11-16T23:30:35.161Z] DLT stderr Type=Segmentation error vmState=0x0002000f
[2023-11-16T23:30:35.161Z] DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2023-11-16T23:30:35.161Z] DLT stderr Handler1=00007FFF9CCB6120 Handler2=00007FFF9CBDD480
[2023-11-16T23:30:35.161Z] DLT stderr R0=00007FFF9C1BE2CC R1=00007FFF784A9F90 R2=00007FFF9C4A5400 R3=00007FFF784AA8C0
[2023-11-16T23:30:35.161Z] DLT stderr R4=000000000057C070 R5=00007FFF784AA368 R6=00007FFF7830B838 R7=00007FFF7830B838
[2023-11-16T23:30:35.161Z] DLT stderr R8=0000000099669966 R9=0000000000577690 R10=0000000000000000 R11=0000000000000000
[2023-11-16T23:30:35.161Z] DLT stderr R12=00007FFF9C3715C0 R13=00007FFF784B68E0 R14=0000000000575990 R15=000000000041F900
[2023-11-16T23:30:35.161Z] DLT stderr R16=00007FFF797E0038 R17=0000000000000000 R18=0000000000575F88 R19=000000000000000A
[2023-11-16T23:30:35.161Z] DLT stderr R20=000000000000000A R21=00000000FFFEFF98 R22=0000000000000001 R23=0000000000020019
[2023-11-16T23:30:35.161Z] DLT stderr R24=00007FFF9C491188 R25=00007FFF9C465080 R26=000000000057C0D0 R27=0000000000000000
[2023-11-16T23:30:35.161Z] DLT stderr R28=00007FFF784AA000 R29=00007FFF9C4A2308 R30=0000000000000000 R31=00007FFF984A4688
[2023-11-16T23:30:35.161Z] DLT stderr NIP=00007FFF9C3716B8 MSR=800000000280F033 ORIG_GPR3=00007FFF9C36BB10 CTR=00007FFF9C3715C0
[2023-11-16T23:30:35.161Z] DLT stderr LINK=00007FFF9C1BE2CC XER=0000000000000000 CCR=0000000028004484 SOFTE=0000000000000001
[2023-11-16T23:30:35.161Z] DLT stderr TRAP=0000000000000300 DAR=0000000000000000 dsisr=0000000040000000 RESULT=0000000000000000
[2023-11-16T23:30:35.161Z] DLT stderr FPR0 ffffffffffffffff (f: 4294967296.000000, d: -nan)
[2023-11-16T23:30:35.161Z] DLT stderr FPR1 4056588dc0000000 (f: 3221225472.000000, d: 8.938365e+01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR2 408f400000000000 (f: 0.000000, d: 1.000000e+03)
[2023-11-16T23:30:35.161Z] DLT stderr FPR3 3fc7466496cb03de (f: 2529887232.000000, d: 1.818357e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR4 3fcc71c51d8e78af (f: 495876256.000000, d: 2.222220e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR5 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR6 3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR7 bfd57bf7808caade (f: 2156702464.000000, d: -3.356913e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR8 bfdffffef20a4123 (f: 4060758272.000000, d: -4.999997e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR9 bfd00ea348b88334 (f: 1220051712.000000, d: -2.508934e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR10 bfe008eb4e32d47a (f: 1311954048.000000, d: -5.010888e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR11 3ee65e1bc79070a2 (f: 3348132096.000000, d: 1.066571e-05)
[2023-11-16T23:30:35.161Z] DLT stderr FPR12 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR13 401cef5faed65272 (f: 2933281280.000000, d: 7.233763e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR14 3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
[2023-11-16T23:30:35.161Z] DLT stderr FPR15 4072d07adcbbbd22 (f: 3703291136.000000, d: 3.010300e+02)
[2023-11-16T23:30:35.161Z] DLT stderr FPR16 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR17 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR18 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR19 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR20 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR21 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR22 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR23 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR24 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR25 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR26 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR27 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR28 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR29 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR30 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr FPR31 0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2023-11-16T23:30:35.161Z] DLT stderr Module=/home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_4/openjdkbinary/j2sdk-image/lib/default/libj9gc29.so
[2023-11-16T23:30:35.161Z] DLT stderr Module_base_address=00007FFF9C170000
[2023-11-16T23:30:35.161Z] DLT stderr Target=2_90_20231116_717 (Linux 4.18.0-511.el8.ppc64le)
[2023-11-16T23:30:35.161Z] DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc60000 RAM)
[2023-11-16T23:30:35.161Z] DLT stderr ----------- Stack Backtrace -----------
[2023-11-16T23:30:35.161Z] STF 15:30:34.456 - Found dump at: /home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_4/aqa-tests/TKG/output_17001685147693/DaaLoadTest_all_special_5m_22/20231116-152539-DaaLoadTest/results/core.20231116.153033.2052624.0001.dmp
[2023-11-16T23:30:35.161Z] DLT stderr core file generated - /home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_4/aqa-tests/TKG/output_17001685147693/DaaLoadTest_all_special_5m_22/20231116-152539-DaaLoadTest/results/core.20231116.153033.2052624.0001.dmp
[2023-11-16T23:30:35.161Z] DLT stderr _ZN23MM_ScavengerRootScanner11doStackSlotEPP8J9ObjectPvPKv+0xf8 (0x00007FFF9C3716B8 [libj9gc29.so+0x2016b8])
[2023-11-16T23:30:35.161Z] DLT stderr _Z17stackSlotIteratorP8J9JavaVMPP8J9ObjectPvP16J9StackWalkStatePKv+0xec (0x00007FFF9C1BE2CC [libj9gc29.so+0x4e2cc])
[2023-11-16T23:30:35.162Z] DLT stderr vmThreadStackDoOSlotIterator+0x3c (0x00007FFF9C1C9EDC [libj9gc29.so+0x59edc])
[2023-11-16T23:30:35.162Z] DLT stderr jitWalkFrame+0x1c8 (0x00007FFF97CAB918 [libj9jit29.so+0xc3b918])
[2023-11-16T23:30:35.162Z] DLT stderr jitWalkStackFrames+0x1000 (0x00007FFF97CAD1A0 [libj9jit29.so+0xc3d1a0])
[2023-11-16T23:30:35.162Z] DLT stderr walkStackFrames+0xfc (0x00007FFF9CD0E9AC [libj9vm29.so+0x9e9ac])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN28GC_VMThreadStackSlotIterator9scanSlotsEP10J9VMThreadS1_PvPFvP8J9JavaVMPP8J9ObjectS2_P16J9StackWalkStatePKvEbb+0x5c (0x00007FFF9C1CA06C [libj9gc29.so+0x5a06c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN14MM_RootScanner13scanOneThreadEP18MM_EnvironmentBaseP10J9VMThreadPv+0x148 (0x00007FFF9C1BDAB8 [libj9gc29.so+0x4dab8])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN14MM_RootScanner11scanThreadsEP18MM_EnvironmentBase+0x10c (0x00007FFF9C1BBF6C [libj9gc29.so+0x4bf6c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN14MM_RootScanner9scanRootsEP18MM_EnvironmentBase+0xa0 (0x00007FFF9C1C0330 [libj9gc29.so+0x50330])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN12MM_Scavenger24workThreadGarbageCollectEP22MM_EnvironmentStandard+0x320 (0x00007FFF9C369E20 [libj9gc29.so+0x1f9e20])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN23MM_ParallelScavengeTask3runEP18MM_EnvironmentBase+0x1c (0x00007FFF9C3E561C [libj9gc29.so+0x27561c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN21MM_ParallelDispatcher3runEP18MM_EnvironmentBaseP7MM_Taskm+0xd8 (0x00007FFF9C2FF138 [libj9gc29.so+0x18f138])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN12MM_Scavenger8scavengeEP18MM_EnvironmentBase+0xcc (0x00007FFF9C34F57C [libj9gc29.so+0x1df57c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN12MM_Scavenger24mainThreadGarbageCollectEP18MM_EnvironmentBaseP22MM_AllocateDescriptionbb+0x2d4 (0x00007FFF9C360EB4 [libj9gc29.so+0x1f0eb4])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN12MM_Scavenger22internalGarbageCollectEP18MM_EnvironmentBaseP17MM_MemorySubSpaceP22MM_AllocateDescription+0xbcc (0x00007FFF9C36224C [libj9gc29.so+0x1f224c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN12MM_Collector14garbageCollectEP18MM_EnvironmentBaseP17MM_MemorySubSpaceP22MM_AllocateDescriptionjP28MM_ObjectAllocationInterfaceS3_P20MM_AllocationContext+0x13c (0x00007FFF9C2CB5FC [libj9gc29.so+0x15b5fc])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN26MM_MemorySubSpaceSemiSpace23allocationRequestFailedEP18MM_EnvironmentBaseP22MM_AllocateDescriptionN17MM_MemorySubSpace14AllocationTypeEP28MM_ObjectAllocationInterfacePS4_S8_+0x42c (0x00007FFF9C3DFE4C [libj9gc29.so+0x26fe4c])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN24MM_MemorySubSpaceGeneric11allocateTLHEP18MM_EnvironmentBaseP22MM_AllocateDescriptionP28MM_ObjectAllocationInterfaceP17MM_MemorySubSpaceS7_b+0x444 (0x00007FFF9C3BC864 [libj9gc29.so+0x24c864])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN23MM_TLHAllocationSupport7refreshEP18MM_EnvironmentBaseP22MM_AllocateDescriptionb+0x590 (0x00007FFF9C30A070 [libj9gc29.so+0x19a070])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN23MM_TLHAllocationSupport15allocateFromTLHEP18MM_EnvironmentBaseP22MM_AllocateDescriptionb+0x124 (0x00007FFF9C30A2E4 [libj9gc29.so+0x19a2e4])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN25MM_TLHAllocationInterface15allocateFromTLHEP18MM_EnvironmentBaseP22MM_AllocateDescriptionb+0x28 (0x00007FFF9C308278 [libj9gc29.so+0x198278])
[2023-11-16T23:30:35.162Z] DLT stderr _ZN25MM_TLHAllocationInterface14allocateObjectEP18MM_EnvironmentBaseP22MM_AllocateDescriptionP14MM_MemorySpaceb+0x1e8 (0x00007FFF9C3084A8 [libj9gc29.so+0x1984a8])
[2023-11-16T23:30:35.162Z] DLT stderr _Z21OMR_GC_AllocateObjectP12OMR_VMThreadP25MM_AllocateInitialization+0x100 (0x00007FFF9C3113C0 [libj9gc29.so+0x1a13c0])
[2023-11-16T23:30:35.162Z] DLT stderr J9AllocateObject+0x47c (0x00007FFF9C1D21FC [libj9gc29.so+0x621fc])
[2023-11-16T23:30:35.162Z] DLT stderr old_slow_jitNewObject+0x384 (0x00007FFF97C91B24 [libj9jit29.so+0xc21b24])
[2023-11-16T23:30:35.162Z] DLT stderr  (0x00007FFF97CB0418 [libj9jit29.so+0xc40418])
[2023-11-16T23:30:35.162Z] DLT stderr runJavaThread+0x340 (0x00007FFF9CC8A850 [libj9vm29.so+0x1a850])
[2023-11-16T23:30:35.162Z] DLT stderr javaProtectedThreadProc+0xf0 (0x00007FFF9CD27930 [libj9vm29.so+0xb7930])
[2023-11-16T23:30:35.162Z] DLT stderr omrsig_protect+0x358 (0x00007FFF9CBDE888 [libj9prt29.so+0x3e888])
[2023-11-16T23:30:35.162Z] DLT stderr javaThreadProc+0x64 (0x00007FFF9CD22B04 [libj9vm29.so+0xb2b04])
[2023-11-16T23:30:35.162Z] DLT stderr thread_wrapper+0x1a8 (0x00007FFF9CB713E8 [libj9thr29.so+0x113e8])
[2023-11-16T23:30:35.162Z] DLT stderr start_thread+0xf8 (0x00007FFF9D6C9718 [libpthread.so.0+0x9718])
[2023-11-16T23:30:35.162Z] DLT stderr clone+0x74 (0x00007FFF9D56B578 [libc.so.6+0x13b578])
[2023-11-16T23:30:35.162Z] DLT stderr ---------------------------------------
[2023-11-16T23:30:35.162Z] DLT stderr JVMDUMP039I Processing dump event "gpf", detail "" at 2023/11/16 15:30:34 - please wait.

[2023-11-17T00:02:46.226Z] DaaLoadTest_all_special_5m_22_FAILED

50x internal grinder - 1/50 failed at cent8le-svl-rt2-1

@cjjdespres
Copy link
Contributor

Seen in the JITServer nightly tests recently. These ran with `-Xnocompressedrefs, so they wouldn't have been using the running JITServer.

# Eclipse OpenJ9 VM (build master-0027b819341, JRE 11 Linux ppc64le-64-Bit Compressed References 20240930_1877 (JIT enabled, AOT enabled)
# OpenJ9   - 0027b819341
# OMR      - c7b33483737
# JCL      - d4e75ea749b based on jdk-11.0.25+7)

        DaaLoadTest_daa1_special_5m_8 Start Time: Mon Sep 30 01:01:45 2024 Epoch Time (ms): 1727683305714
        variation: Mode145
        JVM_OPTIONS: -XX:+UseJITServer -Xgcpolicy:gencon -Xshareclasses -Xjit -Xnocompressedrefs 

        DLT stderr Unhandled exception
        DLT stderr Type=Segmentation error vmState=0x00000000
        DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
        DLT stderr Handler1=00007FFF7E270960 Handler2=00007FFF7E198840
        DLT stderr R0=0000000000000041 R1=00007FFEE5BEB6F0 R2=0000000000000000 R3=FFFFFFFFFFFFFFFF
        DLT stderr R4=FFFFFFFFFFFFFFFF R5=0000000000000041 R6=000000000065B9AA R7=0000000000000000
        DLT stderr R8=00007FFF00D3E1C8 R9=0000000000000000 R10=0000000000000041 R11=00007FFF00D3FC38
        DLT stderr R12=00007FFF012395F8 R13=00007FFEE5BF68E0 R14=00007FFE780075E0 R15=00007FFF78811400
        DLT stderr R16=00007FFEE4F80038 R17=000000000005C0A8 R18=00007FFF73D5BFA8 R19=0000000000000000
        DLT stderr R20=00007FFF00D40210 R21=00000000002FAF08 R22=00007FFF00F9EEF8 R23=0000000000000000
        DLT stderr R24=00007FFF73D5BFC8 R25=00007FFF012395E0 R26=000000000000003F R27=0000000000000007
        DLT stderr R28=00007FFF012395E0 R29=0000000000000041 R30=0000000000000007 R31=0000000000000000
        DLT stderr NIP=00007FFEE6364040 MSR=800000000280F033 ORIG_GPR3=00007FFEE630DBC8 CTR=00007FFEE6487A80
        DLT stderr LINK=00007FFEE6363D3C XER=0000000000000000 CCR=0000000088884824 SOFTE=0000000000000001
        DLT stderr TRAP=0000000000000300 DAR=0000000000000008 dsisr=0000000040000000 RESULT=0000000000000000
        DLT stderr FPR0=0000000000002710 (f: 10000.000000, d: 4.940656e-320)
        DLT stderr FPR1=c312cae0494c1600 (f: 1229723136.000000, d: -1.322404e+15)
        DLT stderr FPR2=bf95c966ebf3f9b1 (f: 3958635008.000000, d: -2.127610e-02)
        DLT stderr FPR3=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
        DLT stderr FPR4=bfcc400000000000 (f: 0.000000, d: -2.207031e-01)
        DLT stderr FPR5=400a934f0979a371 (f: 158966640.000000, d: 3.321928e+00)
        DLT stderr FPR6=3f050b3d5af80000 (f: 1526202368.000000, d: 4.013806e-05)
        DLT stderr FPR7=3f80ecf4c2a50800 (f: 3265595392.000000, d: 8.264458e-03)
        DLT stderr FPR8=3ff4000000000000 (f: 0.000000, d: 1.250000e+00)
        DLT stderr FPR9=3ff8000000000000 (f: 0.000000, d: 1.500000e+00)
        DLT stderr FPR10=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
        DLT stderr FPR11=3e92f346e2bf9206 (f: 3804205568.000000, d: 2.823815e-07)
        DLT stderr FPR12=3fd269e000000000 (f: 0.000000, d: 2.877121e-01)
        DLT stderr FPR13=40c3880000000000 (f: 0.000000, d: 1.000000e+04)
        DLT stderr FPR14=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
        DLT stderr FPR15=4072d07adcbbbd22 (f: 3703291136.000000, d: 3.010300e+02)
        DLT stderr FPR16=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR17=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR18=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR19=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR20=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR21=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR22=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR23=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR24=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR26=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR27=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR28=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR29=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR30=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR31=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr 
        DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
        DLT stderr Target=2_90_20240930_1877 (Linux 4.18.0-553.22.1.el8_10.ppc64le)
        DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc50000 RAM)
        DLT stderr ----------- Stack Backtrace -----------
        DLT stderr Unhandled exception
        DLT stderr Type=Segmentation error vmState=0x00000000
        DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
        DLT stderr Handler1=00007FFF7E270960 Handler2=00007FFF7E198840
        DLT stderr R0=0000000000000004 R1=00007FFEAD0DB6F0 R2=0000000000000000 R3=FFFFFFFFFFFFFFFF
        DLT stderr R4=FFFFFFFFFFFFFFFF R5=0000000000000006 R6=000000000065B9AA R7=0000000000000002
        DLT stderr R8=00007FFF00D3E1C8 R9=0000000000000000 R10=0000000000000006 R11=00007FFF00D3FC38
        DLT stderr R12=00007FFF00EF57F8 R13=00007FFEAD0E68E0 R14=00007FFE8C00A810 R15=00007FFF783DB600
        DLT stderr R16=00007FFEE4F80038 R17=0000000000000000 R18=00007FFF73E2EE78 R19=0000000000000002
        DLT stderr R20=00007FFF00D40210 R21=00000000002FAF08 R22=00007FFF00F9EEF8 R23=0000000000000000
        DLT stderr R24=00007FFF73E2EE98 R25=00007FFF00EF57E0 R26=0000000000000004 R27=0000000000000003
        DLT stderr R28=00007FFF00EF57E0 R29=0000000000000006 R30=0000000000000003 R31=0000000000000002
        DLT stderr NIP=00007FFEE6364040 MSR=800000000280F033 ORIG_GPR3=00007FFF7E30DBB4 CTR=00007FFEE6487A80
        DLT stderr LINK=00007FFEE6363D3C XER=0000000000000000 CCR=0000000088884424 SOFTE=0000000000000001
        DLT stderr TRAP=0000000000000300 DAR=0000000000000008 dsisr=0000000040000000 RESULT=0000000000000000
        DLT stderr FPR0=00007fff787e6368 (f: 2021548928.000000, d: 6.953243e-310)
        DLT stderr FPR1=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR2=bfa1290447333346 (f: 1194537856.000000, d: -3.351606e-02)
        DLT stderr FPR3=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
        DLT stderr FPR4=3fce580000000000 (f: 0.000000, d: 2.370605e-01)
        DLT stderr FPR5=400a934f0979a371 (f: 158966640.000000, d: 3.321928e+00)
        DLT stderr FPR6=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
        DLT stderr FPR7=3fd4043057b6ee09 (f: 1471606272.000000, d: 3.127557e-01)
        DLT stderr FPR8=00007fff73e25a90 (f: 1944214144.000000, d: 6.953240e-310)
        DLT stderr FPR9=00007fff73e27f80 (f: 1944223616.000000, d: 6.953240e-310)
        DLT stderr FPR10=00007fff73e28e30 (f: 1944227328.000000, d: 6.953240e-310)
        DLT stderr FPR11=00007fff73e28f50 (f: 1944227712.000000, d: 6.953240e-310)
        DLT stderr FPR12=00007ffe8c00b749 (f: 2348857088.000000, d: 6.953047e-310)
        DLT stderr FPR13=3feeba05531b0d9b (f: 1394281856.000000, d: 9.602076e-01)
        DLT stderr FPR14=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
        DLT stderr FPR15=4072d07adcbbbd22 (f: 3703291136.000000, d: 3.010300e+02)
        DLT stderr FPR16=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR17=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR18=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR19=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR20=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR21=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR22=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR23=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR24=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR26=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR27=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR28=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR29=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR30=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr FPR31=0000000000000000 (f: 0.000000, d: 0.000000e+00)
        DLT stderr 
        DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
        DLT stderr Target=2_90_20240930_1877 (Linux 4.18.0-553.22.1.el8_10.ppc64le)
        DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc50000 RAM)
        DLT stderr ----------- Stack Backtrace -----------
        DLT stderr  (0x00007FFEE6364040 [<unknown>+0x0])
        DLT stderr runJavaThread+0x240 (0x00007FFF7E246C70 [libj9vm29.so+0x16c70])
        DLT stderr javaProtectedThreadProc+0x148 (0x00007FFF7E2DF858 [libj9vm29.so+0xaf858])
        DLT stderr omrsig_protect+0x3e4 (0x00007FFF7E199CF4 [libj9prt29.so+0x39cf4])
        DLT stderr javaThreadProc+0x60 (0x00007FFF7E2DAEC0 [libj9vm29.so+0xaaec0])
        DLT stderr thread_wrapper+0x190 (0x00007FFF7E12CBC0 [libj9thr29.so+0xcbc0])
        DLT stderr start_thread+0xf8 (0x00007FFF7ECC9718 [libpthread.so.0+0x9718])
        DLT stderr clone+0x74 (0x00007FFF7EB6B798 [libc.so.6+0x13b798])

# Eclipse OpenJ9 VM (build master-0027b819341, JRE 11 Linux s390x-64-Bit Compressed References 20240930_1569 (JIT enabled, AOT enabled)
# OpenJ9   - 0027b819341
# OMR      - c7b33483737
# JCL      - d4e75ea749b based on jdk-11.0.25+7)

        DaaLoadTest_daa1_special_5m_9 Start Time: Mon Sep 30 08:27:48 2024 Epoch Time (ms): 1727684868647
        variation: Mode187
        JVM_OPTIONS: -XX:+UseJITServer -Xaggressive -Xgcpolicy:gencon -Xjit -Xnocompressedrefs 

        DLT java.lang.NullPointerException
        DLT 	at java.base/java.util.regex.Pattern.matcher(Pattern.java:1132)
        DLT 	at java.base/java.util.Formatter.parse(Formatter.java:2700)
        DLT 	at java.base/java.util.Formatter.format(Formatter.java:2655)
        DLT 	at java.base/java.util.Formatter.format(Formatter.java:2609)
        DLT 	at java.base/java.lang.String.format(String.java:3758)
        DLT 	at org.junit.runner.Description.formatDisplayName(Description.java:114)
        DLT 	at org.junit.runner.Description.createTestDescription(Description.java:86)
        DLT 	at org.junit.runners.BlockJUnit4ClassRunner.describeChild(BlockJUnit4ClassRunner.java:96)
        DLT 	at org.junit.runners.BlockJUnit4ClassRunner.describeChild(BlockJUnit4ClassRunner.java:57)
        DLT 	at org.junit.runners.ParentRunner.getDescription(ParentRunner.java:352)
        DLT 	at org.junit.runners.Suite.describeChild(Suite.java:123)
        DLT 	at org.junit.runners.Suite.describeChild(Suite.java:27)
        DLT 	at org.junit.runners.ParentRunner.getDescription(ParentRunner.java:352)
        DLT 	at org.junit.runner.JUnitCore.run(JUnitCore.java:136)
        DLT 	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
        DLT 	at net.adoptopenjdk.loadTest.adaptors.JUnitAdaptor.executeTest(JUnitAdaptor.java:130)
        DLT 	at net.adoptopenjdk.loadTest.LoadTestRunner$2.run(LoadTestRunner.java:182)
        DLT 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        DLT 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        DLT 	at java.base/java.lang.Thread.run(Thread.java:839)

@hzongaro
Copy link
Member

@cjjdespres, the NullPointerException thrown from Pattern.matcher looks like issue #20283

@JasonFengJ9
Copy link
Member

openjdk11_j9_special.system_ppc64le_linux(rhel8le-svl-rt6-1)

[2024-10-21T23:17:18.667Z] variation: Mode145
[2024-10-21T23:17:18.667Z] JVM_OPTIONS:  -Xgcpolicy:gencon -Xshareclasses -Xjit -Xnocompressedrefs 

[2024-10-21T23:19:28.461Z] DLT 16:19:26.461 - Completed 40.1%. Number of tests started=918 (+121)
[2024-10-21T23:19:40.775Z] DLT stderr Unhandled exception
[2024-10-21T23:19:40.775Z] DLT stderr Type=Segmentation error vmState=0x00000000
[2024-10-21T23:19:40.775Z] DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2024-10-21T23:19:40.775Z] DLT stderr Handler1=00007FFF980F0560 Handler2=00007FFF93F68860
[2024-10-21T23:19:40.775Z] DLT stderr Unhandled exception
[2024-10-21T23:19:40.775Z] DLT stderr Type=Segmentation error vmState=0x00000000
[2024-10-21T23:19:40.775Z] DLT stderr R0=0000000000000041 R1=00007FFEFC14B6F0 R2=0000000000000000 R3=00007FFF1AF98D80
[2024-10-21T23:19:40.775Z] DLT stderr R4=FFFFFFFFFFFFFFFF R5=FFFFFFFFFFFFFFFF R6=000000000065B9AA R7=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R8=00007FFF1AF97458 R9=0000000000000000 R10=0000000000000041 R11=00007FFF898547C8
[2024-10-21T23:19:40.775Z] DLT stderr R12=00007FFF1BA32758 R13=00007FFEFC1568E0 R14=00007FFE900072D0 R15=00007FFF94819C00
[2024-10-21T23:19:40.775Z] DLT stderr R16=00007FFEFE020038 R17=0000000000000041 R18=00007FFF898547A8 R19=00007FFF1AFA2390
[2024-10-21T23:19:40.775Z] DLT stderr R20=0000000000000000 R21=00007FFF1B2D9420 R22=00000000002FAF08 R23=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R24=00007FFF898547C8 R25=00007FFF1BA32740 R26=000000000000003F R27=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R28=0000000000000007 R29=00007FFF1BA32740 R30=0000000000000007 R31=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr J9Generic_Signal_Number=00000018 Signal_Number=0000000b Error_Value=00000000 Signal_Code=00000001
[2024-10-21T23:19:40.775Z] DLT stderr Handler1=00007FFF980F0560 Handler2=00007FFF93F68860
[2024-10-21T23:19:40.775Z] DLT stderr NIP=00007FFF003ECE6C MSR=800000000280F033 ORIG_GPR3=00007FFF003B4268 CTR=00007FFF001E4200
[2024-10-21T23:19:40.775Z] DLT stderr LINK=00007FFF003EC888 XER=0000000000000000 CCR=0000000084884844 SOFTE=0000000000000001
[2024-10-21T23:19:40.775Z] DLT stderr TRAP=0000000000000300 DAR=0000000000000008 dsisr=0000000040000000 RESULT=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R0=0000000000000038 R1=00007FFEFCE9B6F0 R2=0000000000000000 R3=00007FFF1AF98D80
[2024-10-21T23:19:40.775Z] DLT stderr R4=FFFFFFFFFFFFFFFF R5=FFFFFFFFFFFFFFFF R6=000000000065B9AA R7=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R8=00007FFF1AF97458 R9=0000000000000000 R10=0000000000000038 R11=00007FFF89840990
[2024-10-21T23:19:40.775Z] DLT stderr R12=00007FFF1BA0A758 R13=00007FFEFCEA68E0 R14=00007FFEA4028FE0 R15=00007FFF943DBA00
[2024-10-21T23:19:40.775Z] DLT stderr R16=00007FFEFE020038 R17=0000000000000038 R18=00007FFF89840970 R19=00007FFF1AFA2390
[2024-10-21T23:19:40.775Z] DLT stderr R20=0000000000000000 R21=00007FFF1B2D9420 R22=00000000002FAF08 R23=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R24=00007FFF89840990 R25=00007FFF1BA0A740 R26=0000000000000036 R27=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr R28=0000000000000007 R29=00007FFF1BA0A740 R30=0000000000000007 R31=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr NIP=00007FFF003ECE6C MSR=800000000280F033 ORIG_GPR3=00007FFF003E0014 CTR=00007FFF001E4200
[2024-10-21T23:19:40.775Z] DLT stderr LINK=00007FFF003EC888 XER=0000000000000000 CCR=0000000088884884 SOFTE=0000000000000001
[2024-10-21T23:19:40.775Z] DLT stderr TRAP=0000000000000300 DAR=0000000000000008 dsisr=0000000040000000 RESULT=0000000000000000
[2024-10-21T23:19:40.775Z] DLT stderr FPR0=0000000000989680 (f: 10000000.000000, d: 4.940656e-317)
[2024-10-21T23:19:40.775Z] DLT stderr FPR1=42781258243d8000 (f: 608010240.000000, d: 1.654192e+12)
[2024-10-21T23:19:40.775Z] DLT stderr FPR2=3fc67dae7d686772 (f: 2103994240.000000, d: 1.757105e-01)
[2024-10-21T23:19:40.775Z] DLT stderr FPR3=bf90c68c14bcc46f (f: 347915360.000000, d: -1.638240e-02)
[2024-10-21T23:19:40.775Z] DLT stderr FPR4=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR5=400a934f0979a371 (f: 158966640.000000, d: 3.321928e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR6=3f050b3d5af80000 (f: 1526202368.000000, d: 4.013806e-05)
[2024-10-21T23:19:40.775Z] DLT stderr FPR7=3f80ecf4c2a50800 (f: 3265595392.000000, d: 8.264458e-03)
[2024-10-21T23:19:40.775Z] DLT stderr FPR8=3ff4000000000000 (f: 0.000000, d: 1.250000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR9=3ff8000000000000 (f: 0.000000, d: 1.500000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR10=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR11=3ea094de06679fc5 (f: 107454408.000000, d: 4.941676e-07)
[2024-10-21T23:19:40.775Z] DLT stderr FPR12=3fd0394800000000 (f: 0.000000, d: 2.534962e-01)
[2024-10-21T23:19:40.775Z] DLT stderr FPR13=416312d000000000 (f: 0.000000, d: 1.000000e+07)
[2024-10-21T23:19:40.775Z] DLT stderr FPR14=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
[2024-10-21T23:19:40.775Z] DLT stderr FPR15=4072cba9d7e79544 (f: 3622278400.000000, d: 3.007290e+02)
[2024-10-21T23:19:40.775Z] DLT stderr FPR16=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR17=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR18=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR19=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR20=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR21=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR22=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR23=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR24=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR26=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR27=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR28=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR29=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR30=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR31=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR0=000003e8000003e8 (f: 1000.000000, d: 2.121996e-311)
[2024-10-21T23:19:40.775Z] DLT stderr FPR1=bf32494a3232afbf (f: 842182592.000000, d: -2.790266e-04)
[2024-10-21T23:19:40.775Z] DLT stderr FPR2=bf98492528c8cabf (f: 684247744.000000, d: -2.371653e-02)
[2024-10-21T23:19:40.775Z] DLT stderr FPR3=bf32494a3232afa3 (f: 842182592.000000, d: -2.790266e-04)
[2024-10-21T23:19:40.775Z] DLT stderr FPR4=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR5=400a934f0979a371 (f: 158966640.000000, d: 3.321928e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR6=3f050b3d5af80000 (f: 1526202368.000000, d: 4.013806e-05)
[2024-10-21T23:19:40.775Z] DLT stderr FPR7=3f80ecf4c2a50800 (f: 3265595392.000000, d: 8.264458e-03)
[2024-10-21T23:19:40.775Z] DLT stderr FPR8=3ff4000000000000 (f: 0.000000, d: 1.250000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR9=3ff8000000000000 (f: 0.000000, d: 1.500000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR10=3ff0000000000000 (f: 0.000000, d: 1.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR11=3e8c6cea541f5b09 (f: 1411341056.000000, d: 2.117861e-07)
[2024-10-21T23:19:40.775Z] DLT stderr FPR12=bfa184c000000000 (f: 0.000000, d: -3.421593e-02)
[2024-10-21T23:19:40.775Z] DLT stderr FPR13=408f400000000000 (f: 0.000000, d: 1.000000e+03)
[2024-10-21T23:19:40.775Z] DLT stderr FPR14=3fe62e42fefa39ef (f: 4277811712.000000, d: 6.931472e-01)
[2024-10-21T23:19:40.775Z] DLT stderr FPR15=4072cba9d7e79544 (f: 3622278400.000000, d: 3.007290e+02)
[2024-10-21T23:19:40.775Z] DLT stderr FPR16=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR17=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR18=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR19=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR20=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR21=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR22=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR23=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR24=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR25=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR26=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR27=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR28=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR29=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR30=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr FPR31=0000000000000000 (f: 0.000000, d: 0.000000e+00)
[2024-10-21T23:19:40.775Z] DLT stderr 
[2024-10-21T23:19:40.775Z] DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
[2024-10-21T23:19:40.775Z] DLT stderr Target=2_90_20241021_973 (Linux 4.18.0-553.22.1.el8_10.ppc64le)
[2024-10-21T23:19:40.775Z] DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc50000 RAM)
[2024-10-21T23:19:40.775Z] DLT stderr 
[2024-10-21T23:19:40.775Z] DLT stderr Compiled_method=java/util/Formatter.format(Ljava/util/Locale;Ljava/lang/String;[Ljava/lang/Object;)Ljava/util/Formatter;
[2024-10-21T23:19:40.775Z] DLT stderr ----------- Stack Backtrace -----------
[2024-10-21T23:19:40.775Z] DLT stderr Target=2_90_20241021_973 (Linux 4.18.0-553.22.1.el8_10.ppc64le)
[2024-10-21T23:19:40.775Z] DLT stderr CPU=ppc64le (4 logical CPUs) (0x1dcc50000 RAM)
[2024-10-21T23:19:40.775Z] DLT stderr ----------- Stack Backtrace -----------
[2024-10-21T23:19:40.775Z] DLT stderr  (0x00007FFF003ECE6C [<unknown>+0x0])
[2024-10-21T23:19:40.775Z] DLT stderr runJavaThread+0x240 (0x00007FFF980C6850 [libj9vm29.so+0x16850])
[2024-10-21T23:19:40.776Z] DLT stderr javaProtectedThreadProc+0x148 (0x00007FFF981602B8 [libj9vm29.so+0xb02b8])
[2024-10-21T23:19:40.776Z] DLT stderr omrsig_protect+0x3e4 (0x00007FFF93F69D14 [libj9prt29.so+0x39d14])
[2024-10-21T23:19:40.776Z] DLT stderr javaThreadProc+0x60 (0x00007FFF9815B920 [libj9vm29.so+0xab920])
[2024-10-21T23:19:40.776Z] DLT stderr thread_wrapper+0x190 (0x00007FFF9807CBC0 [libj9thr29.so+0xcbc0])
[2024-10-21T23:19:40.776Z] DLT stderr start_thread+0xf8 (0x00007FFF98AF9718 [libpthread.so.0+0x9718])
[2024-10-21T23:19:40.776Z] DLT stderr clone+0x74 (0x00007FFF9899B798 [libc.so.6+0x13b798])
[2024-10-21T23:19:40.776Z] DLT stderr ---------------------------------------
[2024-10-21T23:19:40.776Z] DLT stderr JVMDUMP039I Processing dump event "gpf", detail "" at 2024/10/21 16:19:40 - please wait.
[2024-10-21T23:19:40.776Z] DLT stderr JVMDUMP032I JVM requested System dump using '/home/jenkins/workspace/Test_openjdk11_j9_special.system_ppc64le_linux_testList_6/aqa-tests/TKG/output_17295523286803/DaaLoadTest_daa1_special_5m_8/20241021-161718-DaaLoadTest/results/core.20241021.161940.2783256.0001.dmp' in response to an event
[2024-10-21T23:19:40.776Z] DLT stderr  (0x00007FFF003ECE6C [<unknown>+0x0])
[2024-10-21T23:19:40.776Z] DLT stderr runJavaThread+0x240 (0x00007FFF980C6850 [libj9vm29.so+0x16850])
[2024-10-21T23:19:40.776Z] DLT stderr javaProtectedThreadProc+0x148 (0x00007FFF981602B8 [libj9vm29.so+0xb02b8])
[2024-10-21T23:19:40.776Z] DLT stderr omrsig_protect+0x3e4 (0x00007FFF93F69D14 [libj9prt29.so+0x39d14])
[2024-10-21T23:19:40.776Z] DLT stderr javaThreadProc+0x60 (0x00007FFF9815B920 [libj9vm29.so+0xab920])
[2024-10-21T23:19:40.776Z] DLT stderr thread_wrapper+0x190 (0x00007FFF9807CBC0 [libj9thr29.so+0xcbc0])
[2024-10-21T23:19:40.776Z] DLT stderr start_thread+0xf8 (0x00007FFF98AF9718 [libpthread.so.0+0x9718])
[2024-10-21T23:19:40.776Z] DLT stderr clone+0x74 (0x00007FFF9899B798 [libc.so.6+0x13b798])
[2024-10-21T23:19:40.776Z] DLT stderr ---------------------------------------
[2024-10-21T23:19:40.776Z] DLT stderr JVMDUMP039I Processing dump event "gpf", detail "" at 2024/10/21 16:19:40 - please wait.

[2024-10-21T23:20:58.626Z] DaaLoadTest_daa1_special_5m_8_FAILED

@pshipton
Copy link
Member Author

pshipton commented Dec 9, 2024

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_special.system_ppc64le_linux_Personal_testList_3/122

@pshipton pshipton mentioned this issue Dec 12, 2024
Closed
@pshipton pshipton added comp:jit segfault Issues that describe segfaults / JVM crashes labels Dec 12, 2024
@cjjdespres cjjdespres mentioned this issue Jan 7, 2025
Open
@pshipton
Copy link
Member Author

https://openj9-jenkins.osuosl.org/job/Test_openjdk11_j9_special.system_ppc64le_linux_Release_testList_3/81 - 0.49 build

@hzongaro
Copy link
Member

I suspect this is another variation of the problems reported in issues #17515 and #20283, which were fixed by OMR pull request 7573. I am running internal grinder runs with and without that fix to try to verify that.

@hzongaro
Copy link
Member

Internal grinder run 46744 of DaaLoadTest_daa1_special_5m_8 without the fix in eclipse-omr/omr#7573 yielded 4/125 (5x5x5) failures, while a second internal grinder run 46745 with that fix resulted in 0/125 failures.

I will keep this issue open for a couple of weeks in case there are any additional failures seen, but I believe this is a duplicate of #17515.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
comp:jit segfault Issues that describe segfaults / JVM crashes test failure
Projects
None yet
Milestone
Release 0.51 (Java 8, 11, 17, 21, 24)...
Development

No branches or pull requests
4 participants
@JasonFengJ9 @pshipton @hzongaro @cjjdespres