Apache Ignite appears to be causing Kernel issues

Issues related to applications and software problems and general support
Post Reply
bbellrose
Posts: 1
Joined: 2020/10/14 13:48:39

Apache Ignite appears to be causing Kernel issues

Post by bbellrose » 2020/10/14 13:52:01

I am receiving the following kernel dump before an Apache Ignite failure

Oct 12 17:49:41 nalrcsvridbq02 kernel: CPU: 0 PID: 3703404 Comm: kworker/u256:0 Kdump: loaded Tainted: G L --------- - - 4.18.0-193.14.2.el8_2.x86_64 #1
Oct 12 17:49:41 nalrcsvridbq02 kernel: Hardware name: VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform, BIOS 6.00 07/03/2018
Oct 12 17:49:41 nalrcsvridbq02 kernel: Workqueue: writeback wb_workfn (flush-253:3)
Oct 12 17:49:41 nalrcsvridbq02 kernel: RIP: 0010:_raw_spin_unlock_irqrestore+0x11/0x20
Oct 12 17:49:41 nalrcsvridbq02 kernel: Code: 85 ff 48 29 e8 4c 39 e0 76 cf 80 0b 08 eb 8c 90 90 90 90 90 90 90 90 90 90 0f 1f 44 00 00 c6 07 00 0f 1f 40 00 48 89 f7 57 9d <0f> 1f 44 00 00 c3 66 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 8b 07
Oct 12 17:49:41 nalrcsvridbq02 kernel: RSP: 0018:ffffab5785b93520 EFLAGS: 00000296 ORIG_RAX: ffffffffffffff13
Oct 12 17:49:41 nalrcsvridbq02 kernel: RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffffffffffff
Oct 12 17:49:41 nalrcsvridbq02 kernel: RDX: ffffab5780e18000 RSI: 0000000000000296 RDI: 0000000000000296
Oct 12 17:49:41 nalrcsvridbq02 kernel: RBP: ffff934674859728 R08: 0000000000000001 R09: ffff934674859948
Oct 12 17:49:41 nalrcsvridbq02 kernel: R10: 0000000000000001 R11: 0000000000000000 R12: ffff934674f8a000
Oct 12 17:49:41 nalrcsvridbq02 kernel: R13: ffff934674f8a000 R14: ffff934673cf9690 R15: ffff934673cb2000
Oct 12 17:49:41 nalrcsvridbq02 kernel: FS: 0000000000000000(0000) GS:ffff934679c00000(0000) knlGS:0000000000000000
Oct 12 17:49:41 nalrcsvridbq02 kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 12 17:49:41 nalrcsvridbq02 kernel: CR2: 00007fe99013dff8 CR3: 000000008700a003 CR4: 00000000007606f0
Oct 12 17:49:41 nalrcsvridbq02 kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Oct 12 17:49:41 nalrcsvridbq02 kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Oct 12 17:49:41 nalrcsvridbq02 kernel: PKRU: 55555554
Oct 12 17:49:41 nalrcsvridbq02 kernel: Call Trace:
Oct 12 17:49:41 nalrcsvridbq02 kernel: pvscsi_queue+0x2f0/0x760 [vmw_pvscsi]
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? scsi_timeout+0x20/0x20
Oct 12 17:49:41 nalrcsvridbq02 kernel: scsi_queue_rq+0x6e1/0xa80
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_dispatch_rq_list+0x414/0x5b0
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? elv_rb_del+0x1f/0x30
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? deadline_remove_request+0x55/0xc0
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? dd_dispatch_request+0x1ba/0x230
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_do_dispatch_sched+0x76/0x110
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_sched_dispatch_requests+0x11b/0x170
Oct 12 17:49:41 nalrcsvridbq02 kernel: __blk_mq_run_hw_queue+0x51/0xd0
Oct 12 17:49:41 nalrcsvridbq02 kernel: __blk_mq_delay_run_hw_queue+0x141/0x160
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_run_hw_queue+0x4f/0x110
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_sched_insert_requests+0x71/0xf0
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_flush_plug_list+0x196/0x2c0
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_flush_plug_list+0xd7/0x100
Oct 12 17:49:41 nalrcsvridbq02 kernel: blk_mq_make_request+0x23e/0x5a0
Oct 12 17:49:41 nalrcsvridbq02 kernel: generic_make_request+0xcf/0x310
Oct 12 17:49:41 nalrcsvridbq02 kernel: submit_bio+0x45/0x140
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? __test_set_page_writeback+0x1f8/0x3f0
Oct 12 17:49:41 nalrcsvridbq02 kernel: xfs_submit_ioend.isra.23+0x53/0x120 [xfs]
Oct 12 17:49:41 nalrcsvridbq02 kernel: xfs_do_writepage+0x1d9/0x470 [xfs]
Oct 12 17:49:41 nalrcsvridbq02 kernel: write_cache_pages+0x1aa/0x440
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? xfs_vm_releasepage+0x80/0x80 [xfs]
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? submit_bio+0x45/0x140
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? __switch_to_asm+0x41/0x70
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? __switch_to_asm+0x35/0x70
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? __switch_to_asm+0x41/0x70
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? __switch_to_asm+0x35/0x70
Oct 12 17:49:41 nalrcsvridbq02 kernel: xfs_vm_writepages+0x64/0xa0 [xfs]
Oct 12 17:49:41 nalrcsvridbq02 kernel: do_writepages+0x41/0xd0
Oct 12 17:49:41 nalrcsvridbq02 kernel: __writeback_single_inode+0x3d/0x360
Oct 12 17:49:41 nalrcsvridbq02 kernel: writeback_sb_inodes+0x1e3/0x450
Oct 12 17:49:41 nalrcsvridbq02 kernel: __writeback_inodes_wb+0x5d/0xb0
Oct 12 17:49:41 nalrcsvridbq02 kernel: wb_writeback+0x25f/0x2f0
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? cpumask_next+0x17/0x20
Oct 12 17:49:41 nalrcsvridbq02 kernel: wb_workfn+0x342/0x400
Oct 12 17:49:41 nalrcsvridbq02 kernel: process_one_work+0x1a7/0x3b0
Oct 12 17:49:41 nalrcsvridbq02 kernel: worker_thread+0x30/0x390
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? create_worker+0x1a0/0x1a0
Oct 12 17:49:41 nalrcsvridbq02 kernel: kthread+0x112/0x130
Oct 12 17:49:41 nalrcsvridbq02 kernel: ? kthread_flush_work_fn+0x10/0x10
Oct 12 17:49:41 nalrcsvridbq02 kernel: ret_from_fork+0x35/0x40

User avatar
TrevorH
Forum Moderator
Posts: 29681
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: Apache Ignite appears to be causing Kernel issues

Post by TrevorH » 2020/10/14 14:02:03

There are several likely looking fixes in teh most current kernel so I suggest you yum update and reboot and retry.
* Wed Aug 26 2020 Bruno Meneguele <bmeneg@redhat.com> [4.18.0-193.19.1.el8_2]
- [net] tcp: add sanity tests in tcp_add_backlog() (Guillaume Nault) [1861378 1790843]
- [net] tcp: implement coalescing on backlog queue (Guillaume Nault) [1861378 1790843]
- [include] tcp: make tcp_space() aware of socket backlog (Guillaume Nault) [1861378 1790843]
- [net] tcp: take care of compressed acks in tcp_add_reno_sack() (Guillaume Nault) [1861378 1790843]
- [include] tcp: hint compiler about sack flows (Guillaume Nault) [1861378 1790843]
- [net] tcp: drop dst in tcp_add_backlog() (Guillaume Nault) [1861378 1790843]
CentOS 6 will die in November 2020 - migrate sooner rather than later!
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 is dead, do not use it.
Full time Geek, part time moderator. Use the FAQ Luke

Post Reply

Return to “CentOS 8 - General Support”