D-Bus fails to start, rendering system unusable

Issues related to applications and software problems and general support
taprove
Posts: 9
Joined: 2022/09/29 12:32:19

D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/29 13:13:50

We've got about 6 machines we built on CentOS Stream 9. Everything has been going great, then out of the blue I get a message telling me someone rebooted and can no longer get on. Looking at the console during a reboot I get many FAILED messages related to starting the D-Bus service.

Unfortunately, I can't capture the exact text, but when I do a system status on dbus I get messages from systems of "Failed to start D-Bus System Message Bus" and messages from dbus-broker.service that it failed to start.

Doing a systemctl status on dbus-broker, it states that it is "Exiting due to fatal error: -107"

Being a visual VMWare console I can't copy/paste all the text, but here is a screencap showing more detail:
broker error message
broker error message
Screen Shot 2022-09-29 at 8.06.28 AM.png (153.77 KiB) Viewed 6419 times
This is 5.14.0-148.el9.x68_64, though I have tried booting with previous kernels and failsafe and there is no difference in behavior.

Any pointers would be appreciated. I'd tried quite a bit of Googling and searching but nothing seems relevant.

Thanks much!

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: D-Bus fails to start, rendering system unusable

Post by TrevorH » 2022/09/29 14:03:14

Is the a real install or some sort of container? Are there any other messages higher up the console than the ones you showed? Specifically I'd be looking for permission denied errors or thing of that sort.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/29 14:21:09

It's a VMWare guest. I can't capture the boot messages as they go by so quickly, but cruising through dmesg the only thing that pops up that is abnormal is a "BAR 13: no space for [io size 0x1000]" and accompanying messages, but it also occurs on other CentOS 9 machines that are fine, so I don't think it's related.

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/29 14:37:52

I was able to create a video capture of the remote console, and all I can see is the service start failure and the cascading errors.
Screen Shot 2022-09-29 at 9.31.40 AM.png
Screen Shot 2022-09-29 at 9.31.40 AM.png (149.49 KiB) Viewed 6405 times

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: D-Bus fails to start, rendering system unusable

Post by TrevorH » 2022/09/29 17:08:31

The bar messages are about PCIE devices, nothing to do with this. Do you get dropped to an emergency shell or does it boot up? In either case, try journalctl -u dbus-broke and see if that tells you anything useful.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/29 17:47:55

Just tells me "-- No entries --" :(

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/29 17:48:38

I've also checked permissions on the socket file, comparing it to a working one, etc. I just can't find anything abnormal.

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: D-Bus fails to start, rendering system unusable

Post by TrevorH » 2022/09/30 02:13:17

I had a typo, it should have said journalctl -u dbus-broker
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/30 12:37:38

That yields a whole bunch of this, over and over...
Screen Shot 2022-09-30 at 7.35.22 AM.jpg
Screen Shot 2022-09-30 at 7.35.22 AM.jpg (193.87 KiB) Viewed 6310 times

taprove
Posts: 9
Joined: 2022/09/29 12:32:19

Re: D-Bus fails to start, rendering system unusable

Post by taprove » 2022/09/30 12:43:38

I do have SELinux disabled on this machine. I had seen lots of articles that mentioned SELinux as the culprit for similar situations so I disabled that early on in the troubleshooting.

Post Reply