These messages were not displayed before I made the change, so it's possible the kernel was trying to say something, but I never saw it. Per sourcejedi's recommendation, I have now lowered the threshold for console logging to 5, and confirmed that I can see messages sent to /dev/kmsg on the VM's local console. On at least one occasion, the hang has gone on for >8 hours before being noticed by someone trying to access the server via SFTP. VCenter/vSphere does not show abnormally high CPU or memory utilization when this problem occurs. The datastore itself is a large NAS which also services a few other ESXi hosts, and none of the other guests are impacted when this happens. This VM has a single 1TB volume (thick provisioned, lazy zeroed) attached via LSI Logic Parallel vSCSI. There is never anything printed on the VM's "local console" when this problem occurs. The last message in any of the log files is written long before the actual problem occurs. No information about the crash is present in any logs in /var/log (any pointers on someplace else to look?). I can switch to one of the other virtual terminals and enter a username and password.but then the system hangs again. This includes trying to use tab-completion for filenames, &c. Up until that point, you can type whatever you want only after you try to ask the system to do something does it stop working. The "local" console hangs immediately after submitting a command. ![]() It also listens for SSH, but never prompts for authentication before closing the session. The VM responds normally to pings and is still listening for - but not responding to - http/s requests (apache2). I'm looking for some ideas on what to do or look for when it happens again (probably around this Thursday or Friday, if the current pattern holds). The problem goes away after a reboot, and the system appears to run stable for about a week afterward. ![]() The impacted computer is a VM running in vSphere, and it's a production server, so troubleshooting time is generally nonexistent once the issue rears its ugly head.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |