Random segfault from glibc in apt-get, perl

[rluble]

I have noticed random segfaults from many programs (apt-get, perl, freeswitch, ...) with messages like

*** glibc detected *** /usr/bin/perl: corrupted double-linked list: 0x09e3b568 ***

which seems to point to a memory problem; although nothing is found running several passes of memtest so it does seem more like a software issue....

This is on a fit-pc2i from the pilot batch with Ubuntu 9.10 using the fit-pc2 kernel as per installation instruction in the wiki.

Anyone else experiencing these problems? Any thoughts?

-Roberto

[mdavids]

I have noticed random segfaults from many programs
This is on a fit-pc2i from the pilot batch with Ubuntu 9.10 using the fit-pc2 kernel as per installation instruction in the wiki.

For what's it's worth; i see them too. On a Fit-PC2i, rev 1.1 (pilot batch, i assume) with Ubuntu 10.04 (special kernel by axcoco, http://www.fit-pc2.com/forum/viewtopic.php?f=58&t=1651)

Saw them more frequent a while ago (when the outside temperatures where a lot higher, so maybe there's a connection there)

Code: Select all

Sep 15 10:56:03 gw kernel: [1434900.140920] check-new-relea[30300]: segfault at 2020202 ip 02020202 sp bfefd24c error 4 in python2.6[8048000+1e0000]
Sep 21 19:34:07 gw kernel: [1984298.614904] python[18787]: segfault at 2020202 ip 02020202 sp bf87e42c error 4 in python2.6[8048000+1e0000]
Sep 21 22:07:36 gw kernel: [ 5627.654422] tshark[3422]: segfault at bfee5368 ip 012e1e95 sp bfec527c error 4 in libwireshark.so.0.0.1[e39000+145b000]
Sep 21 22:42:10 gw kernel: [ 7701.715889] ufw[6789]: segfault at ffffb5eb ip 00656cd2 sp bfb32f8c error 5 in libm-2.11.1.so[648000+24000]
Sep 25 20:17:01 gw kernel: [116887.244882] sh[2635]: segfault at 8b1808c ip 08058a6e sp bfaac440 error 4 in dash[8048000+14000]
Oct  2 02:42:59 gw kernel: [357415.851976] sshd[24749]: segfault at 8d06750f ip 00fbe7ee sp bfbb0980 error 4 in sshd[f98000+66000]
Oct  7 10:40:05 gw kernel: [ 4993.161330] landscape-sysin[22792]: segfault at 2020202 ip 02020202 sp bfd5b1fc error 4 in python2.6[8048000+1e0000]
Oct 11 09:27:37 gw kernel: [299999.814770] apt-check[6257]: segfault at ba6d40a4 ip 003499b1 sp bfecfc70 error 4 in libapt-pkg-libc6.10-6.so.4.8.0[311000+c8000]
Oct 12 20:57:48 gw kernel: [427810.847911] hdparm[19089]: segfault at 87e17bc2 ip 0099ae05 sp bfb2e9cc error 6 in libc-2.11.1.so[8fd000+153000]

[mgc8]

I get these as well. Fit-PC2i "pilot-batch". Debian Squeeze (testing), kernel 2.6.35 (the same happens with the original 2.6.31-custom from Ubuntu 8.04):

Code: Select all

Oct 17 01:35:08 ams kernel: [ 1466.623119] munin-node[8064]: segfault at 5 ip 080cacfc sp bfa67bb0 error 4 in perl[8048000+12d000]
Oct 17 03:10:09 ams kernel: [ 7167.874789] munin-node[32007]: segfault at 7654241c ip b75c4604 sp bfa68a7c error 4 in libc-2.11.2.so[b7559000+140000]
Oct 17 03:10:09 ams kernel: [ 7167.876700] munin-node[31172]: segfault at 7654241c ip b75c4604 sp bfa68a48 error 4 in libc-2.11.2.so[b7559000+140000]
Oct 17 03:20:10 ams kernel: [ 7768.770689] munin-node[1337]: segfault at 5e3f3474 ip b75c4604 sp bfa68a7c error 4 in libc-2.11.2.so[b7559000+140000]
Oct 17 03:20:10 ams kernel: [ 7768.772608] munin-node[466]: segfault at 5e3f3474 ip b75c4604 sp bfa68a48 error 4 in libc-2.11.2.so[b7559000+140000]
Oct 19 09:30:04 ams kernel: [ 4085.027109] munin-node[20517]: segfault at 6bb769f4 ip b7731604 sp bf90e67c error 4 in libc-2.11.2.so[b76c6000+140000]
Oct 19 09:30:04 ams kernel: [ 4085.030941] munin-node[20310]: segfault at 6bb769f4 ip b7731604 sp bf90e648 error 4 in libc-2.11.2.so[b76c6000+140000]
Oct 19 09:30:06 ams kernel: [ 4086.398048] munin-node[20607]: segfault at 799f661c ip b7731604 sp bf90e67c error 4 in libc-2.11.2.so[b76c6000+140000]
Oct 19 11:00:03 ams kernel: [ 9483.921338] munin-node[9405]: segfault at 7c966c14 ip b7731604 sp bf90e67c error 4 in libc-2.11.2.so[b76c6000+140000]
Oct 19 11:30:03 ams kernel: [ 1293.086595] diskstats[8760]: segfault at 53414c36 ip b764c52e sp bfca60bc error 4 in libc-2.11.2.so[b75e1000+140000]
Oct 19 14:25:05 ams kernel: [11794.876298] munin-node[20224]: segfault at 75f6f4fc ip b76d3604 sp bfac5ebc error 4 in libc-2.11.2.so[b7668000+140000]
Oct 19 14:25:05 ams kernel: [11794.878269] munin-node[19912]: segfault at 75f6f4fc ip b76d3604 sp bfac5e88 error 4 in libc-2.11.2.so[b7668000+140000]
Oct 19 21:40:08 ams kernel: [37898.056180] munin-node[31786]: segfault at 6cd9446c ip b76d3604 sp bfac5ebc error 4 in libc-2.11.2.so[b7668000+140000]
Oct 19 21:40:08 ams kernel: [37898.058228] munin-node[31012]: segfault at 6cd9446c ip b76d3604 sp bfac5e88 error 4 in libc-2.11.2.so[b7668000+140000]
Oct 20 10:47:10 ams kernel: [ 8670.180968] powertop[7589]: segfault at 7e9c566c ip b76b0eb4 sp bfbb0080 error 6 in libc-2.11.2.so[b763e000+140000]

See also: http://www.fit-pc2.com/forum/viewtopic.php?f=9&t=1907

[mdavids]

See also: http://www.fit-pc2.com/forum/viewtopic.php?f=9&t=1907

GV3 only is configured correctly in my BIOS. So I suspect a faulty RAM. Wasn't able to verify this with 'memtest86+', that is present in the Grub bootmenu, because it refuses to work and exits with an error: 'error: too small lower memort (0x99100 > 0x90000).' But from what i understand that that is a known Ubuntu bug.

Hence, I tried something else and ended up with running a userspace program called 'memtester' and the result doesn't look good. I also ran it on my netbook with similar hardware specs, as a reference. And it looks perfect there. I wonder how the experiences of other forum visitors are? Meanwhile i have (RMA) returned my Fit-PC2i to the Dutch reseller for repair - let's see if that helps.

Code: Select all

root@ubuntu:~# memtester 128M   
memtester version 4.1.3 (32-bit)   
Copyright (C) 2010 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffff000  
want 128MB (134217728 bytes)
got  128MB (134217728 bytes), trying mlock ...locked.
Loop 1:
  Stuck Address       : testing   0FAILURE: possible bad address line at
offset 0x002f4281.
Skipping to next test...
  Random Value        : FAILURE: 0xdbeef0f3 != 0xfbeef0f3 at offset
0x00fe7ff0.
FAILURE: 0xee3051b2 != 0xce3051b2 at offset 0x00fe7ff0.
  Compare XOR         : FAILURE: 0x5af34dcd != 0x7af34dcd at offset
0x00688e60.
FAILURE: 0xf2f7b41a != 0xf2d7b41a at offset 0x00760ee1.
FAILURE: 0x96b8ec06 != 0x76b8ec06 at offset 0x00fe7ff0.
  Compare SUB         : FAILURE: 0x23bb72d2 != 0x63bb72d2 at offset
0x00688e60.
FAILURE: 0xa8b162a4 != 0x257162a4 at offset 0x00760ee1.
FAILURE: 0x36b6609c != 0xf6b6609c at offset 0x00fe7ff0.
  Compare MUL         : FAILURE: 0x00000001 != 0x00000000 at offset
0x00760ee1.
FAILURE: 0x00000000 != 0x00000002 at offset 0x00fe7ff0.
  Compare DIV         : FAILURE: 0xf3f5a35b != 0xf3f5a35a at offset
0x00760ee1.
  Compare OR          :   Compare AND         : ok
FAILURE: 0x3fc35869 != 0x3fc15869 at offset 0x006220a1.

etc...