[debian-mysql] Bug#607489: Bug#607489: mysql-server-5.1: mysql processes kernel segfault when out of memory

[Radosław Antoniuk]

Again the same:

Jan  2 04:07:27 db kernel: printk: 181 messages suppressed.
Jan  2 04:07:27 db kernel: mysqld invoked oom-killer:
gfp_mask=0x201d2, order=0, oomkilladj=0
Jan  2 04:07:27 db kernel:
Jan  2 04:07:27 db kernel: Call Trace:
Jan  2 04:07:27 db kernel: [<ffffffff802524a0>] out_of_memory+0x70/0x1e0
Jan  2 04:07:27 db kernel: [<ffffffff80241710>]
autoremove_wake_function+0x0/0x30
Jan  2 04:07:27 db kernel: [<ffffffff80253dcb>] __alloc_pages+0x24b/0x2f0
Jan  2 04:07:27 db kernel: [<ffffffff8047efcd>]
gnttab_free_grant_references+0x1d/0xb0
Jan  2 04:07:27 db kernel: [<ffffffff8025582b>]
__do_page_cache_readahead+0x12b/0x2e0
Jan  2 04:07:27 db kernel: [<ffffffff80667d78>] io_schedule+0x28/0x40
Jan  2 04:07:28 db kernel: [<ffffffff8024f0e0>] sync_page+0x0/0x50
Jan  2 04:07:28 db kernel: [<ffffffff806680d7>] __wait_on_bit_lock+0x67/0x80
Jan  2 04:07:28 db kernel: [<ffffffff8024f0bf>] __lock_page+0x5f/0x70
Jan  2 04:07:28 db kernel: [<ffffffff802516d5>] filemap_nopage+0x155/0x330
Jan  2 04:07:28 db kernel: [<ffffffff802607e8>] __handle_mm_fault+0x428/0x10c0
Jan  2 04:07:28 db kernel: [<ffffffff80668ff6>] __down_read+0xd6/0xf2
Jan  2 04:07:28 db kernel: [<ffffffff80217349>] do_page_fault+0xe79/0x1280
Jan  2 04:07:28 db kernel: [<ffffffff806699e7>] error_exit+0x0/0x79
Jan  2 04:07:28 db kernel:
Jan  2 04:07:28 db kernel: Mem-info:
Jan  2 04:07:28 db kernel: DMA per-cpu:
Jan  2 04:07:28 db kernel: CPU    0: Hot: hi:  186, btch:  31 usd:  11
  Cold: hi:   62, btch:  15 usd:  54
Jan  2 04:07:28 db kernel: CPU    1: Hot: hi:  186, btch:  31 usd:  23
  Cold: hi:   62, btch:  15 usd:  48
Jan  2 04:07:28 db kernel: CPU    2: Hot: hi:  186, btch:  31 usd:  20
  Cold: hi:   62, btch:  15 usd:  55
Jan  2 04:07:28 db kernel: CPU    3: Hot: hi:  186, btch:  31 usd:   4
  Cold: hi:   62, btch:  15 usd:  54
Jan  2 04:07:28 db kernel: Active:1089770 inactive:2945656 dirty:0
writeback:0 unstable:0
Jan  2 04:07:28 db kernel: free:4022 slab:3350 mapped:1
pagetables:13480 bounce:0
Jan  2 04:07:28 db kernel: DMA free:16088kB min:16176kB low:20220kB
high:24264kB active:4359080kB inactive:11782624kB present:16362000kB
pages_scanned:82937571 all_unreclaimable? yes
Jan  2 04:07:28 db kernel: lowmem_reserve[]: 0 0 0
Jan  2 04:07:28 db kernel: DMA: 56*4kB 25*8kB 7*16kB 2*32kB 2*64kB
0*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 16088kB
Jan  2 04:07:28 db kernel: Swap cache: add 22452984, delete 22453029,
find 11334979/12920528, race 6+68
Jan  2 04:07:28 db kernel: Free swap  = 0kB
Jan  2 04:07:28 db kernel: Total swap = 10485752kB
Jan  2 04:07:28 db kernel: Free swap:            0kB
Jan  2 04:07:28 db kernel: 4147200 pages of RAM
Jan  2 04:07:28 db kernel: 80986 reserved pages
Jan  2 04:07:28 db kernel: 2668 pages shared
Jan  2 04:07:28 db kernel: 0 pages swap cached
Jan  2 04:07:28 db kernel: Out of memory: kill process 27569 (mysqld)
score 10792899 or a child
Jan  2 04:07:28 db kernel: Killed process 27569 (mysqld)
Jan  2 04:07:28 db kernel: mysqld invoked oom-killer:
gfp_mask=0x200d2, order=0, oomkilladj=0
Jan  2 04:07:28 db kernel:
Jan  2 04:07:28 db kernel: Call Trace:
Jan  2 04:07:28 db kernel: [<ffffffff802524a0>] out_of_memory+0x70/0x1e0
Jan  2 04:07:28 db kernel: [<ffffffff80253dcb>] __alloc_pages+0x24b/0x2f0
Jan  2 04:07:28 db kernel: [<ffffffff8026b5d3>] read_swap_cache_async+0x43/0xe0
Jan  2 04:07:28 db kernel: [<ffffffff8025b576>] swapin_readahead+0x56/0x90
Jan  2 04:07:28 db kernel: [<ffffffff8026101d>] __handle_mm_fault+0xc5d/0x10c0
Jan  2 04:07:28 db kernel: [<ffffffff803c0b95>] submit_bio+0xc5/0xd0
Jan  2 04:07:28 db kernel: [<ffffffff802a15e6>] mpage_readpages+0x126/0x140
Jan  2 04:07:28 db kernel: [<ffffffff802f0b80>] ext3_get_block+0x0/0x120
Jan  2 04:07:28 db kernel: [<ffffffff80217349>] do_page_fault+0xe79/0x1280
Jan  2 04:07:28 db kernel: [<ffffffff8020dab0>] monotonic_clock+0x50/0xa0
Jan  2 04:07:28 db kernel: [<ffffffff80667407>] thread_return+0x0/0x149
Jan  2 04:07:28 db kernel: [<ffffffff806699e7>] error_exit+0x0/0x79
Jan  2 04:07:28 db kernel: [<ffffffff8020a0b4>] sysret_signal+0x38/0x43
Jan  2 04:07:28 db kernel: [<ffffffff803cfab0>] __get_user_8+0x20/0x2c
Jan  2 04:07:28 db kernel: [<ffffffff802485a4>] exit_robust_list+0x34/0x110
Jan  2 04:07:28 db kernel: [<ffffffff8022f997>] do_exit+0x1f7/0x850
Jan  2 04:07:28 db kernel: [<ffffffff80667f85>] schedule_timeout+0x25/0xd0
Jan  2 04:07:28 db kernel: [<ffffffff802461e0>] get_futex_key+0x50/0x140
Jan  2 04:07:28 db kernel: [<ffffffff80230094>] do_group_exit+0xa4/0xb0
Jan  2 04:07:28 db kernel: [<ffffffff8023982a>]
get_signal_to_deliver+0x48a/0x4e0
Jan  2 04:07:28 db kernel: [<ffffffff8020943a>] do_notify_resume+0xca/0x7e0
Jan  2 04:07:28 db kernel: [<ffffffff80226b40>] default_wake_function+0x0/0x10
Jan  2 04:07:28 db kernel: [<ffffffff8028d897>] mntput_no_expire+0x27/0xa0
Jan  2 04:07:28 db kernel: [<ffffffff8027594f>] sys_faccessat+0x13f/0x1b0
Jan  2 04:07:28 db kernel: [<ffffffff8024827f>] sys_futex+0xcf/0x110
Jan  2 04:07:28 db kernel: [<ffffffff8020a0b4>] sysret_signal+0x38/0x43
Jan  2 04:07:28 db kernel: [<ffffffff8020a37d>] ptregscall_common+0x3d/0x70


It happens quite randomly, i.e. didn't happen for those 3 weeks.