[Pkg-samba-maint] [Bug 3204] winbindd: Exceeding 200 client connections, no idle connection found

[samba-bugs at samba.org]

https://bugzilla.samba.org/show_bug.cgi?id=3204

Hemanth <hemanth.thummala at gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |hemanth.thummala at gmail.com

--- Comment #67 from Hemanth <hemanth.thummala at gmail.com> 2014-07-17 21:09:29 UTC ---
Got the same problem with samba 3.6.12+ stack. Infact we got this issue twice
for one of our customer.

[2014/07/17 11:23:02.223054,  0]
winbindd/winbindd.c:947(winbindd_listen_fde_handler)
  winbindd: Exceeding 400 client connections, no idle connection found
[2014/07/17 11:23:02.224055,  0]
winbindd/winbindd.c:947(winbindd_listen_fde_handler)
  winbindd: Exceeding 400 client connections, no idle connection found

Winbindd went unresponsive and found that there are lot(~10K) of open file
handles for this stuck winbindd process. Had to kill this process to restore
the user access/connectivity.

 ....
 ....
 3378 winbindd         10294 s - rw------   1       0 UDS
/usr/local/var/locks/winbindd_privileged/pipe
 3378 winbindd         10295 s - rw------   1       0 UDS
/usr/local/var/locks/winbindd_privileged/pipe
 3378 winbindd         10296 s - rw------   1       0 UDS
/usr/local/var/locks/winbindd_privileged/pipe

Here is the gdb stack info of stuck winbindd process.
=== Dumping Process winbindd (3380) ===

[Switching to Thread 8030021c0 (LWP 101095)]
0x00000008026cd5ec in poll () from /lib/libc.so.7

Thread 1 (Thread 8030021c0 (LWP 101095)):
#0  0x00000008026cd5ec in poll () from /lib/libc.so.7
#1  0x00000008010a27fe in poll () from /lib/libthr.so.3
#2  0x0000000801ea0ee9 in wait4msg (result=<optimized out>, timeout=<optimized
out>, all=<optimized out>, msgid=<optimized out>, ld=<optimized out>) at
result.c:312
#3  ldap_result (ld=0x80302eac0, msgid=5, all=1, timeout=<optimized out>,
result=0x7fffffffc258) at result.c:117
#4  0x0000000801ea8348 in ldap_sasl_bind_s (ld=0x80302eac0, dn=0x0,
mechanism=0xa00760 "GSS-SPNEGO", cred=0x7fffffffc370, sctrls=0x0,
cctrls=<optimized out>, servercredp=0x7fffffffc400) at sasl.c:194
#5  0x0000000000821a1d in ads_sasl_spnego_rawkrb5_bind (principal=<optimized
out>, ads=<optimized out>) at libads/sasl.c:795
#6  ads_sasl_spnego_krb5_bind (ads=0x803002a80, p=<optimized out>) at
libads/sasl.c:823
#7  0x0000000000822545 in ads_sasl_spnego_bind (ads=0x803002a80) at
libads/sasl.c:904
#8  0x000000000082055d in ads_sasl_bind (ads=0x803002a80) at libads/sasl.c:1213
#9  0x000000000081f8e4 in ads_connect (ads=0x803002a80) at libads/ldap.c:730
#10 0x00000000004a78b0 in ads_cached_connection (domain=0x80305f200) at
winbindd/winbindd_ads.c:131
#11 0x00000000004a7ba0 in sequence_number (domain=0x80305f200, seq=0x80305f718)
at winbindd/winbindd_ads.c:1262
#12 0x0000000000492b31 in refresh_sequence_number (domain=0x80305f200,
force=<optimized out>) at winbindd/winbindd_cache.c:558
#13 0x0000000000492df4 in wcache_fetch (cache=<optimized out>,
domain=0x80305f200, format=0x8b9580 "GM/%s") at winbindd/winbindd_cache.c:711
#14 0x0000000000493ba6 in wcache_lookup_groupmem (domain=0x80305f200,
mem_ctx=0x803009290, group_sid=<optimized out>, num_names=0x7fffffffcf84,
sid_mem=0x7fffffffcf78, names=0x7fffffffcf70, name_types=0x7fffffffcf68) at
winbindd/winbindd_cache.c:2615
#15 0x0000000000493e58 in lookup_groupmem (domain=0x8030af004, mem_ctx=0x1,
group_sid=0x80308c3d0, type=SID_NAME_DOM_GRP, num_names=0x1,
sid_mem=0x7fffffffcf78, names=0x7fffffffcf70, name_types=0x7fffffffcf68) at
winbindd/winbindd_cache.c:2673
#16 0x00000000004b1be4 in _wbint_LookupGroupMembers (p=0x7fffffffd000,
r=0x803044140) at winbindd/winbindd_dual_srv.c:347
#17 0x00000000004bad16 in api_wbint_LookupGroupMembers (p=0x7fffffffd000) at
librpc/gen_ndr/srv_wbint.c:1271
#18 0x00000000004b04a2 in winbindd_dual_ndrcmd (domain=0x80305f200,
state=0x7fffffffe800) at winbindd/winbindd_dual_ndr.c:322
#19 0x00000000004aecfd in child_process_request (state=<optimized out>,
child=<optimized out>) at winbindd/winbindd_dual.c:495
#20 fork_domain_child (child=<optimized out>) at winbindd/winbindd_dual.c:1609
#21 wb_child_request_trigger (req=<optimized out>, private_data=<optimized
out>) at winbindd/winbindd_dual.c:200
#22 0x0000000000569970 in tevent_common_loop_immediate (ev=0x80301e110) at
../lib/tevent/tevent_immediate.c:139
#23 0x0000000000567c35 in run_events_poll (ev=0x80301e110, pollrtn=0, pfds=0x0,
num_pfds=0) at lib/events.c:197
#24 0x0000000000568359 in s3_event_loop_once (ev=0x80301e110,
location=<optimized out>) at lib/events.c:331
#25 0x0000000000568771 in _tevent_loop_once (ev=0x80301e110, location=0x8b41c9
"winbindd/winbindd.c:1456") at ../lib/tevent/tevent.c:494
#26 0x00000000004898a2 in main (argc=<optimized out>, argv=<optimized out>,
envp=<optimized out>) at winbindd/winbindd.c:1456


Would like to know if someone has an idea on where exactly FDs are leaking.

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.