[offlineimap] downloading junk messages raise socket error with "copy message list.remove(x): x not in list" (#198)

[Valentin Lab]

openssl version: 1.0.1f-1ubuntu11.4,
I changed ``ssl_version`` to ``ssl23``
I'm now on the last ``master`` (git describe gives 'v6.6.0-rc2-2-gecd9e66', I have my password patch from #266 only ) 
Please note that the hacky ``while true; do offlineimap; done`` finally reached completion, which means no specific mail was triggering the exception.
As a consequence it becomes harder for me to reproduce the bug, but nevertheless it was reproduced only by fetching new mails.
I must add also that on the server side I have some random issues that might trigger errors from dovecot... but this shouldn't trigger this buggy behavior on ``offlineimap`` side anyway.

```
imap.kalysto.org writer:
 [imap]:   10:01.90 imap.kalysto.org writer > JHHN5 CAPABILITY\r\n
imap.kalysto.org reader:
 [imap]:   10:02.26 imap.kalysto.org reader poll => [(4, 1)]
 [imap]:   10:02.26 imap.kalysto.org reader rcvd 302
 [imap]:   10:02.26 imap.kalysto.org reader < * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS\r\n
 [imap]:   10:02.26 imap.kalysto.org reader < JHHN5 OK Capability completed.\r\n
imap.kalysto.org handler:
 [imap]:   10:02.27 imap.kalysto.org handler _put_response(* CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS)
 [imap]:   10:02.27 imap.kalysto.org handler untagged_responses[CAPABILITY] 1 += ["IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THRE"]
 [imap]:   10:02.27 imap.kalysto.org handler _put_response(JHHN5 OK Capability completed.)
 [imap]:   10:02.27 imap.kalysto.org handler _request_pop(JHHN5, ('OK', ['Capability completed.'])) [0] = JHHN5
 [imap]:   10:02.27 imap.kalysto.org handler CAPABILITY:JHHN5.ready.set
 [imap]:   10:02.27 imap.kalysto.org handler state_change_free.set
Account sync Kalysto:
 [imap]:   10:02.27 Account sync Kalysto _get_untagged_response(CAPABILITY) => ['IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY TH
 [imap]:   10:02.27 Account sync Kalysto _untagged_response(OK, ?, CAPABILITY) => ['IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY TH
 ERROR: command: UID => connection terminated
 ['  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/IMAP.py", line 692, in _fetch_from_imap\n    res_type, data = imapobj.uid(\'fetch\', uids, query)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imaplib2.py", line 1220, in uid\n    return self._simple_command(\'UID\', command, *args, **kw)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imaplib2.py", line 1690, in _simple_command\n    return self._command_complete(self._command(name, *args), kw)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imaplib2.py", line 1440, in _command_complete\n    typ, dat = rqb.get_response(\'command: %s => %%s\' % rqb.name)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imaplib2.py", line 198, in get_response\n    raise typ(exc_fmt % str(val))\n']
 ERROR: Copying message 1915 [acc: Kalysto]
  list.remove(x): x not in list
 ['  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 775, in copymessageto\n    message = self.getmessage(uid)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/IMAP.py", line 287, in getmessage\n    self.imapserver.releaseconnection(imapobj)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imapserver.py", line 173, in releaseconnection\n    self.assignedconnections.remove(connection)\n']
 ERROR: Syncing folder Informations.ml.lxc.users [acc: Kalysto]
  list.remove(x): x not in list
 ['  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 995, in syncmessagesto\n    action(dstfolder, statusfolder)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 864, in __syncmessagesto_copy\n    register = 0)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 775, in copymessageto\n    message = self.getmessage(uid)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/IMAP.py", line 287, in getmessage\n    self.imapserver.releaseconnection(imapobj)\n', '  File "/home/vaab/dev/python/offlineimap/offlineimap/imapserver.py", line 173, in releaseconnection\n    self.assignedconnections.remove(connection)\n']
 ERROR: ERROR in syncfolder for Kalysto folder Informations.ml.lxc.users: Traceback (most recent call last):
  File "/home/vaab/dev/python/offlineimap/offlineimap/accounts.py", line 567, in syncfolder
    remotefolder.syncmessagesto(localfolder, statusfolder)
  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 995, in syncmessagesto
    action(dstfolder, statusfolder)
  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 864, in __syncmessagesto_copy
    register = 0)
  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/Base.py", line 775, in copymessageto
    message = self.getmessage(uid)
  File "/home/vaab/dev/python/offlineimap/offlineimap/folder/IMAP.py", line 287, in getmessage
    self.imapserver.releaseconnection(imapobj)
  File "/home/vaab/dev/python/offlineimap/offlineimap/imapserver.py", line 173, in releaseconnection
    self.assignedconnections.remove(connection)
ValueError: list.remove(x): x not in list

  list.remove(x): x not in list
```


---
Reply to this email directly or view it on GitHub:
https://github.com/OfflineIMAP/offlineimap/issues/198#issuecomment-153275196
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.alioth.debian.org/pipermail/offlineimap-project/attachments/20151102/9fb599f2/attachment-0001.html>