<DKIM> Error when uploading to Gmail: reader socket error: <type 'exceptions.IOError'> Too many read 0

Sean Hammond offlineimap-project at snhmnd.fastmail.com
Sat Sep 10 19:35:20 BST 2016 

Thanks Nicolas, here's the info:

Ubuntu 16.04

Offlineimap 6.7.0.1

Python 2.7.12

The IMAP server that I'm trying to upload to is imap.gmail.com:993

The offlineimap command that I'm running is:

    ~/offlineimap/offlineimap.py -a me at gmail.com -d imap,maildir,thread

Here's my ~/.offlineimaprc file:

    [general]
    accounts = me at gmail.com
    
    [Account me at gmail.com]
    localrepository = me at gmail.com:local
    remoterepository = me at gmail.com:remote
    
    [Repository me at gmail.com:local]
    type = GmailMaildir
    localfolders = ~/Mail/me at gmail.com
    status_backend = sqlite
    readonly = True
    
    [Repository me at gmail.com:remote]
    type = Gmail
    remoteuser = me at gmail.com
    remotepass = ***
    sslcacertfile = /etc/ssl/certs/ca-certificates.crt

I'm not using any pythonfile.

The entire stderr from running this command is 800MB, but there are the
last 100 lines:

imap.gmail.com reader:
 [imap]:   33:59.91 imap.gmail.com reader poll => []
 [imap]:   34:29.94 imap.gmail.com reader poll => []
 [imap]:   34:59.97 imap.gmail.com reader poll => []
 [imap]:   35:29.99 imap.gmail.com reader poll => []
 [imap]:   36:00.02 imap.gmail.com reader poll => []
 [imap]:   36:30.04 imap.gmail.com reader poll => []
 [imap]:   37:00.04 imap.gmail.com reader poll => []
 [imap]:   37:30.06 imap.gmail.com reader poll => []
 [imap]:   38:00.08 imap.gmail.com reader poll => []
 [imap]:   38:30.11 imap.gmail.com reader poll => []
 [imap]:   39:00.13 imap.gmail.com reader poll => []
 [imap]:   39:30.15 imap.gmail.com reader poll => []
 [imap]:   40:00.18 imap.gmail.com reader poll => []
 [imap]:   40:30.20 imap.gmail.com reader poll => []
 [imap]:   41:00.21 imap.gmail.com reader poll => []
 [imap]:   41:30.24 imap.gmail.com reader poll => []
 [imap]:   42:00.26 imap.gmail.com reader poll => []
 [imap]:   42:30.29 imap.gmail.com reader poll => []
 [imap]:   43:00.32 imap.gmail.com reader poll => []
 [imap]:   43:30.35 imap.gmail.com reader poll => []
 [imap]:   44:00.38 imap.gmail.com reader poll => []
 [imap]:   44:30.39 imap.gmail.com reader poll => []
 [imap]:   45:00.42 imap.gmail.com reader poll => []
 [imap]:   45:30.44 imap.gmail.com reader poll => []
 [imap]:   46:00.47 imap.gmail.com reader poll => []
 [imap]:   46:30.50 imap.gmail.com reader poll => []
 [imap]:   47:00.52 imap.gmail.com reader poll => []
 [imap]:   47:30.55 imap.gmail.com reader poll => []
 [imap]:   48:00.58 imap.gmail.com reader poll => []
 [imap]:   48:30.62 imap.gmail.com reader poll => []
 [imap]:   49:00.63 imap.gmail.com reader poll => []
 [imap]:   49:30.64 imap.gmail.com reader poll => []
 [imap]:   50:00.66 imap.gmail.com reader poll => []
 [imap]:   50:30.69 imap.gmail.com reader poll => []
 [imap]:   51:00.70 imap.gmail.com reader poll => []
 [imap]:   51:30.73 imap.gmail.com reader poll => []
 [imap]:   52:00.74 imap.gmail.com reader poll => []
 [imap]:   52:30.77 imap.gmail.com reader poll => []
 [imap]:   53:00.80 imap.gmail.com reader poll => []
 [imap]:   53:30.81 imap.gmail.com reader poll => []
 [imap]:   54:00.82 imap.gmail.com reader poll => []
 [imap]:   54:30.85 imap.gmail.com reader poll => []
 [imap]:   55:00.89 imap.gmail.com reader poll => []
 [imap]:   55:30.89 imap.gmail.com reader poll => []
 [imap]:   56:00.92 imap.gmail.com reader poll => []
 [imap]:   56:30.94 imap.gmail.com reader poll => []
 [imap]:   57:00.96 imap.gmail.com reader poll => []
 [imap]:   57:30.98 imap.gmail.com reader poll => []
 [imap]:   58:01.02 imap.gmail.com reader poll => []
 [imap]:   58:31.03 imap.gmail.com reader poll => []
 [imap]:   59:01.06 imap.gmail.com reader poll => []
 [imap]:   59:31.10 imap.gmail.com reader poll => []
 [imap]:   00:01.11 imap.gmail.com reader poll => []
 [imap]:   00:31.12 imap.gmail.com reader poll => []
 [imap]:   01:01.14 imap.gmail.com reader poll => []
 [imap]:   01:31.17 imap.gmail.com reader poll => []
 [imap]:   02:01.20 imap.gmail.com reader poll => []
 [imap]:   02:31.21 imap.gmail.com reader poll => []
 [imap]:   03:01.23 imap.gmail.com reader poll => []
 [imap]:   03:29.89 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:29.89 imap.gmail.com reader rcvd 0
 [imap]:   03:29.99 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:29.99 imap.gmail.com reader rcvd 0
 [imap]:   03:30.09 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:30.09 imap.gmail.com reader rcvd 0
 [imap]:   03:30.19 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:30.19 imap.gmail.com reader rcvd 0
 [imap]:   03:30.29 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:30.29 imap.gmail.com reader rcvd 0
 [imap]:   03:30.39 imap.gmail.com reader poll => [(5, 1)]
 [imap]:   03:30.39 imap.gmail.com reader rcvd 0
 [imap]:   03:30.39 imap.gmail.com reader last 20 log messages:
 [imap]:   33:13.47 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [sync] APPEND ('Migrated/INBOX/Archive/me at googlemail^com/Archive',
 '()', '"26-Jul-2016 19:25:11 +0100"')
 [imap]:   33:16.51 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [async] CHECK ()
 [imap]:   33:16.68 Folder sms/Trash [acc: me at gmail.com] [sync] SELECT
 ('sms/Trash',)
 [imap]:   33:16.90 Folder sms/Trash [acc: me at gmail.com] state =>
 SELECTED
 [imap]:   33:16.90 Folder sms/Trash [acc: me at gmail.com] [sync] EXAMINE
 ('sms/Trash',)
 [imap]:   33:17.06 Folder sms/Trash [acc: me at gmail.com] state =>
 SELECTED
 [imap]:   33:17.06 Folder sms/Trash [acc: me at gmail.com] [async] FETCH
 ("'1:*'", '(FLAGS UID INTERNALDATE)')
 [imap]:   33:17.53 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [sync] SELECT ('Migrated/INBOX/Archive/me at googlemail^com/Archive',)
 [imap]:   33:20.00 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 state => SELECTED
 [imap]:   33:20.01 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [sync] APPEND ('Migrated/INBOX/Archive/me at googlemail^com/Archive',
 '()', '"26-Jul-2016 19:25:16 +0100"')
 [imap]:   33:23.15 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [async] CHECK ()
 [imap]:   33:23.32 Folder me at googlemail.com [acc: me at gmail.com] [sync]
 SELECT ('me at googlemail.com',)
 [imap]:   33:23.54 Folder me at googlemail.com [acc: me at gmail.com] state
 => SELECTED
 [imap]:   33:23.54 Folder me at googlemail.com [acc: me at gmail.com] [sync]
 EXAMINE ('me at googlemail.com',)
 [imap]:   33:23.70 Folder me at googlemail.com [acc: me at gmail.com] state
 => SELECTED
 [imap]:   33:23.70 Folder me at googlemail.com [acc: me at gmail.com] [async]
 FETCH ("'1:*'", '(FLAGS UID INTERNALDATE)')
 [imap]:   33:24.27 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [sync] SELECT ('Migrated/INBOX/Archive/me at googlemail^com/Archive',)
 [imap]:   33:26.70 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 state => SELECTED
 [imap]:   33:26.70 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [sync] APPEND ('Migrated/INBOX/Archive/me at googlemail^com/Archive',
 '()', '"26-Jul-2016 19:24:20 +0100"')
 [imap]:   33:29.74 Folder
 Migrated/INBOX/Archive/me at googlemail^com/Archive [acc: me at gmail.com]
 [async] CHECK ()
 [imap]:   03:30.40 imap.gmail.com reader socket error: <type
 'exceptions.IOError'> - Too many read 0
 [imap]:   03:30.40 imap.gmail.com reader finished
imap.gmail.com handler:
 [imap]:   03:30.40 imap.gmail.com handler terminating: "socket error:
 <type 'exceptions.IOError'> - Too many read 0"
 [imap]:   03:30.40 imap.gmail.com handler state_change_free.set
 [imap]:   03:30.40 imap.gmail.com handler finished
imap.gmail.com writer:
 [imap]:   03:30.40 imap.gmail.com writer finished



On Fri, 9 Sep 2016, at 08:12 PM, Nicolas Sebrecht wrote:
> On Fri, Sep 09, 2016 at 06:53:26PM +0100, Sean Hammond wrote:
> > Hi, I'm having problem uploading a large local maildir to my gmail
> > account with offlineimap. It always gets to message 177 and then just
> > freezes. When I run it with -d imap,maildir,thread then a couple of the
> > last messages I see, before offlineimap stops doing anything and just
> > sits there, are:
> > 
> > imap.gmail.com reader socket error: <type 'exceptions.IOError'> - Too
> > many read 0
> > 
> > and:
> > 
> > imap.gmail.com handler terminating: "socket error: <type
> > 'exceptions.IOError'> - Too many read 0"
> > 
> > Any idea what the problem could be? Is the maildir folder simply too
> > big?
> 
> Provide the following information:
> - system/distribution (with version)
> - offlineimap version (`offlineimap -V`)
> - Python version
> - server name or domain
> - CLI options
> - Configuration file (offlineimaprc)
> - pythonfile (if any)
> - Logs
> 
> 
> -- 
> Nicolas Sebrecht

More information about the OfflineIMAP-project mailing list