Problem syncing from Yahoo! to Zarafa IMAP

Abdó Roig-Maranges abdo.roig at gmail.com
Tue Jan 6 13:25:17 UTC 2015


Hi,

The relevant piece of code has changed since v6.5.6. It would be helpful if this
could be tested with current git master branch:

https://github.com/OfflineIMAP/offlineimap

Some guesses regarding the cause:

1) the raw message starts with two newlines before the headers.

2) there is only one newline separating headers and content in the raw message.

3) It is newline-style related. The raw messages uses windows-style newlines,
   while offlineimap expects unix-style. If this were the case, I think this may
   be fixed in current master branch.

Could you check whether 1 or 2 happen, or whether the problem still exists in
current master branch?

Abdó.


Nicolas Sebrecht writes:

>   Hi guys,
>
> It looks like the Base.py:addmessageheader() method is mangling the
> headers.
>
> Could you have a look, please? I'm still developing the subtle Unicode
> support feature which eats my time.
>
> Thanks,
>
> On Sun, Jan 04, 2015 at 06:57:37PM -0600, Matthew T. Gibbs wrote:
>> On Sunday, January 04, 2015 13:01:30 Nicolas Sebrecht wrote:
>> > On Sat, Jan 03, 2015 at 08:55:49PM -0600, Matthew T. Gibbs wrote:
>> > > Hi Nicolas-
>> > > 
>> > > Thank you for replying.  I ran offlineimap with the -d ALL option but I'm
>> > > not sure what I'm looking for.  I didn't see anything apparent that was
>> > > an error.
>> > Right. Errors might not all be handled and could be silent errors.
>> > 
>> > > I've attached part of the log, with usernames/passwords omitted, with a
>> > > message that is copied from Yahoo to Zarafa.  As far as I can tell, all of
>> > > the messaged copied show up in Zarafa with the correct header information
>> > > missing.
>> > Fine! I need your help because I'm missing of time. Could you review the
>> > messages from this logs and point what are the missing headers for each
>> > mail, please?
>> > 
>> > Resquested model:
>> > 
>> > --------------
>> > Headers OK:
>> >   -
>> >   -
>> > 
>> > Missing Headers:
>> >   -
>> >   -
>> > 
>> > Mail content:
>> > <...>
>> > --------------
>> 
>> I'm having a hard time figuring out what's what in the log.
>
> Yeah, they are developers ioriented and process time written. Definetly
> not user-friendly.
>
>>                                                              Here is an 
>> example from the mail client:
>> 
>> - Headers from a good message (pre- update):
>> 
>> X-Apparently-To: mtgibbs at yahoo.com; Wed, 17 Dec 2014 12:01:14 +0000
>> Return-Path: <kdepim-users-bounces at kde.org>
>> Received-SPF: pass (domain of kde.org designates 46.4.96.248 as permitted 
>> sender)
>> X-YMailISG: rT3AAGoWLDuoLvKFkDf_uS7IyXg76sE8j86nZigsXrYwFR88
>>  cdXJKK.iAoiaa2RfsONF_e3ngT.xwuc_9xGLec.Pw24dFTkNtusfGK7IeNut
>>  G8NnLDr8eMi<snip>
>> X-Originating-IP: [46.4.96.248]
>> Authentication-Results: mta1344.mail.bf1.yahoo.com  from=kde.org; 
>> domainkeys=neutral (no sig);  from=kde.org; dkim=pass (ok)
>> Received: from 127.0.0.1  (EHLO postbox.kde.org) (46.4.96.248)
>>   by mta1344.mail.bf1.yahoo.com with SMTPS; Wed, 17 Dec 2014 12:01:13 +0000
>> Received: from postbox.kde.org (localhost [IPv6:::1])
>> 	by postbox.kde.org (Postfix) with ESMTP id 044C51A2EB4;
>> 	Wed, 17 Dec 2014 12:01:10 +0000 (UTC)
>> DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=kde.org; s=default;
>> 	t=1418817672; bh=bqTyvUikoze+IlMJOzfwkl/v0JT+PKB/KbKNHCB5l7M=;
>> 	h=Content-Type:MIME-Version:From:Subject:To:Reply-To:Date:
>> 	 Message-ID:List-Id:List-Unsubscribe:List-Post:List-Help:
>> 	 List-Subscribe:Sender; b=bR6bGGhOiI5/laZvquknkT+KoOXY7Cqb+uxl7Fkkj
>> 	Hn/x0c8XrXNm/1FMaFybJMDoIMSf+OzNLPPvOYz7LLMHtPNK27XDrR5oFkkmjFTFj0A
>> 	6tXdRrdnOwSWa53faBZALaJjIdprqTjtfKiRtRph/K0oIj3kuprvyuXTiKzAGKc=
>> Content-Type: multipart/mixed; boundary="===============8509997736553324830=="
>> MIME-Version: 1.0
>> From: kdepim-users-request at kde.org
>> Subject: kdepim-users Digest, Vol 133, Issue 12
>> To: kdepim-users at kde.org
>> Reply-To: kdepim-users at kde.org
>> Date: Wed, 17 Dec 2014 12:00:12 +0000
>> Message-ID: <mailman.46.1418817612.17226.kdepim-users at kde.org>
>> X-BeenThere: kdepim-users at kde.org
>> X-Mailman-Version: 2.1.14
>> Precedence: list
>> List-Id: For discussion about KDE PIM applications <kdepim-users.kde.org>
>> List-Unsubscribe: <https://mail.kde.org/mailman/options/kdepim-users>,
>>  <mailto:kdepim-users-request at kde.org?subject=unsubscribe>
>> List-Post: <mailto:kdepim-users at kde.org>
>> List-Help: <mailto:kdepim-users-request at kde.org?subject=help>
>> List-Subscribe: <https://mail.kde.org/mailman/listinfo/kdepim-users>,
>>  <mailto:kdepim-users-request at kde.org?subject=subscribe>
>> Errors-To: kdepim-users-bounces at kde.org
>> Sender: kdepim-users-bounces at kde.org
>> Content-Length: 2466
>> X-OfflineIMAP: 3561118150-5130404801
>> 
>> 
>> - Headers from a bad message (post- update):
>> 
>> X-OfflineIMAP: 2147287767-5436506290
>> 
>> However, all of the other headers show up in the body of the message.
>
> Very good info.
>
>> This is the only thing I can find in the log that seems like a clue:
>> 
>> where addmessageheader: headers =''
>
> And another one. ,-)
>
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:Inbox 
>> _untagged_response(OK, ?, SEARCH) => ['129022']
>> 2015-01-03 16:56:49 DEBUG: [imap]: __savemessage_searchforheader got initial 
>> matchinguids: '129022'
>> 2015-01-03 16:56:49 DEBUG: [imap]: __savemessage_searchforheader: matchinguids 
>> now ['129022']
>> 2015-01-03 16:56:49 DEBUG: [imap]: savemessage: returning new UID 129022
>> 2015-01-03 16:56:49 DEBUG: [imap]: savemessage: header is: X-OfflineIMAP: 
>> 2147287767-5436506290
>> 2015-01-03 16:56:49 DEBUG: []: addmessageheader: called to add X-OfflineIMAP: 
>> 2147287767-5436506290
>> 2015-01-03 16:56:49 DEBUG: []: addmessageheader: insertionpoint = 0
>> -> 2015-01-03 16:56:49 DEBUG: []: addmessageheader: headers = ''
>> 2015-01-03 16:56:49 DEBUG: []: addmessageheader: new_header = 'X-OfflineIMAP: 
>> 2147287767-5436506290\n\n'
>> 2015-01-03 16:56:49 DEBUG: [imap]: savemessage: date: "31-Dec-2014 06:00:11 
>> -0600", content: 'X-OfflineIMAP: 2147287767-5436506290
>> 
>> X-Apparently-To: mtgibbs at yahoo.com; Wed, 31 Dec 2014 12:01:00 +0000
>> Return-Path: <kdepim-users-bounces at kde.org>...sers
>> 
>> --===============2447077718175636248==--
>> '
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:kdepim-
>> users [sync] SELECT ('kdepim-users',)
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:kdepim-
>> users state_change_pending.acquire
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:kdepim-
>> users _request_push(IGDB105, SELECT, {}) = IGDB105
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:kdepim-
>> users data=IGDB105 SELECT kdepim-users
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 Copy message from Yahoo:kdepim-
>> users SELECT:IGDB105.ready.wait
>> 2015-01-03 16:56:49 DEBUG: [imap]:   56:49.12 localhost writer > IGDB105 
>> SELECT kdepim-users\r\n
>> 
>> Thank you,
>> 
>> Matt




More information about the OfflineIMAP-project mailing list