Automated tests using dovecot

[Sebastian Spaeth]

Hi,

first of all, let me say this is fantastic work and exactly what is
needed to get me to really, really trust oflineimap with my mail. We
should definitely accept this and build upon it. That having said, the
bash-based testing syntax is certainly weird if you are not used to it :).

+1 from me. It will require some more fiddling to avoid hard-coded paths
in dovecot.conf.template, no idea how that would be possible.

On Tue, 07 Jun 2011 17:55:21 -0400, Ethan Glasser-Camp wrote:
> On 06/06/2011 10:28 AM, Sebastian Spaeth wrote:
> > Any pointers as to how get going for those not used to the test suite (I
> > see it was pulled from notmuch the mail indexer :-))?
> >
> 
> Run "basic" instead of "test-lib.sh".

OK, I had to fiddle with some hard coded paths and the password file
settings to get it up and running, but got it in the end. 

My first improvement suggestion is that you attempt to locate the path
of "dovecot" with "which" and attempt "/usr/sbin/dovecot" if that did
not work out. I do not have that path in my regular search path as
normal user and it failed to invoke dovecot (basically without any
sensible error message).

This is the output I got (some PASS and 2 weird FAIL with error messages):

-------------------------------------------------------------
basic: Testing Simple test of offlineimap sync
 PASS   sanity check
 FIXED  offlineimap bails when config file missing
 PASS   sync some mail -- zero at first
 OfflineIMAP 6.3.4-rc1
Copyright (C) 2002 - 2010 John Goerzen <john at complete.org>

This software comes with ABSOLUTELY NO WARRANTY; see the file
COPYING for details.  This is free software, and you are welcome
to distribute it under the conditions laid out in COPYING.
Account sync Test:
 ***** Processing account Test
 Copying folder structure from IMAP to Maildir
 Establishing connection to localhost:10143.
Folder sync [Test]:
 Syncing INBOX: IMAP -> Maildir
Copy message 1 from INBOX:
 Copy message 1 IMAP[INBOX] -> Maildir[INBOX]
Account sync Test:
 ***** Finished processing account Test
 PASS   sync some mail -- got a mail
 PASS   sync some mail -- mail is unread
 PASS   sync some mail -- mail is unread on remote
 PASS   sync some mail -- no read mail
 FAIL   test suite can mark a message as read
        --- basic.8.expected	2011-06-08 15:05:13.004041250 +0000
        +++ basic.8.output	2011-06-08 15:05:13.004041250 +0000
        @@ -1 +1 @@
        -0
        +1
./test-lib.sh: line 643: [: cur: integer expression expected
mv: cannot stat `test-maildir/INBOX/cur/*,': No such file or directory
 FAIL   read flags are synced
        --- basic.9.expected	2011-06-08 15:05:13.384041251 +0000
        +++ basic.9.output	2011-06-08 15:05:13.384041251 +0000
        @@ -1 +1 @@
        -0
        +1
 OfflineIMAP 6.3.4-rc1
Copyright (C) 2002 - 2010 John Goerzen <john at complete.org>

This software comes with ABSOLUTELY NO WARRANTY; see the file
COPYING for details.  This is free software, and you are welcome
to distribute it under the conditions laid out in COPYING.
Account sync Test:
 ***** Processing account Test
 Copying folder structure from IMAP to Maildir
 Establishing connection to localhost:10143.
Folder sync [Test]:
 Syncing INBOX: IMAP -> Maildir
Account sync Test:
 ***** Finished processing account Test
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: not available
URL: <http://alioth-lists.debian.net/pipermail/offlineimap-project/attachments/20110608/bc28e127/attachment-0001.sig>