Bug#724610: Acknowledgement (incrementally updated databases eventually become corrupt)

[Joey Hess]

Here is a cleaner reproduction of this.

I ran attached foo.pl once. I hit ctrl-c after a few seconds.
xapian-check reported the db was ok, and all on the same base.

I ran:

while xapian-check foo; do perl foo.pl & sleep 10s; kill -9 %1; done

This failed in under 2 minutes. Result:

record:
baseA blocksize=8K items=50000 lastblock=589 revision=30 levels=1 root=6
B-tree checked okay
record table structure checked OK

termlist:
baseA blocksize=8K items=50000 lastblock=359 revision=30 levels=1 root=5
B-tree checked okay
termlist table structure checked OK

postlist:
baseB blocksize=8K items=299962 lastblock=1936 revision=31 levels=2 root=24
B-tree checked okay
document id 50001 in doclen stream is larger than get_last_docid() 50000
document id 50001: length 7 doesn't match 0 in the termlist table
document id 50002 in doclen stream is larger than get_last_docid() 50000
document id 50002: length 7 doesn't match 0 in the termlist table
document id 50003 in doclen stream is larger than get_last_docid() 50000
...
document id 59998 in doclen stream is larger than get_last_docid() 50000
document id 59998: length 7 doesn't match 0 in the termlist table
document id 59999 in doclen stream is larger than get_last_docid() 50000
document id 59999: length 7 doesn't match 0 in the termlist table
document id 60000 in doclen stream is larger than get_last_docid() 50000
document id 60000: length 7 doesn't match 0 in the termlist table
postlist table errors found: 20000

position:
baseB blocksize=8K items=180000 lastblock=483 revision=31 levels=1 root=319
B-tree checked okay
position table structure checked OK

spelling:
Lazily created, and not yet used.

synonym:
Lazily created, and not yet used.

Total errors found: 20000


Archive of complete database: http://tmp.kitenet.net/xapian-1.tar.bz2

-- 
see shy jo
-------------- next part --------------
A non-text attachment was scrubbed...
Name: foo.pl
Type: text/x-perl
Size: 640 bytes
Desc: not available
URL: <http://lists.alioth.debian.org/pipermail/pkg-perl-maintainers/attachments/20130925/6530c669/attachment-0001.pl>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 828 bytes
Desc: Digital signature
URL: <http://lists.alioth.debian.org/pipermail/pkg-perl-maintainers/attachments/20130925/6530c669/attachment-0001.sig>