[DRE-maint] Bug#732297: [feed2imap] IMAP errors, duplicate emails

[Ritesh Raj Sarraf]

Package: feed2imap
Version: 1.2.5-1
Followup-For: Bug #732297

I have run into the same problem. I am not sure if it creates duplicate
email entries but it for sure crashes half way through, leaving the rest
of the blog urls it was supposed to fetch from.

I think it would make sense to handle the exception and mark it
non-fatal. That way the program can run through the full list of blog
urls it is suppsed to fetch from.


rrs at priyasi:/var/tmp/Debian-Build/temp/$ feed2imap -vvvv
I, [2018-11-20T18:35:21.248720 #19124]  INFO -- : Feed2Imap V.1.2.5 started
I, [2018-11-20T18:35:21.248767 #19124]  INFO -- : Reading configuration file ...
I, [2018-11-20T18:35:21.250217 #19124]  INFO -- : Initializing cache ...
I, [2018-11-20T18:35:21.273172 #19124]  INFO -- : Connecting to IMAP accounts ...
I, [2018-11-20T18:35:21.273225 #19124]  INFO -- : Fetching and filtering feeds ...
I, [2018-11-20T18:35:22.787177 #19124]  INFO -- : Error while fetching https://www.stylesen.org/rss.xml: 503: Service Unavailable while fetching https://www.stylesen.org/rss.xml (failed 1 times)
I, [2018-11-20T18:35:52.183377 #19124]  INFO -- : Error while fetching http://kingsly.net/kingsly/static/feeds/rss.xml: Timeout while fetching http://kingsly.net/kingsly/static/feeds/rss.xml (failed 1 times)
I, [2018-11-20T18:35:54.558044 #19124]  INFO -- : Fetching feed The-Official-SMPlayer-Blog took 33s
I, [2018-11-20T18:36:15.880137 #19124]  INFO -- : Fetching feed KDE-Dot-News took 53s
I, [2018-11-20T18:36:15.880454 #19124]  INFO -- : Parsing and uploading ...
I, [2018-11-20T18:36:16.315978 #19124]  INFO -- : Libre-Graphics-World: 3 new items, 4 updated items.
/usr/lib/ruby/vendor_ruby/rmail/header.rb:142: warning: constant ::Fixnum is deprecated
/usr/lib/ruby/vendor_ruby/rmail/parser/pushbackreader.rb:84: warning: constant ::Fixnum is deprecated
/usr/lib/ruby/vendor_ruby/rmail/parser/pushbackreader.rb:105: warning: constant ::Fixnum is deprecated
F, [2018-11-20T18:39:15.249028 #19124] FATAL -- : Exception caught while uploading mail to /home/rrs/Maildir/.RSSS: invalid byte sequence in UTF-8
/usr/lib/ruby/vendor_ruby/feedparser/html2text-parser.rb:29:in `gsub!'
/usr/lib/ruby/vendor_ruby/feedparser/html2text-parser.rb:29:in `handle_data'
/usr/lib/ruby/vendor_ruby/feedparser/html2text-parser.rb:149:in `unknown_charref'
/usr/lib/ruby/vendor_ruby/feedparser/sgml-parser.rb:297:in `handle_charref'
/usr/lib/ruby/vendor_ruby/feedparser/sgml-parser.rb:126:in `goahead'
/usr/lib/ruby/vendor_ruby/feedparser/sgml-parser.rb:58:in `feed'
/usr/lib/ruby/vendor_ruby/feedparser/text-output.rb:10:in `html2text'
/usr/lib/ruby/vendor_ruby/feedparser/text-output.rb:75:in `to_text'
/usr/lib/ruby/vendor_ruby/feed2imap/itemtomail.rb:86:in `item_to_mail'
/usr/lib/ruby/vendor_ruby/feed2imap/feed2imap.rb:253:in `block (2 levels) in initialize'
/usr/lib/ruby/vendor_ruby/feed2imap/feed2imap.rb:251:in `each'
/usr/lib/ruby/vendor_ruby/feed2imap/feed2imap.rb:251:in `block in initialize'
/usr/lib/ruby/vendor_ruby/feed2imap/feed2imap.rb:223:in `each'
/usr/lib/ruby/vendor_ruby/feed2imap/feed2imap.rb:223:in `initialize'
/usr/bin/feed2imap:48:in `new'
/usr/bin/feed2imap:48:in `<main>'
F, [2018-11-20T18:39:15.249167 #19124] FATAL -- : We can't recover from IMAP errors, so we are exiting.
18:39 ♒♒♒    ☹ 😟=> 1  

-- System Information:
Debian Release: buster/sid
  APT prefers testing
  APT policy: (900, 'testing'), (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.18.0-2-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages feed2imap depends on:
ii  ruby             1:2.5.1
ii  ruby-feedparser  0.9.4-1
ii  ruby-rubymail    1.1.3-2

feed2imap recommends no packages.

Versions of packages feed2imap suggests:
ii  dovecot-imapd [imap-server]  1:2.3.3-1+b1
ii  evolution [imap-client]      3.30.2-1

-- no debconf information