[Python-apps-team] Bug#851630: beets: UnicodeDecodeError: 'utf8' codec can't decode

[Jameson Graef Rollins]

Package: beets
Version: 1.3.19-2
Severity: normal

Hello.  I haven't yet figured out what's causing it, but I'm getting
the followin exceptions during import:

Traceback (most recent call last):
  File "/usr/bin/beet", line 11, in <module>
    load_entry_point('beets==1.3.19', 'console_scripts', 'beet')()
  File "/usr/share/beets/beets/ui/__init__.py", line 1266, in main
    _raw_main(args)
  File "/usr/share/beets/beets/ui/__init__.py", line 1253, in _raw_main
    subcommand.func(lib, suboptions, subargs)
  File "/usr/share/beets/beets/ui/commands.py", line 967, in import_func
    import_files(lib, paths, query)
  File "/usr/share/beets/beets/ui/commands.py", line 944, in import_files
    session.run()
  File "/usr/share/beets/beets/importer.py", line 320, in run
    pl.run_parallel(QUEUE_SIZE)
  File "/usr/share/beets/beets/util/pipeline.py", line 251, in run
    msg = next(self.coro)
  File "/usr/share/beets/beets/importer.py", line 1202, in read_tasks
    for t in task_factory.tasks():
  File "/usr/share/beets/beets/importer.py", line 1038, in tasks
    for dirs, paths in self.paths():
  File "/usr/share/beets/beets/importer.py", line 1090, in paths
    for dirs, paths in albums_in_dir(self.toppath):
  File "/usr/share/beets/beets/importer.py", line 1480, in albums_in_dir
    logger=log):
  File "/usr/share/beets/beets/util/__init__.py", line 205, in sorted_walk
    for res in sorted_walk(cur, ignore, ignore_hidden, logger):
  File "/usr/share/beets/beets/util/__init__.py", line 205, in sorted_walk
    for res in sorted_walk(cur, ignore, ignore_hidden, logger):
  File "/usr/share/beets/beets/util/__init__.py", line 190, in sorted_walk
    if (ignore_hidden and not hidden.is_hidden(cur)) or not ignore_hidden:
  File "/usr/share/beets/beets/util/hidden.py", line 78, in is_hidden
    path = path.decode('utf-8')
  File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
    return codecs.utf_8_decode(input, errors, True)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xfc in position 80: invalid start byte

This causes the import to crash.

I'll try to see if I can narrow down what's exposing the bug.

Thanks for maintaining such a great program.

jamie.

-- System Information:
Debian Release: stretch/sid
  APT prefers testing
  APT policy: (600, 'testing'), (500, 'stable'), (200, 'unstable'), (101, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.8.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages beets depends on:
ii  libjs-backbone         1.3.3~dfsg-1
ii  libjs-jquery           3.1.1-2
ii  libjs-underscore       1.8.3~dfsg-1
ii  python-enum34          1.1.6-1
ii  python-munkres         1.0.8-1
ii  python-musicbrainzngs  0.6-2
ii  python-mutagen         1.36-1
ii  python-pkg-resources   32.0.0-1
ii  python-unidecode       0.04.19-1
ii  python-yaml            3.12-1
pn  python:any             <none>

beets recommends no packages.

Versions of packages beets suggests:
pn  beets-doc                 <none>
pn  libav-tools               <none>
pn  mp3gain                   <none>
pn  python-acoustid           <none>
ii  python-bs4                4.5.1-1
ii  python-dbus               1.2.4-1
ii  python-flask              0.12-1
ii  python-gst-1.0            1.10.2-1
ii  python-imaging            3.4.2-1
ii  python-mpd                0.5.5-2
pn  python-pathlib            <none>
pn  python-pylast             <none>
pn  python-rarfile            <none>
ii  python-requests           2.12.4-1
pn  python-requests-oauthlib  <none>
ii  python-xdg                0.25-4

-- no debconf information