[Python-modules-team] Bug#743315: python-scrapy 0.22 requires newer python-w3lib

[Maximilian Judtmann]

Package: python-scrapy
Version: 0.22.2-1
Severity: grave
Justification: renders package unusable

The current version of python-w3lib in Sid is 1.0-1.

python-scrapy 0.22 uses the module w3lib.encode that was added in
python-w3lib
1.1.

maix at medusa:~$ scrapy
Traceback (most recent call last):
  File "/usr/bin/scrapy", line 3, in <module>
    from scrapy.cmdline import execute
  File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 9, in
<module>
    from scrapy.crawler import CrawlerProcess
  File "/usr/lib/python2.7/dist-packages/scrapy/crawler.py", line 5, in
<module>
    from scrapy.core.engine import ExecutionEngine
  File "/usr/lib/python2.7/dist-packages/scrapy/core/engine.py", line 14, in
<module>
    from scrapy.core.downloader import Downloader
  File
"/usr/lib/python2.7/dist-packages/scrapy/core/downloader/__init__.py",
line 13, in <module>
    from .middleware import DownloaderMiddlewareManager
  File
"/usr/lib/python2.7/dist-packages/scrapy/core/downloader/middleware.py",
line 7, in <module>
    from scrapy.http import Request, Response
  File "/usr/lib/python2.7/dist-packages/scrapy/http/__init__.py", line
15, in
<module>
    from scrapy.http.response.html import HtmlResponse
  File "/usr/lib/python2.7/dist-packages/scrapy/http/response/html.py",
line 8,
in <module>
    from scrapy.http.response.text import TextResponse
  File "/usr/lib/python2.7/dist-packages/scrapy/http/response/text.py",
line 8,
in <module>
    from w3lib.encoding import html_to_unicode, resolve_encoding, \
ImportError: No module named encoding
maix at medusa:~$ scrapy genspider -l
Traceback (most recent call last):
  File "/usr/bin/scrapy", line 3, in <module>
    from scrapy.cmdline import execute
  File "/usr/lib/python2.7/dist-packages/scrapy/cmdline.py", line 9, in
<module>
    from scrapy.crawler import CrawlerProcess
  File "/usr/lib/python2.7/dist-packages/scrapy/crawler.py", line 5, in
<module>
    from scrapy.core.engine import ExecutionEngine
  File "/usr/lib/python2.7/dist-packages/scrapy/core/engine.py", line 14, in
<module>
    from scrapy.core.downloader import Downloader
  File
"/usr/lib/python2.7/dist-packages/scrapy/core/downloader/__init__.py",
line 13, in <module>
    from .middleware import DownloaderMiddlewareManager
  File
"/usr/lib/python2.7/dist-packages/scrapy/core/downloader/middleware.py",
line 7, in <module>
    from scrapy.http import Request, Response
  File "/usr/lib/python2.7/dist-packages/scrapy/http/__init__.py", line
15, in
<module>
    from scrapy.http.response.html import HtmlResponse
  File "/usr/lib/python2.7/dist-packages/scrapy/http/response/html.py",
line 8,
in <module>
    from scrapy.http.response.text import TextResponse
  File "/usr/lib/python2.7/dist-packages/scrapy/http/response/text.py",
line 8,
in <module>
    from w3lib.encoding import html_to_unicode, resolve_encoding, \
ImportError: No module named encoding


Please version bump python-w3lib (ideally to 1.5) and add the version to the
dependency.

Best regards,
Max



-- System Information:
Debian Release: jessie/sid
  APT prefers testing
  APT policy: (990, 'testing'), (500, 'unstable'), (500, 'stable'), (1,
'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.13.4-medusa (SMP w/4 CPU cores; PREEMPT)
Locale: LANG=en_GB.utf8, LC_CTYPE=en_GB.utf8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages python-scrapy depends on:
ii  python                2.7.5-5
ii  python-boto           2.27.0-1
ii  python-libxml2        2.9.1+dfsg1-3
ii  python-twisted-conch  1:13.2.0-1
ii  python-twisted-core   13.2.0-1
ii  python-twisted-mail   13.2.0-1
ii  python-twisted-web    13.2.0-1
ii  python-w3lib          1.0-1

Versions of packages python-scrapy recommends:
ii  ipython          1.2.1-2
ii  python-django    1.6.1-2
pn  python-guppy     <none>
ii  python-imaging   2.3.0-2
ii  python-lxml      3.3.2-1
ii  python-mysqldb   1.2.3-2
ii  python-pygments  1.6+dfsg-1

Versions of packages python-scrapy suggests:
ii  python-openssl  0.13.1-2

-- no debconf information