[Python-modules-team] Bug#950072: python-asttokens FTBFS with Python 3.8 as supported version

[Adrian Bunk]

Source: python-asttokens
Version: 1.1.13-2
Severity: serious
Tags: ftbfs bullseye sid

https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/python-asttokens.html

...
======================================================================
ERROR: test_comprehensions (tests.test_astroid.TestAstroid)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/tests/test_mark_tokens.py", line 369, in test_comprehensions
    m = self.create_mark_checker(source)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/tests/test_astroid.py", line 15, in create_mark_checker
    return tools.MarkChecker(source, tree=tree)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/tests/tools.py", line 82, in __init__
    self.atok = asttokens.ASTTokens(source, parse=parse, tree=tree)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/asttokens.py", line 65, in __init__
    self.mark_tokens(self._tree)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/asttokens.py", line 76, in mark_tokens
    MarkTokens(self).visit_tree(root_node)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/mark_tokens.py", line 47, in visit_tree
    util.visit_tree(node, self._visit_before_children, self._visit_after_children)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/util.py", line 184, in visit_tree
    ret = postvisit(current, par_value, value)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/mark_tokens.py", line 90, in _visit_after_children
    nfirst, nlast = self._methods.get(self, node.__class__)(node, first, last)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/mark_tokens.py", line 175, in visit_listcomp
    return self.handle_comp('[', node, first_token, last_token)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/mark_tokens.py", line 171, in handle_comp
    util.expect_token(before, token.OP, open_brace)
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/asttokens/util.py", line 56, in expect_token
    raise ValueError("Expected token %s, got %s on line %s col %s" % (
ValueError: Expected token OP:'[', got ENDMARKER:'' on line 2 col 1
...
======================================================================
FAIL: test_walk_ast (tests.test_util.TestUtil)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build/tests/test_util.py", line 43, in test_walk_ast
    self.assertEqual(scan, [
AssertionError: Lists differ: ["Mod[202 chars]2', 'Constant:1', 'Constant:2', "BinOp:'hello'[95 chars]ld'"] != ["Mod[202 chars]2', 'Num:1', 'Num:2', "BinOp:'hello' + ', ' + [70 chars]ld'"]

First differing element 7:
'Constant:1'
'Num:1'

  ["Module:foo(bar(1 + 2), 'hello' + ', ' + 'world')",
   "Expr:foo(bar(1 + 2), 'hello' + ', ' + 'world')",
   "Call:foo(bar(1 + 2), 'hello' + ', ' + 'world')",
   'Name:foo',
   'Call:bar(1 + 2)',
   'Name:bar',
   'BinOp:1 + 2',
-  'Constant:1',
-  'Constant:2',
+  'Num:1',
+  'Num:2',
   "BinOp:'hello' + ', ' + 'world'",
   "BinOp:'hello' + ', '",
-  "Constant:'hello'",
-  "Constant:', '",
-  "Constant:'world'"]
+  "Str:'hello'",
+  "Str:', '",
+  "Str:'world'"]

----------------------------------------------------------------------
Ran 79 tests in 2.124s

FAILED (SKIP=1, errors=8, failures=11)
E: pybuild pybuild:341: test: plugin distutils failed with: exit code=1: cd /build/1st/python-asttokens-1.1.13/.pybuild/cpython3_3.8_asttokens/build; python3.8 -m nose -v tests
dh_auto_test: error: pybuild --test --test-nose -i python{version} -p "3.8 3.7" returned exit code 13
make: *** [debian/rules:6: build] Error 25