Bug#1092414: neovim: FTBFS: make[1]: *** [debian/rules:129: override_dh_auto_test-arch] Error 1

[Chris Hofstaedtler]

Hi James,

On Mon, Jan 13, 2025 at 08:20:52PM -0500, James McCoy wrote:
> This looks like typical flakiness that I see in the neovim tests.
> Downgrading the severity.

I see similar flakyness in the buildd logs on s390x and riscv64, and 
in the reproduce.debian.net logs, in these tests:

Failures: 
	From test_options.vim:
	Found errors in Test_shortmess_F3():
	command line..script /build/reproducible-path/neovim-0.10.4/test/old/testdir/runtest.vim[543]..function RunTheTest[55]..Test_shortmess_F3 line 19: Expected ['bar'] but got ['foo']
	command line..script /build/reproducible-path/neovim-0.10.4/test/old/testdir/runtest.vim[543]..function RunTheTest[55]..Test_shortmess_F3 line 29: Expected ['baz'] but got ['foo']


----

FAILED   1 test, listed below:
FAILED   test/functional/terminal/edit_spec.lua @ 38: :edit term://* runs TermOpen early enough to set buffer-local 'scrollback'
test/functional/terminal/edit_spec.lua:67: Row 1 did not match.
Expected:
  |*96: foobar          |
  |                    |
  |^[Process exited 0]  |
  |                    |
Actual:
  |*36: foobar          |
  |                    |
  |^[Process exited 0]  |
  |                    |

To print the expect() call that would assert the current screen state, use
screen:snapshot_util(). In case of non-deterministic failures, use
screen:redraw_debug() to show all intermediate screen states.

Snapshot:
screen:expect({
  grid = [[
    36: foobar          |
                        |
    ^[Process exited 0]  |
                        |
  ]]
})

stack traceback:
	test/functional/ui/screen.lua:850: in function '_wait'
	test/functional/ui/screen.lua:526: in function 'expect'
	test/functional/terminal/edit_spec.lua:67: in function <test/functional/terminal/edit_spec.lua:38>

---

FAILED   1 test, listed below:
FAILED   test/functional/ui/highlight_spec.lua @ 1350: CursorColumn highlight is updated if cursor is moved from timer
test/functional/ui/highlight_spec.lua:1362: Row 1 did not match.
Expected:
  |*aaaa{21:a}                                             |
  |*bbbb{21:b}                                             |
  |*cccc{21:c}                                             |
  |*dddd^d                                             |
  |{1:~                                                 }|
  |{1:~                                                 }|
  |{1:~                                                 }|
  |                                                  |
Actual:
  |*^aaaaa                                             |
  |*{21:b}bbbb                                             |
  |*{21:c}cccc                                             |
  |*{21:d}dddd                                             |
  |{1:~                                                 }|
  |{1:~                                                 }|
  |{1:~                                                 }|
  |                                                  |

To print the expect() call that would assert the current screen state, use
screen:snapshot_util(). In case of non-deterministic failures, use
screen:redraw_debug() to show all intermediate screen states.

Snapshot:
screen:expect({
  grid = [[
    ^aaaaa                                             |
    {21:b}bbbb                                             |
    {21:c}cccc                                             |
    {21:d}dddd                                             |
    {1:~                                                 }|*3
                                                      |
  ]]
})

stack traceback:
	test/functional/ui/screen.lua:850: in function '_wait'
	test/functional/ui/screen.lua:526: in function 'expect'
	test/functional/ui/highlight_spec.lua:1362: in function <test/functional/ui/highlight_spec.lua:1350>


For the tests which fail in `_wait`, maybe the timeouts could be increased.

Thanks,
Chris