cafkafk/nixpkgs
cafkafk/nixpkgs
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 2

home-assistant: rerun tests failing with RuntimeError

Browse source 
The flakyness in home-assistant stems from premature event loop closing,
due to race conditions throughout the test suite.

> RuntimeError: Event loop is closed

They also happen during upstreams testsuite runs, but they silently
ignore them, so I don't expect a fix for them in the near future.

Alleviate our pains by rerunning tests that fail in this particular way.
This commit is contained in:
Martin Weinelt 2021-03-02 17:56:33 +01:00
parent 4e65797018
commit 598bc98ba1
No known key found for this signature in database
GPG key ID: 87C1E9888F856759
1 changed files with 5 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
pkgs/servers/home-assistant/default.nix
View file

@ -136,6 +136,7 @@ in with py.pkgs; buildPythonApplication rec {
# test infrastructure
asynctest
pytest-aiohttp
pytest-rerunfailures
pytest-xdist
pytestCheckHook
requests-mock
@ -292,7 +293,10 @@ in with py.pkgs; buildPythonApplication rec {
pytestFlagsArray = [
# limit amout of runners to reduce race conditions
"-n 2"
"-n auto"
# retry racy tests that end in "RuntimeError: Event loop is closed"
"--reruns 3"
"--only-rerun RuntimeError"
# assign tests grouped by file to workers
"--dist loadfile"
# tests are located in tests/