🌐 AI搜索 & 代理 主页
Skip to content

[Bug]: Flaky tests with "Python 3.11 on ubuntu-22.04 (Minimum Versions)" #30882

@timhoffm

Description

@timhoffm

Bug summary

An number of times, I've seen a set of 15 tests fail; e.g. here https://github.com/matplotlib/matplotlib/actions/runs/20340944398/job/58439839528?pr=30600

FAILED lib/matplotlib/tests/test_axes.py::test_pcolor_log_scale[png] - matplo...
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[1-lims0-ticks0]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[2-lims1-ticks1]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[3-lims2-ticks2]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[9-lims3-ticks3]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[1-lims4-ticks4]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[2-lims5-ticks5]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[3-lims6-ticks6]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[9-lims7-ticks7]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[1-lims8-ticks8]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[3-lims10-ticks10]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[9-lims11-ticks11]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[1-lims12-ticks12]
FAILED lib/matplotlib/tests/test_ticker.py::test_small_range_loglocator[9-lims15-ticks15]
FAILED lib/mpl_toolkits/mplot3d/tests/test_axes3d.py::test_bar3d_notshaded[png]

Seems to be only in "Python 3.11 on ubuntu-22.04 (Minimum Versions)" - but not completely sure about that.

Actual outcome

Most of the failing tests are an assert_array_equal() failing with minimal numeric tolerance.

E           AssertionError: 
E           Arrays are not equal
E           
E           Mismatched elements: 1 / 3 (33.3%)
E           Max absolute difference: 1.38777878e-17
E           Max relative difference: 1.38777878e-16
E            x: array([1.e-01, 1.e+01, 1.e+03])
E            y: array([1.e-01, 1.e+01, 1.e+03])

Matplotlib Version

main

Metadata

Metadata

Assignees

No one assigned

    Labels

    CI: testingCI configuration and testing

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions