pyperformance icon indicating copy to clipboard operation
pyperformance copied to clipboard

macOS failing on GitHub Actions: test_pythoninfo.GetInfoTests

Open hugovk opened this issue 2 months ago • 1 comments

We should handle the directory issue on GA but as I commented let's create an issue and solve it separately.

FAIL: test_venv (test_pythoninfo.GetInfoTests.test_venv)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/runner/work/pyperformance/pyperformance/pyperformance/tests/test_pythoninfo.py", line 87, in test_venv
    self.assertEqual(vars(info), vars(expected))
AssertionError: {'sys[21 chars]le='/private/var/folders/24/8k48jl6d249_n_qfxw[1240 chars]r\n'} != {'sys[21 chars]le='/var/folders/24/8k48jl6d249_n_qfxwsl6xvm00[1216 chars]True}
  {'base_executable': '/Library/Frameworks/Python.framework/Versions/3.12/bin/python3.12',
   'executable_realpath': '/Library/Frameworks/Python.framework/Versions/3.12/bin/python3.12',
   'is_venv': True,
   'pyc_magic_number': b'\xcb\r\r\n',
   'stdlib_dir': '/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12',
-  'sys': namespace(executable='/private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv/bin/python3',
?                               --------

+  'sys': namespace(executable='/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv/bin/python3',
-                   prefix='/private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv',
-                   exec_prefix='/private/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv',
-                   _stdlib_dir='/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12',
                    _base_executable='/Library/Frameworks/Python.framework/Versions/3.12/bin/python3.12',
-                   base_prefix='/Library/Frameworks/Python.framework/Versions/3.12',
-                   base_exec_prefix='/Library/Frameworks/Python.framework/Versions/3.12',
                    version='3.12.0 (v3.12.0:0fb18b02c8, Oct  2 2023, 09:45:56) '
                            '[Clang 13.0.0 (clang-1300.0.29.30)]',
                    version_info=(3, 12, 0, 'final', 0),
                    hexversion=51118320,
                    api_version=1013,
                    implementation=namespace(name='cpython',
                                             version=(3, 12, 0, 'final', 0)),
-                   platform='darwin'),
?                                    -

+                   platform='darwin',
+                   prefix='/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv',
+                   exec_prefix='/var/folders/24/8k48jl6d249_n_qfxwsl6xvm0000gn/T/tmprglvf6f4/venv',
+                   base_prefix='/Library/Frameworks/Python.framework/Versions/3.12',
+                   base_exec_prefix='/Library/Frameworks/Python.framework/Versions/3.12',
+                   _stdlib_dir='/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12'),
   'sysconfig': namespace(paths=namespace(stdlib='/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12'),
                          is_python_build=False)}

In macOS, /var is a symlink to /private/var.

Originally posted by @corona10 in https://github.com/python/pyperformance/issues/320#issuecomment-1774012394

hugovk avatar Oct 24 '25 11:10 hugovk

Recent example on 3.14:

..........FFF..
======================================================================
FAIL: test_current (test_pythoninfo.GetInfoTests.test_current)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/runner/work/pyperformance/pyperformance/pyperformance/tests/test_pythoninfo.py", line 56, in test_current
    self.assertEqual(vars(info), vars(expected))
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: {'sys[84 chars]on', prefix='/Library/Frameworks/Python.framew[1215 chars]r\n'} != {'sys[84 chars]on', _base_executable='/Library/Frameworks/Pyt[1211 chars]alse}
- {'base_executable': '/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
?                                                                                   ----

+ {'base_executable': '/Library/Frameworks/Python.framework/Versions/3.14/bin/python',
   'executable_realpath': '/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
   'is_venv': False,
   'pyc_magic_number': b'+\x0e\r\n',
   'stdlib_dir': '/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14',
   'sys': namespace(executable='/Library/Frameworks/Python.framework/Versions/3.14/bin/python',
-                   prefix='/Library/Frameworks/Python.framework/Versions/3.14',
-                   exec_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
-                   _stdlib_dir='/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14',
                    _base_executable='/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
-                   base_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
-                   base_exec_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
                    version='3.14.0 (v3.14.0:ebf955df7a8, Oct  7 2025, 08:20:14) '
                            '[Clang 16.0.0 (clang-1600.0.26.6)]',
                    version_info=sys.version_info(major=3, minor=14, micro=0, releaselevel='final', serial=0),
                    hexversion=51249392,
                    api_version=1013,
                    implementation=namespace(name='cpython',
                                             version=sys.version_info(major=3, minor=14, micro=0, releaselevel='final', serial=0)),
-                   platform='darwin'),
?                                    -

+                   platform='darwin',
+                   prefix='/Library/Frameworks/Python.framework/Versions/3.14',
+                   exec_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/runner/work/pyperformance/pyperformance/pyperformance/tests/test_pythoninfo.py", line 86, in test_venv
    self.assertEqual(vars(info), vars(expected))
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: {'sys[21 chars]le='/private/var/folders/q0/wmf37v850txck86cpn[1239 chars]r\n'} != {'sys[21 chars]le='/var/folders/q0/wmf37v850txck86cpnvwm_zw00[1215 chars]True}
  {'base_executable': '/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
   'executable_realpath': '/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
   'is_venv': True,
   'pyc_magic_number': b'+\x0e\r\n',
   'stdlib_dir': '/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14',
-  'sys': namespace(executable='/private/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv/bin/python3',
?                               --------

+  'sys': namespace(executable='/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv/bin/python3',
-                   prefix='/private/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv',
-                   exec_prefix='/private/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv',
-                   _stdlib_dir='/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14',
                    _base_executable='/Library/Frameworks/Python.framework/Versions/3.14/bin/python3.14',
-                   base_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
-                   base_exec_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
                    version='3.14.0 (v3.14.0:ebf955df7a8, Oct  7 2025, 08:20:14) '
                            '[Clang 16.0.0 (clang-1600.0.26.6)]',
                    version_info=(3, 14, 0, 'final', 0),
                    hexversion=51249392,
                    api_version=1013,
                    implementation=namespace(name='cpython',
                                             version=(3, 14, 0, 'final', 0)),
-                   platform='darwin'),
?                                    -

+                   platform='darwin',
+                   prefix='/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv',
+                   exec_prefix='/var/folders/q0/wmf37v850txck86cpnvwm_zw0000gn/T/tmpwopvtgmd/venv',
+                   base_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
+                   base_exec_prefix='/Library/Frameworks/Python.framework/Versions/3.14',
+                   _stdlib_dir='/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14'),
   'sysconfig': namespace(paths=namespace(stdlib='/Library/Frameworks/Python.framework/Versions/3.14/lib/python3.14'),
                          is_python_build=False)}

https://github.com/python/pyperformance/actions/runs/18777328410/job/53574859676

hugovk avatar Oct 24 '25 11:10 hugovk