[ci] Segfaults?

[EricCousineau-TRI]

See https://github.com/RobotLocomotion/drake-ros/actions/runs/9670843228

=================== Test output for //drake_ros:tf2_test:
...
drake_ros/test/tf2_test.py Fatal Python error: Segmentation fault
...
Extension modules: numpy._core._multiarray_umath, numpy._core._multiarray_tests, numpy.linalg._umath_linalg, tf2_py._tf2_py (total: 4)
...
//drake_ros:geometry_conversions_test                                    FAILED in 26.7s
//drake_ros:tf2_test                                                     FAILED in 25.2s
//drake_ros:viz_test                                                     FAILED in 27.1s

On my machine, I do not see these segfaults.

EDIT: Naive guess is that numpy gets upgraded by this (silly?) setup:
https://github.com/ros-tooling/setup-ros/blob/v0.4/src/setup-ros-linux.ts#L132-L138
https://github.com/ros-tooling/setup-ros/blob/v0.4/src/package_manager/pip.ts#L63

\cc @IanTheEngineer @calderpg-tri

[EricCousineau-TRI]

Per #363, something in ros-tooling/setup-ros seems like the culprit. Most likely the numpy upgrade.