(partial) EasyBuild log for failed build of /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.1-foss-2025b-CUDA-12.9.1.eb (PR(s) #24926)

PyTorch-2.9.1-foss-2025b-CUDA-12.9.1_partial.log

== 2025-12-21 19:04:48,024 easyconfig.py:1833 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1', cuda_cc_cmake='90', cuda_cc_nvhpc='cc90', cuda_cc_semicolon_sep='9.0', cuda_cc_space_sep='9.0', cuda_cc_space_sep_no_period='90', cuda_compute_capabilities='9.0', cuda_int_comma_sep='90', cuda_int_semicolon_sep='90', cuda_int_space_sep='90', cuda_sm_comma_sep='sm_90', cuda_sm_space_sep='sm_90', cudamajver='12', cudaminver='9', cudashortver='12.9', cudaver='12.9.1', github_account='pytorch', installdir='/data/horse/ws/s3248973-EasyBuild/easybuild-genoa/software/PyTorch/2.9.1-foss-2025b-CUDA-12.9.1', module_name='PyTorch/2.9.1-CUDA-12.9.1', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='56', pymajver='3', pyminver='13', pyshortver='3.13', pyver='3.13.5', rpath_enabled='false', software_commit='', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2025b', version='2.9.1', version_major='2', version_major_minor='2.9', version_major_minor_patch='2.9.1', version_minor='9', version_minor_patch='9.1', version_patch='1', versionprefix='', versionsuffix='-CUDA-12.9.1'
== 2025-12-21 19:04:48,024 easyblock.py:4765 INFO Running method extract_step part of step extract
== 2025-12-21 19:04:48,024 easyblock.py:2875 INFO Unpacking source pytorch-v2.9.1.tar.gz
== 2025-12-21 19:04:48,034 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'tar ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/tar-5e1b7lbv/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/tar-5e1b7lbv/out.txt
== 2025-12-21 19:04:48,035 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:48,035 run.py:518 INFO Running 'tar ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1:
	tar xzf /data/horse/ws/s3248973-EasyBuild/sources/p/PyTorch/pytorch-v2.9.1.tar.gz
== 2025-12-21 19:04:54,185 run.py:632 INFO 'tar ...' shell command completed successfully
== 2025-12-21 19:04:54,186 run.py:634 INFO Output of 'tar ...' shell command (stdout + stderr):

== 2025-12-21 19:04:54,187 easyblock.py:2875 INFO Unpacking source six-1.11.0.tar.gz
== 2025-12-21 19:04:54,199 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'tar ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/tar-g6mgwv7g/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/tar-g6mgwv7g/out.txt
== 2025-12-21 19:04:54,199 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,199 run.py:518 INFO Running 'tar ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1:
	tar xzf /data/horse/ws/s3248973-EasyBuild/sources/p/PyTorch/six-1.11.0.tar.gz
== 2025-12-21 19:04:54,217 run.py:632 INFO 'tar ...' shell command completed successfully
== 2025-12-21 19:04:54,218 run.py:634 INFO Output of 'tar ...' shell command (stdout + stderr):

== 2025-12-21 19:04:54,218 build_log.py:329 INFO ... (took 6 secs)
== 2025-12-21 19:04:54,219 build_log.py:329 INFO patching...
== 2025-12-21 19:04:54,219 easyblock.py:4754 INFO Starting patch step
== 2025-12-21 19:04:54,219 easyconfig.py:1814 INFO Generating template values...
== 2025-12-21 19:04:54,220 mpi.py:123 INFO Using template MPI command 'mpirun -n %(nr_ranks)s %(cmd)s' for MPI family 'OpenMPI'
== 2025-12-21 19:04:54,220 mpi.py:299 INFO Using MPI command template 'mpirun -n %(nr_ranks)s %(cmd)s' (params: {'nr_ranks': 1, 'cmd': 'xxx_command_xxx'})
== 2025-12-21 19:04:54,220 easyconfig.py:1833 INFO Template values: arch='x86_64', bitbucket_account='pytorch', builddir='/dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1', cuda_cc_cmake='90', cuda_cc_nvhpc='cc90', cuda_cc_semicolon_sep='9.0', cuda_cc_space_sep='9.0', cuda_cc_space_sep_no_period='90', cuda_compute_capabilities='9.0', cuda_int_comma_sep='90', cuda_int_semicolon_sep='90', cuda_int_space_sep='90', cuda_sm_comma_sep='sm_90', cuda_sm_space_sep='sm_90', cudamajver='12', cudaminver='9', cudashortver='12.9', cudaver='12.9.1', github_account='pytorch', installdir='/data/horse/ws/s3248973-EasyBuild/easybuild-genoa/software/PyTorch/2.9.1-foss-2025b-CUDA-12.9.1', module_name='PyTorch/2.9.1-CUDA-12.9.1', mpi_cmd_prefix='mpirun -n 1', name='PyTorch', nameletter='P', nameletterlower='p', namelower='pytorch', parallel='56', pymajver='3', pyminver='13', pyshortver='3.13', pyver='3.13.5', rpath_enabled='false', software_commit='', start_dir='None', sysroot='', toolchain_name='foss', toolchain_version='2025b', version='2.9.1', version_major='2', version_major_minor='2.9', version_major_minor_patch='2.9.1', version_minor='9', version_minor_patch='9.1', version_patch='1', versionprefix='', versionsuffix='-CUDA-12.9.1'
== 2025-12-21 19:04:54,220 easyblock.py:4765 INFO Running method patch_step part of step patch
== 2025-12-21 19:04:54,220 easyblock.py:2892 INFO Applying patch PyTorch-1.12.1_add-hypothesis-suppression.patch
== 2025-12-21 19:04:54,229 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-2r0x76ky/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-2r0x76ky/out.txt
== 2025-12-21 19:04:54,230 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,230 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-1.12.1_add-hypothesis-suppression.patch
== 2025-12-21 19:04:54,243 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,244 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/quantization/core/test_quantized_op.py
Hunk #1 succeeded at 8362 (offset 2793 lines).

== 2025-12-21 19:04:54,244 easyblock.py:2892 INFO Applying patch PyTorch-1.7.0_disable-dev-shm-test.patch
== 2025-12-21 19:04:54,255 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-5x3hccir/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-5x3hccir/out.txt
== 2025-12-21 19:04:54,256 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,256 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-1.7.0_disable-dev-shm-test.patch
== 2025-12-21 19:04:54,262 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,263 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_multiprocessing.py
Hunk #1 succeeded at 266 (offset 64 lines).

== 2025-12-21 19:04:54,263 easyblock.py:2892 INFO Applying patch PyTorch-2.0.1_skip-tests-skipped-in-subprocess.patch
== 2025-12-21 19:04:54,273 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-3ubqcu44/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-3ubqcu44/out.txt
== 2025-12-21 19:04:54,274 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,274 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.0.1_skip-tests-skipped-in-subprocess.patch
== 2025-12-21 19:04:54,282 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,283 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file torch/testing/_internal/common_distributed.py
Hunk #1 succeeded at 984 with fuzz 1 (offset 156 lines).
Hunk #2 succeeded at 1400 with fuzz 1 (offset 277 lines).

== 2025-12-21 19:04:54,283 easyblock.py:2892 INFO Applying patch PyTorch-2.1.0_remove-test-requiring-online-access.patch
== 2025-12-21 19:04:54,292 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-wliznz53/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-wliznz53/out.txt
== 2025-12-21 19:04:54,293 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,293 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.1.0_remove-test-requiring-online-access.patch
== 2025-12-21 19:04:54,307 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,308 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_cuda.py
Hunk #1 succeeded at 4081 with fuzz 1 (offset 709 lines).

== 2025-12-21 19:04:54,308 easyblock.py:2892 INFO Applying patch PyTorch-2.6.0_show-test-duration.patch
== 2025-12-21 19:04:54,319 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-pzqovvma/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-pzqovvma/out.txt
== 2025-12-21 19:04:54,320 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,320 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.6.0_show-test-duration.patch
== 2025-12-21 19:04:54,330 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,331 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/run_test.py
Hunk #1 succeeded at 1787 (offset -171 lines).
Hunk #2 succeeded at 1812 (offset -171 lines).

== 2025-12-21 19:04:54,331 easyblock.py:2892 INFO Applying patch PyTorch-2.6.0_skip-test_segfault.patch
== 2025-12-21 19:04:54,343 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ld9zji3q/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ld9zji3q/out.txt
== 2025-12-21 19:04:54,344 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,344 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.6.0_skip-test_segfault.patch
== 2025-12-21 19:04:54,354 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,355 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_dataloader.py
Hunk #1 succeeded at 1407 with fuzz 2 (offset 19 lines).

== 2025-12-21 19:04:54,355 easyblock.py:2892 INFO Applying patch PyTorch-2.7.0_avoid_caffe2_test_cpp_jit.patch
== 2025-12-21 19:04:54,365 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-6f4okfdy/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-6f4okfdy/out.txt
== 2025-12-21 19:04:54,366 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,366 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.0_avoid_caffe2_test_cpp_jit.patch
== 2025-12-21 19:04:54,376 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,377 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file torch/testing/_internal/torchbind_impls.py
Hunk #1 succeeded at 175 (offset 59 lines).

== 2025-12-21 19:04:54,377 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_avoid-caffe2-sandcastle-test-lib.patch
== 2025-12-21 19:04:54,388 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-6h0jomo4/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-6h0jomo4/out.txt
== 2025-12-21 19:04:54,389 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,389 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_avoid-caffe2-sandcastle-test-lib.patch
== 2025-12-21 19:04:54,397 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,398 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_aot_inductor_custom_ops.py
Hunk #1 succeeded at 473 (offset 93 lines).

== 2025-12-21 19:04:54,398 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_skip-test_data_parallel_rnn.patch
== 2025-12-21 19:04:54,409 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-g7mnijle/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-g7mnijle/out.txt
== 2025-12-21 19:04:54,410 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,410 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_skip-test_data_parallel_rnn.patch
== 2025-12-21 19:04:54,416 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,416 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/test_data_parallel.py

== 2025-12-21 19:04:54,416 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_skip-test_gds_fails_in_ci.patch
== 2025-12-21 19:04:54,425 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-n91w1bz4/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-n91w1bz4/out.txt
== 2025-12-21 19:04:54,426 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,426 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_skip-test_gds_fails_in_ci.patch
== 2025-12-21 19:04:54,438 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,439 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_cuda.py
Hunk #1 succeeded at 3986 (offset 353 lines).

== 2025-12-21 19:04:54,439 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_skip-test_mixed_mm_exhaustive_dtypes.patch
== 2025-12-21 19:04:54,448 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-tx4wa1ru/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-tx4wa1ru/out.txt
== 2025-12-21 19:04:54,449 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,449 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_skip-test_mixed_mm_exhaustive_dtypes.patch
== 2025-12-21 19:04:54,458 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,458 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_pattern_matcher.py
Hunk #1 succeeded at 382 (offset -7 lines).

== 2025-12-21 19:04:54,459 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_skip-tests-requiring-SM90.patch
== 2025-12-21 19:04:54,469 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-gk_f4iw2/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-gk_f4iw2/out.txt
== 2025-12-21 19:04:54,470 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,470 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_skip-tests-requiring-SM90.patch
== 2025-12-21 19:04:54,482 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,482 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/test_c10d_nccl.py
Hunk #1 succeeded at 3350 with fuzz 1 (offset -17 lines).
Hunk #2 succeeded at 3358 (offset -17 lines).

== 2025-12-21 19:04:54,482 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_suport-64bit-BARs.patch
== 2025-12-21 19:04:54,494 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-8hyc5u1j/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-8hyc5u1j/out.txt
== 2025-12-21 19:04:54,495 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,495 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_suport-64bit-BARs.patch
== 2025-12-21 19:04:54,504 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,505 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file third_party/tensorpipe/tensorpipe/channel/cuda_gdr/context_impl.cc

== 2025-12-21 19:04:54,505 easyblock.py:2892 INFO Applying patch PyTorch-2.7.1_tolerance-test_partial_flat_weights.patch
== 2025-12-21 19:04:54,516 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-49u64io1/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-49u64io1/out.txt
== 2025-12-21 19:04:54,517 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,517 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.7.1_tolerance-test_partial_flat_weights.patch
== 2025-12-21 19:04:54,528 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,528 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_nn.py
Hunk #1 succeeded at 4321 (offset 22 lines).

== 2025-12-21 19:04:54,529 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_disable-test_nan_assert.patch
== 2025-12-21 19:04:54,539 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-lz57xcvm/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-lz57xcvm/out.txt
== 2025-12-21 19:04:54,540 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,540 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_disable-test_nan_assert.patch
== 2025-12-21 19:04:54,553 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,553 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/test_c10d_nccl.py

== 2025-12-21 19:04:54,554 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_enable-symbolizer-in-test_workspace_allocation_error.patch
== 2025-12-21 19:04:54,565 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-xnlze2oe/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-xnlze2oe/out.txt
== 2025-12-21 19:04:54,565 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,565 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_enable-symbolizer-in-test_workspace_allocation_error.patch
== 2025-12-21 19:04:54,572 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,573 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_cudagraph_trees.py
Hunk #2 succeeded at 1674 (offset 130 lines).

== 2025-12-21 19:04:54,573 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_fix-attention-squeeze.patch
== 2025-12-21 19:04:54,584 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-j5vbbih7/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-j5vbbih7/out.txt
== 2025-12-21 19:04:54,584 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,584 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_fix-attention-squeeze.patch
== 2025-12-21 19:04:54,595 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,596 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file torch/distributed/tensor/experimental/_attention.py
Hunk #1 succeeded at 152 (offset 18 lines).
Hunk #2 succeeded at 160 (offset 18 lines).
Hunk #3 succeeded at 225 (offset 18 lines).

== 2025-12-21 19:04:54,596 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_fix-FP16-CPU-tests-in-test_torchinductor_opinfo.patch
== 2025-12-21 19:04:54,606 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-xvubqcae/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-xvubqcae/out.txt
== 2025-12-21 19:04:54,606 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,606 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_fix-FP16-CPU-tests-in-test_torchinductor_opinfo.patch
== 2025-12-21 19:04:54,614 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,614 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_torchinductor_opinfo.py

== 2025-12-21 19:04:54,615 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_fix-nccl-test-env.patch
== 2025-12-21 19:04:54,622 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-uqxxj127/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-uqxxj127/out.txt
== 2025-12-21 19:04:54,623 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,623 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_fix-nccl-test-env.patch
== 2025-12-21 19:04:54,631 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,631 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/test_c10d_nccl.py
Hunk #1 succeeded at 3087 (offset -58 lines).

== 2025-12-21 19:04:54,632 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_fix-test_exclude_padding.patch
== 2025-12-21 19:04:54,641 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-iegyyeq0/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-iegyyeq0/out.txt
== 2025-12-21 19:04:54,642 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,642 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_fix-test_exclude_padding.patch
== 2025-12-21 19:04:54,651 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,651 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_pad_mm.py

== 2025-12-21 19:04:54,651 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_fix-test_version_error.patch
== 2025-12-21 19:04:54,662 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ll3xtp5d/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ll3xtp5d/out.txt
== 2025-12-21 19:04:54,663 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,663 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_fix-test_version_error.patch
== 2025-12-21 19:04:54,669 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,670 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/export/test_serialize.py

== 2025-12-21 19:04:54,670 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_honor-XDG_CACHE_HOME.patch
== 2025-12-21 19:04:54,679 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-igf791ne/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-igf791ne/out.txt
== 2025-12-21 19:04:54,680 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,680 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_honor-XDG_CACHE_HOME.patch
== 2025-12-21 19:04:54,691 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,691 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file torch/csrc/distributed/c10d/FlightRecorder.cpp

== 2025-12-21 19:04:54,692 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_increase-tolerance-in-test_transformers.patch
== 2025-12-21 19:04:54,704 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ak4u6mu6/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ak4u6mu6/out.txt
== 2025-12-21 19:04:54,705 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,705 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_increase-tolerance-in-test_transformers.patch
== 2025-12-21 19:04:54,715 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,716 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_transformers.py

== 2025-12-21 19:04:54,716 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_remove-faulty-close.patch
== 2025-12-21 19:04:54,726 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ree7m1sv/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ree7m1sv/out.txt
== 2025-12-21 19:04:54,727 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,727 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_remove-faulty-close.patch
== 2025-12-21 19:04:54,736 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,736 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file torch/_inductor/autotune_process.py
Hunk #1 succeeded at 864 (offset -18 lines).
Hunk #2 succeeded at 913 (offset -18 lines).

== 2025-12-21 19:04:54,736 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_revert-pybind11-3-change.patch
== 2025-12-21 19:04:54,746 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-l4mrlisg/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-l4mrlisg/out.txt
== 2025-12-21 19:04:54,747 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,747 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_revert-pybind11-3-change.patch
== 2025-12-21 19:04:54,756 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,756 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_cpu_cpp_wrapper.py
patching file torch/_inductor/codegen/cpp_wrapper_cpu.py
patching file torch/_inductor/codegen/cpp_wrapper_cpu_array_ref.py
patching file torch/csrc/inductor/cpp_wrapper/common.h

== 2025-12-21 19:04:54,756 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_benchmark_on_non_zero_device.patch
== 2025-12-21 19:04:54,767 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-3hzj32cv/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-3hzj32cv/out.txt
== 2025-12-21 19:04:54,767 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,767 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_benchmark_on_non_zero_device.patch
== 2025-12-21 19:04:54,775 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,776 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_benchmark_fusion.py

== 2025-12-21 19:04:54,776 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_convolution1-on-H100.patch
== 2025-12-21 19:04:54,786 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-9rysebm5/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-9rysebm5/out.txt
== 2025-12-21 19:04:54,787 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,787 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_convolution1-on-H100.patch
== 2025-12-21 19:04:54,796 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,796 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_select_algorithm.py

== 2025-12-21 19:04:54,797 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_inductor_all_gather_into_tensor_coalesced.patch
== 2025-12-21 19:04:54,806 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-4gibhd33/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-4gibhd33/out.txt
== 2025-12-21 19:04:54,807 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,807 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_inductor_all_gather_into_tensor_coalesced.patch
== 2025-12-21 19:04:54,815 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,815 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/test_c10d_functional_native.py

== 2025-12-21 19:04:54,815 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_original_aten_preserved_pad_mm.patch
== 2025-12-21 19:04:54,823 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-zp8cajsi/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-zp8cajsi/out.txt
== 2025-12-21 19:04:54,824 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,824 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_original_aten_preserved_pad_mm.patch
== 2025-12-21 19:04:54,832 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,833 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_pad_mm.py
Hunk #1 succeeded at 511 (offset 3 lines).

== 2025-12-21 19:04:54,833 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_override-without-CUDA.patch
== 2025-12-21 19:04:54,842 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ilmrlovf/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-ilmrlovf/out.txt
== 2025-12-21 19:04:54,843 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,843 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_override-without-CUDA.patch
== 2025-12-21 19:04:54,851 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,851 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/test_overrides.py

== 2025-12-21 19:04:54,852 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-test_unbacked_reduction.patch
== 2025-12-21 19:04:54,862 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-gvlo4ml1/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-gvlo4ml1/out.txt
== 2025-12-21 19:04:54,863 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,863 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-test_unbacked_reduction.patch
== 2025-12-21 19:04:54,870 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,871 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_torchinductor_dynamic_shapes.py

== 2025-12-21 19:04:54,871 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-tests-requiring-CUDA-12.8.patch
== 2025-12-21 19:04:54,880 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-fvtp21vc/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-fvtp21vc/out.txt
== 2025-12-21 19:04:54,881 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,881 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-tests-requiring-CUDA-12.8.patch
== 2025-12-21 19:04:54,889 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,890 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/inductor/test_aot_inductor.py
patching file test/inductor/test_aot_inductor_package.py
patching file torch/testing/_internal/common_cuda.py

== 2025-12-21 19:04:54,890 easyblock.py:2892 INFO Applying patch PyTorch-2.9.0_skip-unexpected-success-in-test_fake_export.patch
== 2025-12-21 19:04:54,899 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-27_2tuek/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-27_2tuek/out.txt
== 2025-12-21 19:04:54,899 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,899 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.0_skip-unexpected-success-in-test_fake_export.patch
== 2025-12-21 19:04:54,907 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,908 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/export/test_export_opinfo.py

== 2025-12-21 19:04:54,908 easyblock.py:2892 INFO Applying patch PyTorch-2.9.1_ignore-warning-incompatible-pointer-types.patch
== 2025-12-21 19:04:54,919 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-sdxdf_wk/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-sdxdf_wk/out.txt
== 2025-12-21 19:04:54,919 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,919 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.1_ignore-warning-incompatible-pointer-types.patch
== 2025-12-21 19:04:54,927 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,927 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file CMakeLists.txt

== 2025-12-21 19:04:54,927 easyblock.py:2892 INFO Applying patch PyTorch-2.9.1_skip-RingFlexAttentionTest.patch
== 2025-12-21 19:04:54,938 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-rbi7jeum/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-rbi7jeum/out.txt
== 2025-12-21 19:04:54,939 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,939 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.1_skip-RingFlexAttentionTest.patch
== 2025-12-21 19:04:54,949 run.py:632 INFO 'patch ...' shell command completed successfully
== 2025-12-21 19:04:54,950 run.py:634 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file test/distributed/tensor/test_attention.py

== 2025-12-21 19:04:54,950 easyblock.py:2892 INFO Applying patch PyTorch-2.9.1_workaround-GCC-14-error.patch
== 2025-12-21 19:04:54,960 run.py:478 INFO run_shell_cmd: Script to start debug shell for 'patch ...' shell command
	will be saved to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-wmq18_q9/cmd.sh
	output will be logged to /tmp/easybuild-tmp/eb-7wbg3d2y/run-shell-cmd-output/patch-wmq18_q9/out.txt
== 2025-12-21 19:04:54,961 run.py:504 INFO Path to bash that will be used to run shell commands: /usr/bin/bash
== 2025-12-21 19:04:54,961 run.py:518 INFO Running 'patch ...' shell command in /dev/shm/s3248973-EasyBuild/PyTorch/2.9.1/foss-2025b-CUDA-12.9.1/pytorch-v2.9.1:
	patch  -p1 -i /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.1_workaround-GCC-14-error.patch
== 2025-12-21 19:04:54,969 run.py:636 WARNING 'patch ...' shell command FAILED (exit code 1)
== 2025-12-21 19:04:54,970 run.py:637 INFO Output of 'patch ...' shell command (stdout + stderr):
patching file aten/src/ATen/cpu/vec/sve/vec_bfloat16.h
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/cpu/vec/sve/vec_bfloat16.h.rej
patching file aten/src/ATen/native/cpu/Activation.cpp
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/native/cpu/Activation.cpp.rej
patching file aten/src/ATen/native/cpu/Unfold2d.cpp
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/native/cpu/Unfold2d.cpp.rej

== 2025-12-21 19:04:55,127 build_log.py:233 ERROR EasyBuild encountered an error: Couldn't apply patch file /tmp/easybuild-tmp/eb-7wbg3d2y/files_pr24926/p/PyTorch/PyTorch-2.9.1_workaround-GCC-14-error.patch. Process exited with code 1: patching file aten/src/ATen/cpu/vec/sve/vec_bfloat16.h
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/cpu/vec/sve/vec_bfloat16.h.rej
patching file aten/src/ATen/native/cpu/Activation.cpp
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/native/cpu/Activation.cpp.rej
patching file aten/src/ATen/native/cpu/Unfold2d.cpp
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file aten/src/ATen/native/cpu/Unfold2d.cpp.rej
 (at easybuild/tools/filetools.py:1773 in apply_patch)
Callstack:
	easybuild/tools/filetools.py:1773 in apply_patch
	easybuild/framework/easyblock.py:2925 in patch_step
	easybuild/framework/easyblock.py:4781 in run_step
	easybuild/framework/easyblock.py:4940 in run_all_steps
	easybuild/framework/easyblock.py:5127 in build_and_install_one
	easybuild/main.py:178 in build_and_install_software
	easybuild/main.py:611 in process_eb_args
	easybuild/main.py:795 in main
	easybuild/main.py:844 in main_with_hooks
	easybuild/main.py:859 in <module>
== 2025-12-21 19:04:55,127 filetools.py:2172 INFO Removing lock /data/horse/ws/s3248973-EasyBuild/easybuild-genoa/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-genoa_software_PyTorch_2.9.1-foss-2025b-CUDA-12.9.1.lock...
== 2025-12-21 19:04:55,131 filetools.py:423 INFO Path /data/horse/ws/s3248973-EasyBuild/easybuild-genoa/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-genoa_software_PyTorch_2.9.1-foss-2025b-CUDA-12.9.1.lock successfully removed.
== 2025-12-21 19:04:55,131 filetools.py:2176 INFO Lock removed: /data/horse/ws/s3248973-EasyBuild/easybuild-genoa/software/.locks/_data_horse_ws_s3248973-EasyBuild_easybuild-genoa_software_PyTorch_2.9.1-foss-2025b-CUDA-12.9.1.lock
== 2025-12-21 19:04:55,131 easyblock.py:392 INFO Closing log for application name PyTorch version 2.9.1