fds icon indicating copy to clipboard operation
fds copied to clipboard

MPI finalize error?

Open rmcdermo opened this issue 11 months ago • 4 comments

Describe the bug Error message reported after successful completion of 8 mesh UGMLAT with HYPRE run

To Reproduce Steps to reproduce the behavior: Run fds/Verification/Pressure_Solver/duct_flow_uglmat_hypre.fds

Expected behavior Clean exit, no error message

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: M2 macOS Sequoia

Additional context Here is the error file to screen

(fds_python_env) rmcdermo@PN122745 Pressure_Solver (master) $ mpiexec -n 8 fds duct_flow_uglmat_hypre.fds

 Starting FDS ...

 MPI Process      0 started on PN122745
 MPI Process      2 started on PN122745
 MPI Process      3 started on PN122745
 MPI Process      4 started on PN122745
 MPI Process      5 started on PN122745
 MPI Process      6 started on PN122745
 MPI Process      7 started on PN122745
 MPI Process      1 started on PN122745

 Reading FDS input file ...


 Fire Dynamics Simulator

 Current Date     : March  6, 2025  11:37:30
 Revision         : FDS-6.9.1-2055-gdd3edb3-nightly
 Revision Date    : Wed Mar 5 16:10:42 2025 -0500
 Compiler         : Intel(R) Fortran Intel(R) 64 Compiler Classic for applications running on Intel(R) 64, Version 2021.7.1 Build 20221019_000000
 Compilation Date : Mar 06, 2025  08:31:39

 Number of MPI Processes:  8

 MPI version: 3.1
 MPI library version: Open MPI v4.1.4, package: Open MPI [email protected] Distribution, ident: 4.1.4, repo rev: v4.1.4, May 26, 2022
 Hypre library version: v2.32.0
 Sundials library version: v6.7.0

 Job TITLE        : Flow through a duct, test of UGLMAT with HYPRE
 Job ID string    : duct_flow_uglmat_hypre

 Time Step:       1, Simulation Time:   0.12623 s
 Time Step:       2, Simulation Time:   0.25245 s
 Time Step:       3, Simulation Time:   0.37868 s
 Time Step:       4, Simulation Time:   0.50490 s
 Time Step:       5, Simulation Time:   0.63113 s
 Time Step:       6, Simulation Time:   0.75736 s
 Time Step:       7, Simulation Time:   0.88358 s
 Time Step:       8, Simulation Time:   0.99612 s
 Time Step:       9, Simulation Time:   1.09695 s
 Time Step:      10, Simulation Time:   1.19777 s
 Time Step:      20, Simulation Time:   2.17338 s
 Time Step:      30, Simulation Time:   3.02671 s
 Time Step:      40, Simulation Time:   3.83389 s
 Time Step:      50, Simulation Time:   4.64106 s
 Time Step:      60, Simulation Time:   5.38325 s
 Time Step:      70, Simulation Time:   6.10918 s
 Time Step:      80, Simulation Time:   6.78741 s
 Time Step:      90, Simulation Time:   7.43055 s
 Time Step:     100, Simulation Time:   8.12412 s
 Time Step:     200, Simulation Time:  14.08941 s
 Time Step:     300, Simulation Time:  19.52028 s
 Time Step:     400, Simulation Time:  25.27850 s
 Time Step:     500, Simulation Time:  31.11664 s
 Time Step:     600, Simulation Time:  37.10841 s
 Time Step:     700, Simulation Time:  43.54940 s
 Time Step:     800, Simulation Time:  49.75274 s
 Time Step:     900, Simulation Time:  55.76802 s
 Time Step:     970, Simulation Time:  60.00000 s

STOP: FDS completed successfully (CHID: duct_flow_uglmat_hypre)
--------------------------------------------------------------------------
A system call failed during shared memory initialization that should
not have.  It is likely that your MPI job will now either abort or
experience performance degradation.

  Local host:  PN122745
  System call: unlink(2) /var/folders/xt/s_7ggm_d6038thsw171sgzd40015xx/T//ompi.PN122745.38845/pid.44348/1/vader_segment.PN122745.38845.b3cc0001.6
  Error:       No such file or directory (errno 2)
--------------------------------------------------------------------------

rmcdermo avatar Mar 06 '25 16:03 rmcdermo

Randy, try what is recommended here:

https://github.com/SENSEI-insitu/SENSEI/issues/126

marcosvanella avatar Mar 06 '25 16:03 marcosvanella

Well, I don't have the problem when I compile and run locally. I don't think this is something we should expect users to need to do.

rmcdermo avatar Mar 06 '25 16:03 rmcdermo

Yes, adding export TMPDIR=/tmp removes the error message.

rmcdermo avatar Mar 06 '25 17:03 rmcdermo

I am not getting the error because for me MacOS automatically defined a TMPDIR environment variable as follows:

echo $TMPDIR
/var/folders/qq/nhw6cyzs2fdf_3bms4st1k9r002c63/T/

cxp484 avatar Mar 06 '25 17:03 cxp484

I’m closing this issue assuming this comment provides a solution.

cxp484 avatar Sep 04 '25 15:09 cxp484