Skip to content

[Bug]: Error checking restart data  #117

Description

@mattzett

What happened?

Often an error will trigger on a reload with a large number of workers when one workers gets mostly (or all) underground points.

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
  7174	 ! Restarting simulation from time:          2024           4           2   70092.000000000000     
  7175	 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
  7176	 Treating the following file as initial conditions:  /p/work1/inchinp/simulations/taiwan/eq/20240402_70092.000000.h5
  7177	  full duration:     115200.00000000000      ; remaining simulation time:     45000.000000000000     
  7178	  simulation start time:     70200.000000000000     
  7179	/p/work1/inchinp/simulations/taiwan/eq/inputs/simsize.h5 input dimensions:   256   256   256
  7180	Target (output) grid structure dimensions:   256   256   256
  7181	Sent ICs to workers in   1.463E+00 seconds.
       
  7182	Initial conditions (root):
  7183	------------------------
  7184	Min/max input density:   1.00E-20   1.00E-20
  7185	Min/max input velocity:   0.00E+00   0.00E+00
  7186	Min/max input temperature:   1.00E+02   1.00E+02
  7187	Min/max input electric potential:   0.00E+00   0.00E+00
  7188	Min/max input electric potential (full grid):   0.00E+00   0.00E+00
  7189	Note: The following floating-point exceptions are signalling: IEEE_INVALID_FLAG
  7190	ERROR STOP input:plasma: too low maximum density dumped to /p/work1/inchinp/simulations/taiwan/eq/dump_nonfinite_plasma.h5

Relevant log output

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions