/*---------------------------------------------------------------------------*\ | ========= | | | \\ / F ield | OpenFOAM: The Open Source CFD Toolbox | | \\ / O peration | Version: 5.x | | \\ / A nd | Web: www.OpenFOAM.org | | \\/ M anipulation | | \*---------------------------------------------------------------------------*/ Build : 5.x-3fe7aa77e620 Exec : pimpleFoam -parallel Date : Aug 28 2017 Time : 21:10:50 Host : "node070.service" PID : 8428 I/O : uncollated Case : /beegfs/testcase/IOTestCase nProcs : 4 Slaves : 3 ( "node070.service.8429" "node070.service.8430" "node070.service.8431" ) Pstream initialized with: floatTransfer : 0 nProcsSimpleSum : 0 commsType : nonBlocking polling iterations : 0 sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE). fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10) allowSystemOperations : Allowing user-supplied system call operations // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // Create time Overriding DebugSwitches according to controlDict decomposedBlockData 1; OFstreamCollator 1; Overriding OptimisationSwitches according to controlDict maxThreadFileBufferSize 2e+09; maxMasterFileBufferSize 2e+09; Overriding fileHandler to collated I/O : collated (maxThreadFileBufferSize 2e+09) Threading activated since maxThreadFileBufferSize > 0. Requires thread support enabled in MPI, otherwise the simulation may "hang". If thread support cannot be enabled, deactivate threading by setting maxThreadFileBufferSize to 0 in $FOAM_ETC/controlDict Create mesh for time = 0 [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/points" [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/points" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/faces" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/faces" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/owner" [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/owner" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/neighbour" [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/neighbour" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/boundary" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/boundary" commsType:nonBlocking PIMPLE: Operating solver in PISO mode Reading field p [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/p" commsType:nonBlocking Reading field U [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/U" commsType:nonBlocking Reading/calculating face flux field phi [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/0/phi" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/phi" commsType:nonBlocking Selecting incompressible transport model Newtonian Selecting turbulence model type LES Selecting LES turbulence model dynamicKEqn Selecting LES delta type cubeRootVol [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/nut" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/k" commsType:nonBlocking bounding k, min: 0 max: 2.581693 average: 0.064223725 dynamicKEqnCoeffs { filter simple; Ce 1.048; } No MRF models present No finite volume options present Starting time loop Courant Number mean: 0.019271517 max: 0.14347296 deltaT = 1.2e-05 Time = 1.2e-05 PIMPLE: iteration 1 DILUPBiCG: Solving for Ux, Initial residual = 0.00063933574, Final residual = 1.0133512e-07, No Iterations 1 DILUPBiCG: Solving for Uy, Initial residual = 0.0039839205, Final residual = 6.2724362e-07, No Iterations 1 DILUPBiCG: Solving for Uz, Initial residual = 0.0039929386, Final residual = 6.3206595e-07, No Iterations 1 DICPCG: Solving for p, Initial residual = 0.95020722, Final residual = 0.0083812333, No Iterations 8 time step continuity errors : sum local = 3.4815182e-07, global = 7.948159e-10, cumulative = 7.948159e-10 DICPCG: Solving for p, Initial residual = 0.0060926763, Final residual = 2.0447134e-06, No Iterations 1001 time step continuity errors : sum local = 1.5374615e-10, global = 6.3334315e-13, cumulative = 7.9544925e-10 DILUPBiCG: Solving for k, Initial residual = 0.0019602937, Final residual = 3.4806129e-07, No Iterations 1 bounding k, min: -0.0035616505 max: 2.6040647 average: 0.064221013 [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 11562830 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:11562830 commsType:scheduled [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 13028027 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:13028027 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 12268085 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" data:12268085 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 12544682 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:12544682 commsType:scheduled [1] Finished master-only writing at:1.5039475e+09 s [1] OFstreamCollator : Finished writing 12544682 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039475e+09 s [2] OFstreamCollator : Finished writing 11562830 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039475e+09 s [3] OFstreamCollator : Finished writing 13028027 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039475e+09 s [0] OFstreamCollator : Finished writing 12268085 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 43239935 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:43239935 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 43622996 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/U" data:43622996 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 43544183 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:43544183 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 43475086 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:43475086 commsType:scheduled [0] #0 Foam::error::printStack(Foam::Ostream&)-------------------------------------------------------------------------- A process has executed an operation involving a call to the "fork()" system call to create a child process. Open MPI is currently operating in a condition that could result in memory corruption or other system errors; your job may hang, crash, or produce silent data corruption. The use of fork() (or system() or other calls that create child processes) is strongly discouraged. The process that invoked fork was: Local host: [[33579,1],0] (PID 8428) If you are *absolutely sure* that your application will successfully and correctly survive a call to fork(), you may disable this warning by setting the mpi_warn_on_fork MCA parameter to 0. -------------------------------------------------------------------------- [node070:08428] *** Process received signal *** [node070:08428] Signal: Segmentation fault (11) [node070:08428] Signal code: (1107740560) [node070:08428] Failing at address: 0x2ae042302e32 [node070:08428] [ 0] /usr/lib64/libc.so.6(+0x35250)[0x2ae00c230250] [node070:08428] [ 1] /usr/lib64/libpsm_infinipath.so.1(psmi_mpool_get+0xd)[0x2ae027badf5d] [node070:08428] [ 2] /usr/lib64/libpsm_infinipath.so.1(psmi_mq_req_alloc+0x2c)[0x2ae027bc17cc] [node070:08428] [ 3] /usr/lib64/libpsm_infinipath.so.1(psmi_mq_handle_envelope_unexpected+0x72)[0x2ae027bc1d52] [node070:08428] [ 4] /usr/lib64/libpsm_infinipath.so.1(psmi_am_mq_handler+0x282)[0x2ae027ba3a42] [node070:08428] [ 5] /usr/lib64/libpsm_infinipath.so.1(+0xaa52)[0x2ae027b99a52] [node070:08428] [ 6] /usr/lib64/libpsm_infinipath.so.1(+0x13f4c)[0x2ae027ba2f4c] [node070:08428] [ 7] /usr/lib64/libpsm_infinipath.so.1(psmi_poll_internal+0x67)[0x2ae027bc2f37] [node070:08428] [ 8] /usr/lib64/libpsm_infinipath.so.1(psm_mq_ipeek+0x8a)[0x2ae027bc176a] [node070:08428] [ 9] /cluster/mpi/gcc/openmpi/2.1.1/lib/openmpi/mca_mtl_psm.so(ompi_mtl_psm_progress+0x87)[0x2ae02798ad17] [node070:08428] [10] /cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20(opal_progress+0x5c)[0x2ae01034dc8c] [node070:08428] [11] /cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20(sync_wait_mt+0xc5)[0x2ae010352e35] [node070:08428] [12] /cluster/mpi/gcc/openmpi/2.1.1/lib/openmpi/mca_pml_cm.so(+0x275c)[0x2ae02735275c] [node070:08428] [13] /cluster/mpi/gcc/openmpi/2.1.1/lib/libmpi.so.20(MPI_Recv+0x175)[0x2ae00ea9af85] [node070:08428] [14] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/openmpi-system/libPstream.so(_ZN4Foam9UIPstream4readENS_8UPstream10commsTypesEiPclii+0x1b5)[0x2ae00c5c07c5] [node070:08428] [15] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam19decomposedBlockData11writeBlocksEiRNS_7autoPtrINS_8OSstreamEEERNS_4ListIlEERKNS_5UListIcEENS_8UPstream10commsTypesEb+0x71f)[0x2ae00afd0e0f] [node070:08428] [16] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam16OFstreamCollator9writeFileEiRKNS_4wordERKNS_8fileNameERKNS_6stringENS_8IOstream12streamFormatENSA_13versionNumberENSA_15compressionTypeEb+0xb7)[0x2ae00af0a577] [node070:08428] [17] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam16OFstreamCollator8writeAllEPv+0xbb)[0x2ae00af0a93b] [node070:08428] [18] /usr/lib64/libpthread.so.0(+0x7dc5)[0x2ae00ed36dc5] [node070:08428] [19] /usr/lib64/libc.so.6(clone+0x6d)[0x2ae00c2f276d] [node070:08428] *** End of error message *** -------------------------------------------------------------------------- mpirun noticed that process rank 0 with PID 8428 on node node070 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------