/*---------------------------------------------------------------------------*\ | ========= | | | \\ / F ield | OpenFOAM: The Open Source CFD Toolbox | | \\ / O peration | Version: 5.x | | \\ / A nd | Web: www.OpenFOAM.org | | \\/ M anipulation | | \*---------------------------------------------------------------------------*/ Build : 5.x-3fe7aa77e620 Exec : pimpleFoam -parallel Date : Aug 28 2017 Time : 21:38:06 Host : "node010.service" PID : 20606 I/O : uncollated Case : /beegfs/testcase/IOTestCase nProcs : 4 Slaves : 3 ( "node010.service.20607" "node010.service.20608" "node010.service.20609" ) Pstream initialized with: floatTransfer : 0 nProcsSimpleSum : 0 commsType : nonBlocking polling iterations : 0 sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE). fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10) allowSystemOperations : Allowing user-supplied system call operations // * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * // Create time Overriding DebugSwitches according to controlDict decomposedBlockData 1; OFstreamCollator 1; Overriding OptimisationSwitches according to controlDict maxThreadFileBufferSize 2e+09; maxMasterFileBufferSize 2e+09; Overriding fileHandler to collated I/O : collated (maxThreadFileBufferSize 2e+09) Threading activated since maxThreadFileBufferSize > 0. Requires thread support enabled in MPI, otherwise the simulation may "hang". If thread support cannot be enabled, deactivate threading by setting maxThreadFileBufferSize to 0 in $FOAM_ETC/controlDict Create mesh for time = 0 [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/points" [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/points" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/faces" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/faces" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/owner" [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/owner" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/neighbour" [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/neighbour" commsType:nonBlocking [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/boundary" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/constant/polyMesh/boundary" commsType:nonBlocking PIMPLE: Operating solver in PISO mode Reading field p [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/p" commsType:nonBlocking Reading field U [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/U" commsType:nonBlocking Reading/calculating face flux field phi [0] decomposedBlockData::readMasterHeader: stream:"/beegfs/testcase/IOTestCase/processors/0/phi" [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/phi" commsType:nonBlocking Selecting incompressible transport model Newtonian Selecting turbulence model type LES Selecting LES turbulence model dynamicKEqn Selecting LES delta type cubeRootVol [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/nut" commsType:nonBlocking [1] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [2] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [3] decomposedBlockData::readBlocks: stream:"invalid" commsType:nonBlocking [0] decomposedBlockData::readBlocks: stream:"/beegfs/testcase/IOTestCase/processors/0/k" commsType:nonBlocking bounding k, min: 0 max: 2.581693 average: 0.064223725 dynamicKEqnCoeffs { filter simple; Ce 1.048; } No MRF models present No finite volume options present Starting time loop Courant Number mean: 0.019271517 max: 0.14347296 deltaT = 1.2e-05 Time = 1.2e-05 PIMPLE: iteration 1 DILUPBiCG: Solving for Ux, Initial residual = 0.00063933574, Final residual = 1.0133512e-07, No Iterations 1 DILUPBiCG: Solving for Uy, Initial residual = 0.0039839205, Final residual = 6.2724362e-07, No Iterations 1 DILUPBiCG: Solving for Uz, Initial residual = 0.0039929386, Final residual = 6.3206595e-07, No Iterations 1 DICPCG: Solving for p, Initial residual = 0.95020722, Final residual = 0.0083812333, No Iterations 8 time step continuity errors : sum local = 3.4815182e-07, global = 7.948159e-10, cumulative = 7.948159e-10 DICPCG: Solving for p, Initial residual = 0.0060926763, Final residual = 2.0447134e-06, No Iterations 1001 time step continuity errors : sum local = 1.5374615e-10, global = 6.3334315e-13, cumulative = 7.9544925e-10 DILUPBiCG: Solving for k, Initial residual = 0.0019602937, Final residual = 3.4806129e-07, No Iterations 1 bounding k, min: -0.0035616505 max: 2.6040647 average: 0.064221013 [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 11562830 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:11562830 commsType:scheduled [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 13028027 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:13028027 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 12268085 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" data:12268085 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 12544682 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:12544682 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 12544682 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 11562830 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 13028027 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 12268085 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/nut" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 43239935 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:43239935 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 43544183 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:43544183 commsType:scheduled [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 43622996 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/U" data:43622996 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 43475086 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:43475086 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 43544183 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 43475086 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 43239935 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 43622996 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/U" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 14176288 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:14176288 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 14726717 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:14726717 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" to thread [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 14614333 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:14614333 commsType:scheduled [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 14843280 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/k" data:14843280 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 14614333 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 14726717 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 14176288 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 14843280 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/k" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 51714076 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:51714076 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 51180546 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:51180546 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 52081538 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:52081538 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 52132478 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" data:52132478 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 52081538 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 51180546 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 51714076 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 52132478 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 51713795 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:51713795 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 51181324 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:51181324 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 52079688 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:52079688 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 52132744 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" data:52132744 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 52079688 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 51181324 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 51713795 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 52132744 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/phi_0" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 13430838 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:13430838 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 13258420 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:13258420 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 13993114 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:13993114 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 13970481 bytes to ExecutionTime = "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 85.6 s ClockTime = 85 s [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/1.2e-05/p" data:13970481 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 13993114 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [1] OFstreamCollator : Exiting write thread Courant Number mean: 0.023126426 max: 0.17198731 deltaT = 1.44e-05 Time = 2.64e-05 PIMPLE: iteration 1 [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 13258420 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 13430838 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 13970481 bytes to "/beegfs/testcase/IOTestCase/processors/1.2e-05/p" using comm 1 [0] OFstreamCollator : Exiting write thread DILUPBiCG: Solving for Ux, Initial residual = 0.0012657738, Final residual = 1.5916653e-07, No Iterations 1 DILUPBiCG: Solving for Uy, Initial residual = 0.0059614998, Final residual = 7.1450902e-07, No Iterations 1 DILUPBiCG: Solving for Uz, Initial residual = 0.0059679377, Final residual = 7.4868288e-07, No Iterations 1 DICPCG: Solving for p, Initial residual = 0.94012796, Final residual = 0.0080740382, No Iterations 9 time step continuity errors : sum local = 3.3602888e-07, global = -8.8072524e-10, cumulative = -8.5275992e-11 DICPCG: Solving for p, Initial residual = 0.031670651, Final residual = 4.500214e-06, No Iterations 1001 time step continuity errors : sum local = 5.9423136e-11, global = 8.5360696e-14, cumulative = -8.5190631e-11 DILUPBiCG: Solving for k, Initial residual = 0.0023563998, Final residual = 3.1006644e-07, No Iterations 1 bounding k, min: -0.0098655761 max: 2.6296338 average: 0.064220051 [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 11565375 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:11565375 commsType:scheduled [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 13034909 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:13034909 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 12271859 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" data:12271859 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 12549808 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:12549808 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 12549808 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 11565375 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 13034909 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 12271859 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/nut" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 43239935 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:43239935 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 43544183 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:43544183 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 43622999 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" to thread [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" data:43622999 commsType:scheduled [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 43475086 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:43475086 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 43544183 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 43475086 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 43239935 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 43622999 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U_0" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 43239582 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:43239582 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" to thread [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" to thread [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 43542971 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:43542971 commsType:scheduled [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 43476820 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:43476820 commsType:scheduled [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 43622923 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/U" data:43622923 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 43542971 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 43476820 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 43239582 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 43622923 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/U" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 14175065 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:14175065 commsType:scheduled [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 14726359 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:14726359 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" to thread [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 14843197 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 14614528 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:14614528 commsType:scheduled [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/k" data:14843197 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 14614528 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 14726359 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 14175065 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 14843197 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/k" using comm 1 [0] OFstreamCollator : Exiting write thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" to thread [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" to thread [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 51713290 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:51713290 commsType:scheduled [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 51180890 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:51180890 commsType:scheduled [1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" to thread [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" to thread [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 52080631 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:52080631 commsType:scheduled [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 52133658 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" data:52133658 commsType:scheduled [1] Finished master-only writing at:1.5039492e+09 s [1] OFstreamCollator : Finished writing 52080631 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [1] OFstreamCollator : Exiting write thread [2] Finished master-only writing at:1.5039492e+09 s [2] OFstreamCollator : Finished writing 51180890 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [2] OFstreamCollator : Exiting write thread [3] Finished master-only writing at:1.5039492e+09 s [3] OFstreamCollator : Finished writing 51713290 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [3] OFstreamCollator : Exiting write thread [0] Finished master-only writing at:1.5039492e+09 s [0] OFstreamCollator : Finished writing 52133658 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi" using comm 1 [0] OFstreamCollator : Exiting write thread [2] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" to thread [3] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" to thread [2] OFstreamCollator : Started write thread [2] OFstreamCollator : Writing 51180546 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" using comm 1 [2] decomposedBlockData::writeBlocks: stream:"invalid" data:51180546 commsType:scheduled [3] OFstreamCollator : Started write thread [3] OFstreamCollator : Writing 51714076 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" using comm 1 [3] decomposedBlockData::writeBlocks: stream:"invalid" data:51714076 commsType:scheduled [2] #0 Foam::error::printStack(Foam::Ostream&)[1] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" to thread -------------------------------------------------------------------------- A process has executed an operation involving a call to the "fork()" system call to create a child process. Open MPI is currently operating in a condition that could result in memory corruption or other system errors; your job may hang, crash, or produce silent data corruption. The use of fork() (or system() or other calls that create child processes) is strongly discouraged. The process that invoked fork was: Local host: [[57503,1],2] (PID 20608) If you are *absolutely sure* that your application will successfully and correctly survive a call to fork(), you may disable this warning by setting the mpi_warn_on_fork MCA parameter to 0. -------------------------------------------------------------------------- [1] OFstreamCollator : Started write thread [1] OFstreamCollator : Writing 52081538 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" using comm 1 [1] decomposedBlockData::writeBlocks: stream:"invalid" data:52081538 commsType:scheduled [0] OFstreamCollator : relaying write of "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" to thread [0] OFstreamCollator : Started write thread [0] OFstreamCollator : Writing 52132481 bytes to "/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" using comm 1 [0] decomposedBlockData::writeBlocks: stream:"/beegfs/testcase/IOTestCase/processors/2.64e-05/phi_0" data:52132481 commsType:scheduled at ??:? [2] #1 Foam::sigSegv::sigHandler(int) at ??:? [2] #2 ? in "/usr/lib64/libc.so.6" [2] #3 ? at pml_cm.c:? [2] #4 ompi_mtl_psm_progress at ??:? [2] #5 opal_progress in "/cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20" [2] #6 sync_wait_mt in "/cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20" [2] #7 ? at pml_cm.c:? [2] #8 MPI_Recv in "/cluster/mpi/gcc/openmpi/2.1.1/lib/libmpi.so.20" [2] #9 Foam::UIPstream::read(Foam::UPstream::commsTypes, int, char*, long, int, int) at ??:? [2] #10 void Foam::Pstream::gatherList(Foam::List const&, Foam::List&, int, int) at ??:? [2] #11 Foam::decomposedBlockData::writeBlocks(int, Foam::autoPtr&, Foam::List&, Foam::UList const&, Foam::UPstream::commsTypes, bool) at ??:? [2] #12 Foam::OFstreamCollator::writeFile(int, Foam::word const&, Foam::fileName const&, Foam::string const&, Foam::IOstream::streamFormat, Foam::IOstream::versionNumber, Foam::IOstream::compressionType, bool) at ??:? [2] #13 Foam::OFstreamCollator::writeAll(void*) at ??:? [2] #14 ? in "/usr/lib64/libpthread.so.0" [2] #15 clone in "/usr/lib64/libc.so.6" [node010:20608] *** Process received signal *** [node010:20608] Signal: Segmentation fault (11) [node010:20608] Associated errno: Unknown error 11166 (11166) [node010:20608] Signal code: (0) [node010:20608] Failing at address: (nil) [node010:20608] [ 0] /usr/lib64/libc.so.6(+0x35250)[0x2b9e1dfe5250] [node010:20608] [ 1] /usr/lib64/libc.so.6(gsignal+0x37)[0x2b9e1dfe51d7] [node010:20608] [ 2] /usr/lib64/libc.so.6(+0x35250)[0x2b9e1dfe5250] [node010:20608] [ 3] /cluster/mpi/gcc/openmpi/2.1.1/lib/openmpi/mca_pml_cm.so(+0x2405)[0x2b9e31132405] [node010:20608] [ 4] /cluster/mpi/gcc/openmpi/2.1.1/lib/openmpi/mca_mtl_psm.so(ompi_mtl_psm_progress+0x75)[0x2b9e3176ad05] [node010:20608] [ 5] /cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20(opal_progress+0x5c)[0x2b9e22102c8c] [node010:20608] [ 6] /cluster/mpi/gcc/openmpi/2.1.1/lib/libopen-pal.so.20(sync_wait_mt+0xc5)[0x2b9e22107e35] [node010:20608] [ 7] /cluster/mpi/gcc/openmpi/2.1.1/lib/openmpi/mca_pml_cm.so(+0x275c)[0x2b9e3113275c] [node010:20608] [ 8] /cluster/mpi/gcc/openmpi/2.1.1/lib/libmpi.so.20(MPI_Recv+0x175)[0x2b9e2084ff85] [node010:20608] [ 9] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/openmpi-system/libPstream.so(_ZN4Foam9UIPstream4readENS_8UPstream10commsTypesEiPclii+0x1b5)[0x2b9e1e3757c5] [node010:20608] [10] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libfiniteVolume.so(_ZN4Foam7Pstream10gatherListIiEEvRKNS_4ListINS_8UPstream11commsStructEEERNS2_IT_EEii+0xee)[0x2b9e1a29964e] [node010:20608] [11] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam19decomposedBlockData11writeBlocksEiRNS_7autoPtrINS_8OSstreamEEERNS_4ListIlEERKNS_5UListIcEENS_8UPstream10commsTypesEb+0x1f9)[0x2b9e1cd858e9] [node010:20608] [12] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam16OFstreamCollator9writeFileEiRKNS_4wordERKNS_8fileNameERKNS_6stringENS_8IOstream12streamFormatENSA_13versionNumberENSA_15compressionTypeEb+0xb7)[0x2b9e1ccbf577] [node010:20608] [13] /cluster/engineering/OpenFOAM/OpenFOAM-5.x/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so(_ZN4Foam16OFstreamCollator8writeAllEPv+0xbb)[0x2b9e1ccbf93b] [node010:20608] [14] /usr/lib64/libpthread.so.0(+0x7dc5)[0x2b9e20aebdc5] [node010:20608] [15] /usr/lib64/libc.so.6(clone+0x6d)[0x2b9e1e0a776d] [node010:20608] *** End of error message *** -------------------------------------------------------------------------- mpirun noticed that process rank 2 with PID 20608 on node node010 exited on signal 11 (Segmentation fault). --------------------------------------------------------------------------