主机并行运算问题

青山

@cccrrryyy mpirun -np 24 twoPhaseEulerFoam -parallel ，命令应该没问题，我在其他电脑上并行的话都挺快的，就这机子不行。没有超线程，32核64线程我只用了24个核。

cccrrryyy

@青山那这听起来是机子本身的问题了，硬件层面的了。按道理，一台机器内部也不涉及网络，跟网络也无关。

青山

@cccrrryyy 是的，跑起来的时候24个cup的占用都起来了，就是速度没块，我再研究研究，感谢！

李东岳

@青山 https://www.cfd-china.com/topic/3988/200万网格并行算力测试-openfoam版本跑一下我这个标准算例

星星星星晴

@青山原生ubuntu？

青山

@星星星星晴是的，原生的20.04

星星星星晴

@青山跑一下大佬的算力测试，看看怎么样，顺便把你这个case的log发一下开头的部分出来看看

青山

@星星星星晴没问题，明天算一下再回来反馈

青山

@李东岳大佬跑完了，这7502感觉有点拉胯啊

cccrrryyy

@青山不太熟悉AMD，7532和7502差别大么？感觉用的7532还不错的样子

青山

@cccrrryyy 我看东岳老师测试的，7502跑32核60多秒就跑完了，我比他慢了十倍不知道是硬件的问题还是设置的问题

星星星星晴

@青山发一下log文件啊。。你这个截图有什么用呢。。32核多少内存？内存怎么装的？

青山

@星星星星晴来了，大佬帮我看看，内存是16*8的


*---------------------------------------------------------------------------*\
  =========                 |
  \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox
   \\    /   O peration     | Website:  https://openfoam.org
    \\  /    A nd           | Version:  7
     \\/     M anipulation  |
\*---------------------------------------------------------------------------*/
Build  : 7-3bcbaf946ae9
Exec   : reactingTwoPhaseEulerFoam -parallel
Date   : Jan 18 2022
Time   : 13:20:12
Host   : "ps"
PID    : 6349
I/O    : uncollated
Case   : /home/ps/OpenFoam/zf/tube
nProcs : 24
Slaves : 
23
(
"ps.6350"
"ps.6351"
"ps.6352"
"ps.6353"
"ps.6354"
"ps.6355"
"ps.6356"
"ps.6357"
"ps.6358"
"ps.6359"
"ps.6360"
"ps.6361"
"ps.6362"
"ps.6363"
"ps.6364"
"ps.6365"
"ps.6366"
"ps.6367"
"ps.6368"
"ps.6369"
"ps.6370"
"ps.6371"
"ps.6372"
)

Pstream initialized with:
    floatTransfer      : 0
    nProcsSimpleSum    : 0
    commsType          : nonBlocking
    polling iterations : 0
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0


PIMPLE: No convergence criteria found


PIMPLE: No corrector convergence criteria found
        Calculations will do 3 corrections


PIMPLE: Operating solver in transient mode with 3 outer correctors

星星星星晴

@青山看起来没啥问题啊。。神奇了

星星星星晴

@青山 sudo dmidecode -t memory | grep Channel 看一下你的内存工作模式

青山

@星星星星晴这里有问题吗？

星星星星晴

@青山看不出来有什么问题，看其他大佬们的吧。。
实在不行重装，装ub1804，看起来都没啥问题。。

青山

@星星星星晴好的吧

李东岳

@青山前几步计算的log贴一下？

青山

@李东岳


------------*\
 =========                 |
 \\      /  F ield         | OpenFOAM: The Open Source CFD Toolbox
  \\    /   O peration     | Website:  https://openfoam.org
   \\  /    A nd           | Version:  7
    \\/     M anipulation  |
\*---------------------------------------------------------------------------*/
Build  : 7-3bcbaf946ae9
Exec   : reactingTwoPhaseEulerFoam -parallel
Date   : Jan 18 2022
Time   : 13:20:12
Host   : "ps"
PID    : 6349
I/O    : uncollated
Case   : /home/ps/OpenFoam/zf/tube
nProcs : 24
Slaves : 
23
(
"ps.6350"
"ps.6351"
"ps.6352"
"ps.6353"
"ps.6354"
"ps.6355"
"ps.6356"
"ps.6357"
"ps.6358"
"ps.6359"
"ps.6360"
"ps.6361"
"ps.6362"
"ps.6363"
"ps.6364"
"ps.6365"
"ps.6366"
"ps.6367"
"ps.6368"
"ps.6369"
"ps.6370"
"ps.6371"
"ps.6372"
)

Pstream initialized with:
   floatTransfer      : 0
   nProcsSimpleSum    : 0
   commsType          : nonBlocking
   polling iterations : 0
sigFpe : Enabling floating point exception trapping (FOAM_SIGFPE).
fileModificationChecking : Monitoring run-time modified files using timeStampMaster (fileModificationSkew 10)
allowSystemOperations : Allowing user-supplied system call operations

// * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * //
Create time

Create mesh for time = 0


PIMPLE: No convergence criteria found


PIMPLE: No corrector convergence criteria found
       Calculations will do 3 corrections


PIMPLE: Operating solver in transient mode with 3 outer correctors



Reading g

Reading hRef
Creating phaseSystem

Selecting twoPhaseSystem populationBalanceTwoPhaseSystem
Selecting phaseModel for air: purePhaseModel
Selecting diameterModel for phase air: velocityGroup
Selecting thermodynamics package 
{
   type            heRhoThermo;
   mixture         pureMixture;
   transport       const;
   thermo          eConst;
   equationOfState rhoConst;
   specie          specie;
   energy          sensibleInternalEnergy;
}

Calculating face flux field phi.air
Selecting turbulence model type RAS
Selecting RAS turbulence model mixtureKEpsilon
RAS
{
   RASModel        mixtureKEpsilon;
   turbulence      on;
   printCoeffs     on;
   Cmu             0.09;
   C1              1.44;
   C2              1.92;
   C3              1.92;
   Cp              0.25;
   sigmak          1;
   sigmaEps        1.3;
}

Selecting phaseModel for water: purePhaseModel
Selecting diameterModel for phase water: constant
Selecting thermodynamics package 
{
   type            heRhoThermo;
   mixture         pureMixture;
   transport       const;
   thermo          eConst;
   equationOfState rhoConst;
   specie          specie;
   energy          sensibleInternalEnergy;
}

Calculating face flux field phi.water
Selecting turbulence model type RAS
Selecting RAS turbulence model mixtureKEpsilon
RAS
{
   RASModel        mixtureKEpsilon;
   turbulence      on;
   printCoeffs     on;
   Cmu             0.09;
   C1              1.44;
   C2              1.92;
   C3              1.92;
   Cp              0.25;
   sigmak          1;
   sigmaEps        1.3;
}

No MRF models present

Selecting default blending method: linear
Selecting drag blending method: linear
Selecting surfaceTensionModel for (air and water): constant
Selecting aspectRatioModel for (air in water): constant
Selecting aspectRatioModel for (water in air): constant
Selecting dragModel for (air and water): segregated
Selecting swarmCorrection for (air and water): none
Selecting dragModel for (air in water): IshiiZuber
Selecting swarmCorrection for (air in water): Tomiyama
Selecting dragModel for (water in air): IshiiZuber
Selecting swarmCorrection for (water in air): Tomiyama
Selecting virtualMassModel for (air in water): constantCoefficient
Selecting virtualMassModel for (water in air): constantCoefficient
Selecting heatTransferModel for (air in water): RanzMarshall
Selecting heatTransferModel for (water in air): RanzMarshall
Calculating field g.h

Reading field p_rgh

Courant Number mean: 4.48994e-05 max: 0.00609375

Starting time loop

Courant Number mean: 4.48994e-05 max: 0.00609375
Max Ur Courant Number = 0
Time = 5e-05

PIMPLE: Iteration 1
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 8.97988e-05  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.990339, Final residual = 7.12114e-09, No Iterations 43
PIMPLE: Iteration 2
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 8.97988e-05  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.00172072, Final residual = 8.24851e-09, No Iterations 14
PIMPLE: Iteration 3
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 8.97988e-05  Min(alpha1) = 0  Max(alpha1) = 0.25
populationBalance bubbles: Iteration 1
DILUPBiCGStab:  Solving for f0.air.bubbles, Initial residual = 1, Final residual = 1.07449e-10, No Iterations 1
DILUPBiCGStab:  Solving for f1.air.bubbles, Initial residual = 1, Final residual = 1.0744e-10, No Iterations 1
DILUPBiCGStab:  Solving for f2.air.bubbles, Initial residual = 1, Final residual = 1.07565e-10, No Iterations 1
DILUPBiCGStab:  Solving for f3.air.bubbles, Initial residual = 1, Final residual = 1.07601e-10, No Iterations 1
DILUPBiCGStab:  Solving for f4.air.bubbles, Initial residual = 1, Final residual = 1.07472e-10, No Iterations 1
DILUPBiCGStab:  Solving for f5.air.bubbles, Initial residual = 1, Final residual = 1.07428e-10, No Iterations 1
DILUPBiCGStab:  Solving for f6.air.bubbles, Initial residual = 1, Final residual = 1.07231e-10, No Iterations 1
DILUPBiCGStab:  Solving for f7.air.bubbles, Initial residual = 1, Final residual = 1.07023e-10, No Iterations 1
DILUPBiCGStab:  Solving for f8.air.bubbles, Initial residual = 1, Final residual = 1.06289e-10, No Iterations 1
DILUPBiCGStab:  Solving for f9.air.bubbles, Initial residual = 1, Final residual = 1.04711e-10, No Iterations 1
DILUPBiCGStab:  Solving for f10.air.bubbles, Initial residual = 1, Final residual = 1.00915e-10, No Iterations 1
DILUPBiCGStab:  Solving for f11.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f12.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f13.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f14.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
air Sauter mean diameter, min, max = 4.65318e-05 4.65237e-05 4.65318e-05
air sizeGroups-sum volume fraction, min, max = 1 1 1
bubbles sizeGroup phase fraction first, last = 8.85697e-08 0
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.000995987, Final residual = 6.44985e-09, No Iterations 11
smoothSolver:  Solving for epsilonm, Initial residual = 0.360485, Final residual = 5.98015e-08, No Iterations 6
smoothSolver:  Solving for km, Initial residual = 1, Final residual = 4.14411e-08, No Iterations 6
ExecutionTime = 0.14 s


Courant Number mean: 0.0537623 max: 1.16043
Max Ur Courant Number = 0.0897572
Time = 0.0001

PIMPLE: Iteration 1
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000179598  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.00793744, Final residual = 8.90127e-09, No Iterations 30
PIMPLE: Iteration 2
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000179598  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.0765251, Final residual = 7.71052e-09, No Iterations 16
PIMPLE: Iteration 3
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000179598  Min(alpha1) = 0  Max(alpha1) = 0.25
populationBalance bubbles: Iteration 1
DILUPBiCGStab:  Solving for f0.air.bubbles, Initial residual = 0.147551, Final residual = 4.86871e-11, No Iterations 1
DILUPBiCGStab:  Solving for f1.air.bubbles, Initial residual = 0.0394195, Final residual = 1.02867e-11, No Iterations 1
DILUPBiCGStab:  Solving for f2.air.bubbles, Initial residual = 0.736843, Final residual = 2.25619e-10, No Iterations 1
DILUPBiCGStab:  Solving for f3.air.bubbles, Initial residual = 0.793873, Final residual = 2.42534e-10, No Iterations 1
DILUPBiCGStab:  Solving for f4.air.bubbles, Initial residual = 0.857026, Final residual = 2.6112e-10, No Iterations 1
DILUPBiCGStab:  Solving for f5.air.bubbles, Initial residual = 0.608674, Final residual = 1.86077e-10, No Iterations 1
DILUPBiCGStab:  Solving for f6.air.bubbles, Initial residual = 0.196465, Final residual = 5.34906e-11, No Iterations 1
DILUPBiCGStab:  Solving for f7.air.bubbles, Initial residual = 0.596202, Final residual = 1.77238e-10, No Iterations 1
DILUPBiCGStab:  Solving for f8.air.bubbles, Initial residual = 0.32325, Final residual = 9.33873e-11, No Iterations 1
DILUPBiCGStab:  Solving for f9.air.bubbles, Initial residual = 0.785256, Final residual = 1.98355e-10, No Iterations 1
DILUPBiCGStab:  Solving for f10.air.bubbles, Initial residual = 0.727823, Final residual = 1.4766e-10, No Iterations 1
DILUPBiCGStab:  Solving for f11.air.bubbles, Initial residual = 1, Final residual = 1.35917e-10, No Iterations 1
DILUPBiCGStab:  Solving for f12.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f13.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f14.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
air Sauter mean diameter, min, max = 4.6532e-05 4.65318e-05 4.65537e-05
air sizeGroups-sum volume fraction, min, max = 1 0.999972 1
bubbles sizeGroup phase fraction first, last = 1.77403e-07 0
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.0649563, Final residual = 6.62621e-09, No Iterations 17
smoothSolver:  Solving for epsilonm, Initial residual = 0.24891, Final residual = 1.7812e-08, No Iterations 6
smoothSolver:  Solving for km, Initial residual = 0.212581, Final residual = 2.92726e-08, No Iterations 6
ExecutionTime = 0.27 s


Courant Number mean: 0.0538033 max: 1.18845
Max Ur Courant Number = 0.12208
Time = 0.00015

PIMPLE: Iteration 1
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000269397  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.148212, Final residual = 7.88969e-09, No Iterations 17
PIMPLE: Iteration 2
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000269397  Min(alpha1) = 0  Max(alpha1) = 0.25
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.0744514, Final residual = 5.55115e-09, No Iterations 18
PIMPLE: Iteration 3
MULES: Solving for alpha.air
MULES: Solving for alpha.air
alpha.air volume fraction = 0.000269397  Min(alpha1) = 0  Max(alpha1) = 0.25
populationBalance bubbles: Iteration 1
DILUPBiCGStab:  Solving for f0.air.bubbles, Initial residual = 0.0782433, Final residual = 4.79582e-11, No Iterations 1
DILUPBiCGStab:  Solving for f1.air.bubbles, Initial residual = 0.163708, Final residual = 8.79559e-11, No Iterations 1
DILUPBiCGStab:  Solving for f2.air.bubbles, Initial residual = 0.412078, Final residual = 2.36687e-10, No Iterations 1
DILUPBiCGStab:  Solving for f3.air.bubbles, Initial residual = 0.425663, Final residual = 2.43918e-10, No Iterations 1
DILUPBiCGStab:  Solving for f4.air.bubbles, Initial residual = 0.43729, Final residual = 2.49922e-10, No Iterations 1
DILUPBiCGStab:  Solving for f5.air.bubbles, Initial residual = 0.376317, Final residual = 2.14072e-10, No Iterations 1
DILUPBiCGStab:  Solving for f6.air.bubbles, Initial residual = 0.974911, Final residual = 5.33381e-10, No Iterations 1
DILUPBiCGStab:  Solving for f7.air.bubbles, Initial residual = 0.367985, Final residual = 1.98277e-10, No Iterations 1
DILUPBiCGStab:  Solving for f8.air.bubbles, Initial residual = 0.238507, Final residual = 1.18735e-10, No Iterations 1
DILUPBiCGStab:  Solving for f9.air.bubbles, Initial residual = 0.396462, Final residual = 1.61137e-10, No Iterations 1
DILUPBiCGStab:  Solving for f10.air.bubbles, Initial residual = 0.365836, Final residual = 1.05167e-10, No Iterations 1
DILUPBiCGStab:  Solving for f11.air.bubbles, Initial residual = 0.798764, Final residual = 1.27828e-10, No Iterations 1
DILUPBiCGStab:  Solving for f12.air.bubbles, Initial residual = 0.999974, Final residual = 7.83893e-11, No Iterations 1
DILUPBiCGStab:  Solving for f13.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
DILUPBiCGStab:  Solving for f14.air.bubbles, Initial residual = 0, Final residual = 0, No Iterations 0
air Sauter mean diameter, min, max = 4.65323e-05 4.65318e-05 4.65886e-05
air sizeGroups-sum volume fraction, min, max = 0.999999 0.999917 1
bubbles sizeGroup phase fraction first, last = 2.66368e-07 0
Constructing momentum equations
GAMG:  Solving for p_rgh, Initial residual = 0.0789003, Final residual = 8.16298e-09, No Iterations 16
smoothSolver:  Solving for epsilonm, Initial residual = 0.217737, Final residual = 1.58357e-08, No Iterations 6
smoothSolver:  Solving for km, Initial residual = 0.191623, Final residual = 2.29973e-08, No Iterations 8
ExecutionTime = 0.38 s

CFD中文网

主机并行运算问题