计算服务器的问题

[shrine]

系统是centos，是运维帮忙安装的of9，自己用xshell登录进去运行算例没有问题，上传pbs脚本运行就会出现mpicc ：command not found

[xpqiu]

试试把 MPI 的路径写到系统的 PATH 和 LD_LIBRARY_PATH 里面去。

另外说个题外话，你的 pbs脚本里面最后一句有点问题，你需要指定 hostfile，要不然不管你用多少核，都只会在头节点上运行。比如上面，你制定了两个节点 cu01 和 cu02，每个32核共64核，但是如果按照你上面这个脚本提交作业，那么实际上是会在 cu01上面启动64个进程，cu02则空闲。

[cccrrryyy]

@shrine 是不是装了别的版本的openfoam？xshell登录进去运行算例是怎么运行的？

[shrine]

@cccrrryyy 我自己装了of8，运行不成功，出现glibc库版本不够。

运维装的of9，xshell登录进去，多线程并行运行没有问题

提交脚本就显示mpicc找不到，现在运维那边说就是glibc的原因

[shrine]

@xpqiu 我在

https://www.cfd-china.com/topic/5535/rhel怎么安装of/14
里是自己安装的of8，用xshell运行遇到glibc版本低的问题

运维安装了of9，用xshell运行mpi算例没有问题，但是用脚本提交就不行，估计运维把mpicc目录添加进去了，最终还是变成glibc版本太低

[xpqiu]

@shrine
可以在作业提交脚本里面加一些 echo 语句

echo "PATH=$PATH"
echo "LD_LIBRARY_PATH=$LD_LIBRARY_PATH"
ldd $(which interFoam) 

同时，在你的 xshell里面，登录到服务器也执行这三个命令，对比一下输出有何区别，这样有助于定位问题。

[shrine]

@xpqiu

PATH=/usr/lib64/openmpi/bin:/home/xry/OpenFOAM/xry-2112/platforms/linux64GccDPInt32Opt/bin:/usr/lib/openfoam/openfoam2112/site/2112/platforms/linux64GccDPInt32Opt/bin:/usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/bin:/usr/lib/openfoam/openfoam2112/bin:/usr/java/jre1.8.0_151/bin:/opt/tsce4/maui/sbin:/opt/tsce4/maui/bin:/opt/tsce4/torque6/bin:/opt/tsce4/torque6/sbin:/usr/local/bin:/opt/software/openmpi/bin:/usr/mpich/bin:/usr/bin:/usr/local/sbin:/usr/sbin:.:/home/xry/.local/bin:/home/xry/bin

LD_LIBRARY_PATH=/home/xry/OpenFOAM/xry-2112/platforms/linux64GccDPInt32Opt/lib:/usr/lib/openfoam/openfoam2112/site/2112/platforms/linux64GccDPInt32Opt/lib:/usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/sys-openmpi:/usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib:/usr/lib/openfoam/openfoam2112/ThirdParty/platforms/linux64GccDPInt32/lib/sys-openmpi:/usr/lib/openfoam/openfoam2112/ThirdParty/platforms/linux64GccDPInt32/lib:/usr/lib64/openmpi/lib:/usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/dummy:/opt/software/openmpi/lib:/software/openmpi/lib:/usr/mpich/lib:/usr/local/mpc/lib:/usr/local/gmp/lib:/usr/local/mpfr-4.1.0/lib

	linux-vdso.so.1 =>  (0x00007ffce15f4000)
	libfiniteVolume.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libfiniteVolume.so (0x00007faff29f9000)
	libfvOptions.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libfvOptions.so (0x00007faff2583000)
	libmeshTools.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libmeshTools.so (0x00007faff1c79000)
	libsampling.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libsampling.so (0x00007faff1568000)
	libdynamicFvMesh.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libdynamicFvMesh.so (0x00007faff12ad000)
	libincompressibleTransportModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libincompressibleTransportModels.so (0x00007faff101a000)
	libinterfaceProperties.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libinterfaceProperties.so (0x00007faff0d9c000)
	libimmiscibleIncompressibleTwoPhaseMixture.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libimmiscibleIncompressibleTwoPhaseMixture.so (0x00007faff0b91000)
	libturbulenceModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libturbulenceModels.so (0x00007faff073a000)
	libincompressibleTurbulenceModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libincompressibleTurbulenceModels.so (0x00007faff02a7000)
	libwaveModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libwaveModels.so (0x00007fafeffd5000)
	libVoFphaseTurbulentTransportModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libVoFphaseTurbulentTransportModels.so (0x00007fafefc15000)
	libincompressibleInterPhaseTransportModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libincompressibleInterPhaseTransportModels.so (0x00007fafefa12000)
	libOpenFOAM.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libOpenFOAM.so (0x00007fafeeca9000)
	libdl.so.2 => /lib64/libdl.so.2 (0x00007fafeeaa5000)
	libstdc++.so.6 => /lib64/libstdc++.so.6 (0x00007fafee79d000)
	libm.so.6 => /lib64/libm.so.6 (0x00007fafee49b000)
	libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00007fafee285000)
	libpthread.so.0 => /lib64/libpthread.so.0 (0x00007fafee069000)
	libc.so.6 => /lib64/libc.so.6 (0x00007fafedc9c000)
	libPstream.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/sys-openmpi/libPstream.so (0x00007fafeda81000)
	libfileFormats.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libfileFormats.so (0x00007fafed6c5000)
	libsurfMesh.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libsurfMesh.so (0x00007fafed287000)
	libfluidThermophysicalModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libfluidThermophysicalModels.so (0x00007fafecac0000)
	libsolidThermo.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libsolidThermo.so (0x00007fafec7c2000)
	libcompressibleTurbulenceModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libcompressibleTurbulenceModels.so (0x00007fafec2eb000)
	libdynamicMesh.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libdynamicMesh.so (0x00007fafebbc5000)
	liblagrangian.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/liblagrangian.so (0x00007fafeb980000)
	libtwoPhaseMixture.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libtwoPhaseMixture.so (0x00007fafeb766000)
	libtwoPhaseProperties.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libtwoPhaseProperties.so (0x00007fafeb519000)
	libspecie.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libspecie.so (0x00007fafeaea1000)
	libz.so.1 => /lib64/libz.so.1 (0x00007fafeac8b000)
	/lib64/ld-linux-x86-64.so.2 (0x00007faff511c000)
	libmpi.so.12 => /usr/lib64/openmpi/lib/libmpi.so.12 (0x00007fafea9a7000)
	libcompressibleTransportModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libcompressibleTransportModels.so (0x00007fafea7a3000)
	libthermophysicalProperties.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libthermophysicalProperties.so (0x00007fafea466000)
	libsolidSpecie.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libsolidSpecie.so (0x00007fafea234000)
	libreactionThermophysicalModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libreactionThermophysicalModels.so (0x00007fafe940c000)
	libradiationModels.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libradiationModels.so (0x00007fafe9052000)
	libextrudeModel.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libextrudeModel.so (0x00007fafe8e22000)
	libopen-rte.so.12 => /usr/lib64/openmpi/lib/libopen-rte.so.12 (0x00007fafe8ba6000)
	libopen-pal.so.13 => /usr/lib64/openmpi/lib/libopen-pal.so.13 (0x00007fafe8902000)
	librt.so.1 => /lib64/librt.so.1 (0x00007fafe86fa000)
	libutil.so.1 => /lib64/libutil.so.1 (0x00007fafe84f7000)
	libhwloc.so.5 => /lib64/libhwloc.so.5 (0x00007fafe82ba000)
	libSLGThermo.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libSLGThermo.so (0x00007fafe80b2000)
	libdistributed.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libdistributed.so (0x00007fafe7e37000)
	libblockMesh.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libblockMesh.so (0x00007fafe7b93000)
	libnuma.so.1 => /lib64/libnuma.so.1 (0x00007fafe7987000)
	libltdl.so.7 => /lib64/libltdl.so.7 (0x00007fafe777d000)
	libdecompositionMethods.so => /usr/lib/openfoam/openfoam2112/platforms/linux64GccDPInt32Opt/lib/libdecompositionMethods.so (0x00007fafe74ec000)