Intel MPI sometimes fails due to incompatibility with the xpmem component that can be installed on some Linux machines. Please ask your IT support to remove this component on Linux machines where you are running Forte if you are having issues such as random failures or hangs.

These are examples of the kinds of messages you may see if xpmem is installed and causing interference with Intel MPI:

mm_xpmem.c:135  UCX  ERROR   failed to attach xpmem apid 0x1e002a1822 offset 0x155120bb5000 length 45056: Cannot allocate memory
ucp_rkey.c:449  UCX  ERROR   failed to unpack remote key from remote md[6]: Input/output error 

This is an issue known to Intel.