Increased dom0 memory requirement when using Mellanox® HCAs on Oracle VM Server
Oracle VM Servers running UEKR4u2 and upward in
dom0
require at least 400MB more memory to
use the Mellanox® drivers. This memory requirement is a
result of the default size of the SRQ count being increased from
64K to 256K in later versions of the kernel and the
scale_profile
option is now enabled by
default in the mlx_core
module.
In the case where out-of-memory errors are observed in dom0
, the maximum
dom0
memory size should be increased. Alternative workarounds might involve
manually setting the module parameters for the mlx4_core
driver. To set these
parameters, edit /etc/modprobe.d/mlx4_core.conf
and set
scale_profile
to 0
. Alternately, set
log_num_srq
to 16
. The preferred resolution to this issue
is to increase the memory allocated to dom0
on an Oracle VM Server. (Bug ID
23581534)