Increased dom0
memory requirement when using Mellanox
HCAs on Oracle VM Server
Oracle VM Servers running UEKR4u2 and upward in
dom0
require at least 400MB more memory to
use the Mellanox® drivers. This memory requirement is a
result of the default size of the SRQ count being increased from
64K to 256K in later versions of the kernel and the
scale_profile
option is now enabled by
default in the mlx_core
module.
In the case where out-of-memory errors are observed in dom0
, the maximum
dom0
memory size should be increased. Alternative workarounds might involve
manually setting the module parameters for the mlx4_core
driver. To set these
parameters, edit /etc/modprobe.d/mlx4_core.conf
and set
scale_profile
to 0
. Alternately, set
log_num_srq
to 16
. The preferred resolution to this issue
is to increase the memory allocated to dom0
on an Oracle VM Server. (Bug ID
23581534)