Increased dom0
memory requirement when using Mellanox
HCAs on Oracle VM Server
Oracle VM Servers running UEKR4u2 and upward in
dom0
require at least 400MB more memory to
use the Mellanox® drivers. This memory requirement is a
result of the default size of the SRQ count being increased from
64K to 256K in later versions of the kernel and the
scale_profile
option is now enabled by
default in the mlx_core
module.
In the case where out-of-memory errors are observed in
dom0
, the maximum dom0
memory size should be increased. Alternative workarounds might
involve manually setting the module parameters for the
mlx4_core
driver. To set these parameters,
edit /etc/modprobe.d/mlx4_core.conf
and set
scale_profile
to 0
.
Alternately, set log_num_srq
to
16
. The preferred resolution to this issue is
to increase the memory allocated to dom0
on
an Oracle VM Server. (Bug ID 23581534)