Draft: mlx5, MACsec offload support with RoCE traffic

Description:

Hi all,

This MR contains the patch set supporting macsec offload with ROCE traffic:
patch set + description:
https://lore.kernel.org/all/cover.1691403485.git.leon@kernel.org/

Dependencies:

This patch set was built on top of the following MR's:
Depends: !3485 (merged)
Depends: !3563 (merged)
Depends: !3647 (merged)
Depends: !3645 (merged)
Depends: !3648 (merged)

JIRA:

JIRA: https://issues.redhat.com/browse/RHEL-22227

Upstream-status:

All patches are accepted upstream to Linus tree.
each patch commit message describes its origin.

Testing:

This patch set passed incremental build testing to verify that it is bisectable.
Sanity tests ran over mlx5 drivers on x86_64 systems (using ConnectX-4/5/6),
including the following:

Ethernet:
-- IPv4 traffic (ICMP, TCP, UDP).
-- IPv6 traffic (ICMP, TCP, UDP).

VLAN:
-- IPv4 traffic (ICMP, TCP, UDP).
-- IPv6 traffic (ICMP, TCP, UDP).

RoCE:
-- RDMA (ibv_*_pingpong).
-- RDMACM (examples that comes with librdmacm packages).

Infiniband:
-- RDMA (ibv_*_pingpong).
-- RDMACM (examples that comes with librdmacm packages).

IPoIB:
-- IPv4 traffic (ICMP, TCP, UDP).
-- IPv6 traffic (ICMP, TCP, UDP).

PKey:
-- IPv4 traffic (ICMP, TCP, UDP).
-- IPv6 traffic (ICMP, TCP, UDP).

ASAP2/OVS:
-- Various sanity tests covering OVS offloads.

NFSoRDMA:
-- Discover, mount and write.

iSER:
-- Discover, login and mount.

SRP:
-- Verify srp_daemon service is up and system can discover SRP targets.

Signed-off-by: Amir Tzin atzin@redhat.com