RoCE over ConnectX5 card using centos drivers

Issues related to configuring your network
Post Reply
z900collector
Posts: 3
Joined: 2020/12/01 23:39:48

RoCE over ConnectX5 card using centos drivers

Post by z900collector » 2021/03/05 03:39:14

G'Day all,

I have some new servers fitted with ConnectX5 cards and I was trying to get RDMA over Converged Ethernet working. I have TCP working over the 100G card but I was wondering if you MUST install the Mellanox OFED drivers to get RoCE working or will the Infiniband/rdma support in Centos 7.9 work with the card out of the box?

Sid
Sid


z900collector
Posts: 3
Joined: 2020/12/01 23:39:48

Re: RoCE over ConnectX5 card using centos drivers

Post by z900collector » 2021/03/07 22:10:22

I've read that one previously in my research, doesn't actually answer which is better....

THx

Sid

chemal
Posts: 776
Joined: 2013/12/08 19:44:49

Re: RoCE over ConnectX5 card using centos drivers

Post by chemal » 2021/03/08 02:52:27

If you've already read the RH docs, why did you write:
... I was wondering if you MUST install the Mellanox OFED drivers to get RoCE working or will the Infiniband/rdma support in Centos 7.9 work with the card out of the box?
The docs make it pretty clear that RoCE is supported by RHEL/CentOS 7 without 3rd-party software.

As to what is better: Both RHEL/CentOS and Mellanox OFED basically package the same upstream software. Which means that if you install Mellanox OFED you are replacing dozens of base packages and no longer have a supported CentOS installation.

Post Reply