10Gbit Connections breaks

Issues related to configuring your network
Post Reply
tgotthard
Posts: 2
Joined: 2021/04/13 14:37:47

10Gbit Connections breaks

Post by tgotthard » 2021/04/13 14:44:46

Hi All,

I currently have a problem with my 2009 CentOS 7.9 that when I have a client that writes to the server via direct connection via 1Gbit I don't have any problems but when switching to 10Gbit I have the phantom that the connection breaks when I want to write 600MB/s to the RAID. So it writes the data for a random time and then the connections has 0MB/s and then the connection gets restarted. The total RAID speed is about 1,6GB/s.

The network config (direct connection):

TYPE="Ethernet"
PROXY_METHOD="none"
BROWSER_ONLY="no"
BOOTPROTO="none"
IPADDR="172.16.5.10"
PREFIX="24"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="no"
IPV6INIT="no"
NAME="p3p1"
UUID="f6c0713a-d89d-4162-8dc2-e0f4c99a7fa0"
DEVICE="p3p1"
ONBOOT="yes"

I also added

/sbin/ifconfig p3p1 txqueuelen 10000 &>/dev/null
ethtool -A p3p1 tx on rx on
ethtool -A p3p1 autoneg on

Kind regards,

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: 10Gbit Connections breaks

Post by TrevorH » 2021/04/13 15:08:29

I do wish they hadn't decided to name the version after YYMM as 2009 sounds like it's 12 years old :(

Please show us the output from lspci -nn | grep -i net so we can see the exact model of network card that you have in the machine.

Also, check in /var/log/messages for things that may relate to the problem and show us those (and a few lines on either side for context)
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke


tgotthard
Posts: 2
Joined: 2021/04/13 14:37:47

Re: 10Gbit Connections breaks

Post by tgotthard » 2021/04/14 05:30:08

Hi TrevorH,

I used a Supermicro 4-Port 10Gbit network card: .

Here is the lspci output:

03:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
03:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
04:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
04:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710/X557-AT 10GBASE-T [8086:1589] (rev 02)
06:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710/X557-AT 10GBASE-T [8086:1589] (rev 02)
06:00.2 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710/X557-AT 10GBASE-T [8086:1589] (rev 02)
06:00.3 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710/X557-AT 10GBASE-T [8086:1589] (rev 02)
08:00.0 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
08:00.1 Ethernet controller [0200]: Intel Corporation I350 Gigabit Network Connection [8086:1521] (rev 01)
0b:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
0b:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
0c:00.0 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)
0c:00.1 Ethernet controller [0200]: Intel Corporation 82576 Gigabit Network Connection [8086:10c9] (rev 01)


@BShT: I changed already the cables to the new ones and still have the problem.

Kind regards,

User avatar
TrevorH
Site Admin
Posts: 33191
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: 10Gbit Connections breaks

Post by TrevorH » 2021/04/14 14:23:09

06:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller X710/X557-AT 10GBASE-T [8086:1589] (rev 02)
So, yes, 10GBASE-T will be extremely sensitive to cable quality so make sure you are using good quality CAT7 ones.

X710 cards were known for having problems when they were first released but most of those problems have now been fixed via firmware upgrades. I would suggest checking to see what firmware your card has and upgrading it if it is not the latest. How you do that for a Supermicro card, I do not know. For Dell cards they supply linux executables that perform the upgrade.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

Post Reply