HA iSCSI Target with DRBD (2 node cluster how-to)

Issues related to applications and software problems
User avatar
TrevorH
Site Admin
Posts: 33202
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by TrevorH » 2019/08/10 15:32:03

If it's the same as DRBD8 then you need to bump up:

Code: Select all

disk { al-extents 3389; }
net {                 max-buffers 72000;
                max-epoch-size 20000;
                sndbuf-size 1M;
}
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by hunter86_bg » 2019/08/10 16:39:42

Post ping results of '-c 4' .
Are you using one 10GbE interface or multiple small ones ?
You can check with 'iftop' current network usage.

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by hunter86_bg » 2019/08/10 16:45:49

Have you checked this one ?

ladam@ictuniverse.eu
Posts: 12
Joined: 2019/07/14 12:17:27

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by ladam@ictuniverse.eu » 2019/08/10 20:42:40

So,

It's one 10 GB interface on each server directly connected via direct fiber. Only used for sync. MTU set to 9000

[root@san3 ~]# ethtool ens3f4 | grep -i speed
Speed: 10000Mb/s
[root@san3 ~]#


[root@san3 ~]# ping 10.0.0.31 -c 4
PING 10.0.0.31 (10.0.0.31) 56(84) bytes of data.
64 bytes from 10.0.0.31: icmp_seq=1 ttl=64 time=0.181 ms
64 bytes from 10.0.0.31: icmp_seq=2 ttl=64 time=0.136 ms
64 bytes from 10.0.0.31: icmp_seq=3 ttl=64 time=0.087 ms
64 bytes from 10.0.0.31: icmp_seq=4 ttl=64 time=0.142 ms

--- 10.0.0.31 ping statistics ---
4 packets transmitted, 4 received, 0% packet loss, time 2999ms
rtt min/avg/max/mdev = 0.087/0.136/0.181/0.035 ms

Iftop average: 550 Mb

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by hunter86_bg » 2019/08/11 01:35:41

Latency is OK, interface should be OK.

Most probaly it's a drbd sync limit.Check the link in my previous comment - it might help you speedup the situation.

ladam@ictuniverse.eu
Posts: 12
Joined: 2019/07/14 12:17:27

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by ladam@ictuniverse.eu » 2019/08/11 10:12:37

Hi,

With this in the drbd0.res, I reach 1.5 GB in iftop.

disk { al-extents 3389;
no-disk-flushes ;
no-disk-barrier;
c-plan-ahead 50;
c-fill-target 24M;
c-min-rate 10M;
c-max-rate 1000M;
}


net { max-buffers 72000;
max-epoch-size 20000;
sndbuf-size 2M;
cram-hmac-alg sha1;
shared-secret "FooFunFactory";

}

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by hunter86_bg » 2019/08/11 16:22:49

ladam@ictuniverse.eu wrote:
2019/08/11 10:12:37
Hi,

With this in the drbd0.res, I reach 1.5 GB in iftop.

disk { al-extents 3389;
no-disk-flushes ;
no-disk-barrier;
c-plan-ahead 50;
c-fill-target 24M;
c-min-rate 10M;
c-max-rate 1000M;
}


net { max-buffers 72000;
max-epoch-size 20000;
sndbuf-size 2M;
cram-hmac-alg sha1;
shared-secret "FooFunFactory";

}
Great to hear that.
Just change the 'shared-secret' if you go over the internet... Well, it's always a good idea to chabge it - as its the default in the docs.

ladam@ictuniverse.eu
Posts: 12
Joined: 2019/07/14 12:17:27

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by ladam@ictuniverse.eu » 2019/08/11 16:58:20

Hi,

So not so great. Rate was probably due to 2 drbd source at the same time.
Max is still 550 Mb.
each.
So I'm still looking because my goal is to sync 3 servers with 80 TB.
For the secret, yes but for now it's only on a private network.

Regards and thanks for your support

hunter86_bg
Posts: 2019
Joined: 2015/02/17 15:14:33
Location: Bulgaria
Contact:

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by hunter86_bg » 2019/08/11 18:51:06

If you have 3 servers , you might consider GlusterFS with a 'replica 3' volume.

The setup is way easier.

nafiz
Posts: 1
Joined: 2019/06/25 07:27:49

Re: HA iSCSI Target with DRBD (2 node cluster how-to)

Post by nafiz » 2019/08/30 13:13:52

Thank you for this awesome and detailed implementation of DRBD with two node. It works !!!!! but unfortunately does not work with target. Works with tgtd. And also works in CentOS 7.6 smoothly.

Post Reply