A network we can work with …

A Unison file system appliance connected with Infiniband and 10GbE.

[root@unison-jr4-2 ~]# qperf 10.3.1.1 rc_bi_bw
rc_bi_bw:
    bw  =  9.7 GB/sec

[root@unison-jr4-2 ~]# qperf 10.3.1.1 ud_lat ud_bw
ud_lat:
    latency  =  3.66 us
ud_bw:
    send_bw  =  4.9 GB/sec
    recv_bw  =  4.9 GB/sec

and of course, IPoIB

[root@unison-jr4-2 ~]# qperf 10.3.1.1 tcp_bw tcp_lat
tcp_bw:
    bw  =  474 MB/sec
tcp_lat:
    latency  =  13.4 us

which, if you run the same thing over a pair of good 10GbE ports …

[root@unison-jr4-2 ~]# qperf 10.2.1.1 tcp_bw tcp_lat
tcp_bw:
    bw  =  1.18 GB/sec
tcp_lat:
    latency  =  9.5 us

Higher bandwidth and lower latency on 10GbE than IPoIB.

Viewed 85128 times by 4160 viewers

Comments are closed.