What would be considered good iSCSI bonnie performance?

I am curious. Running JackRabbit with a pair of 10 GbE cards. Getting some numbers, want to compare to others to see where we stand.

Is more than 100 MB/s good? More than 200 MB/s? 300 MB/s?

10 GbE should give us ~1000MB/s. What fraction of the maximum bandwidth are you seeing in your iSCSI connection?

We haven’t started tuning this yet. I just want to see where we are.

Viewed 14259 times by 3132 viewers

Facebooktwittergoogle_plusredditpinterestlinkedinmail

2 thoughts on “What would be considered good iSCSI bonnie performance?

  1. Hmm… It kind of depends on the CPU since it has to do the encoding and decoding on either end. 🙂 What kind of numbers are you seeing now?

  2. Well I am seeing about 500 MB/s writes and 400 MB/s reads (ballpark). Here is from the write:

    [root@pegasus-a ~]# ./simple-write.bash
    + sync
    + echo -n ‘start at ‘
    start at + date
    Thu Jan 31 22:34:46 EST 2008
    + dd if=/dev/zero of=/big/local.file.7858 bs=8388608 count=100000 oflag=direct
    100000+0 records in
    100000+0 records out
    838860800000 bytes (839 GB) copied, 1684.05 seconds, 498 MB/s
    + sync
    + echo -n ‘stop at ‘
    stop at + date
    Thu Jan 31 23:02:50 EST 2008

    And this is a snapshot of the dstat from the read


    ----total-cpu-usage---- -dsk/total- -net/total- ---paging-- ---system--
    usr sys idl wai hiq siq| read writ| recv send| in out | int csw
    0 2 94 2 0 1|6845k 17M| 0 0 | 0.4 10B|2275 586
    0 4 74 0 3 19| 442M 0 | 445M 364k| 0 0 | 11k 1065
    0 4 74 0 3 19| 443M 0 | 445M 365k| 0 0 | 11k 987
    0 3 74 1 3 18| 444M 164k| 448M 367k| 0 0 | 11k 1007
    0 3 74 0 4 18| 443M 0 | 446M 363k| 0 0 | 11k 959
    0 4 74 0 4 18| 442M 0 | 446M 365k| 0 0 | 11k 1073

    Numbers I have seen on a few mailing lists suggest higher for SRP (IB based, I am using 10GbE).

    BTW: this is *not* to nullio. This is going to disk. We have more head room, so I am trying to figure out how to get at it.

    Does TOE help these at 10GbE speeds? I/OAT? Any data on this?

Comments are closed.