vmware ESX - ISCSI versus NFS and my results

Equipment:

STORAGE:
HP DL320 Storage server running OpenFiler
6TB of 500gb sata disks in raid 6+hotspare

ESX
HP DL385 single quad with 8gb ram

Issue:
Terrible performance from VM's hosted on presented ISCSI luns.

Soo... i started to investigate.

first, i tried block/io versus file/io on the iscsi luns within openfiler with no change in result.
second, created a nfs lun that i presented, did a little svmotion magic from iscsi to nfs lun and....

welll here are the hdparm results:

ISCSI -

Code:

Timing cached reads: 1862 MB in 2.00 seconds = 1328.39 MB/sec
Timing buffered disk reads: 88 MB in 3.02 seconds = 29.13 MB/sec

NFS-

Code:

/dev/sda:
Timing cached reads: 1860 MB in 2.00 seconds = 929.72 MB/sec
Timing buffered disk reads: 180 MB in 3.05 seconds = 59.07 MB/sec

kind of odd huh? well i just updated openfiler, ill let you know what happens!