Been playing with ZFS dedupe for the last two weeks and just wanted to share my findings.
Setup OpenSolaris build 131
Sun X4200, 2 x Dual Core Opteron 2.6Ghz, 8Gb Ram, 4 x 73Gb SAS 10Krpm
root@osol:~# zfs list
NAME USED AVAIL REFER MOUNTPOINT
compress 72K 66.9G 21K /compress
dedupe 72K 66.9G 21K /dedupe
root@osol:~# zfs set compression=on compress
root@osol:~# zfs set dedup=on dedupe
Wanted to see how much real data would dedupe.
I loaded the my company project/Software folders, 68,000 files (Visio/PDF/Project/Word/OpenOffice/Excel,ISO's... ) total of 38.9Gb
Load times, copying files from local UFS filesystem to ZFS dataset.
root@osol:/ufs# ptime tar cf - iso projects software | pv | ( cd /dedupe/ ; tar xf - )
real 19:51.930407394
user 5.807881662
sys 1:48.025965013
38.8GB 0:19:51 [33.3MB/s]
root@osol:/ufs# ptime tar cf - iso projects software | pv | ( cd /compress/ ; tar xf - )
real 18:46.5443211…
Comments