ian351c
Patron
- Joined
- Oct 20, 2011
- Messages
- 219
Hi All,
I recently did an upgrade to my FreeNAS box, which has been performing great for the last few years. I have lately noticed that performance seemed to be slower than I was used to and upon upgrading to 9.2 this morning, performance is in the toilet. I've been using FreeNAS for years now (so I'm not exactly a noob, though I don't claim to understand all the nuances of ZFS, if such a claim is even possible).
Old System:
Core i3 2500S
8GB RAM
3Ware 9650 (all drives in Single mode, write cache enabled)
5x 2TB drives
A single ZFS RAIDZ1 dev/vol
New system:
Core i3 2500S (same as the old one)
16GB RAM
3Ware 9650 (same controller) (all drives in Single mode, write cache enabled)
6x 3TB drives (3x Hitachi and 3x WD)
A single ZFS RAIDZ2 dev/vol with Compression turned on
I've also started doing scheduled snapshots, which I wasn't doing before. Every 4 hours with a 6 week lifetime.
Before the hardware upgrade, running FreeNAS 8.x and 9.0/9.1 I was seeing upwards of 120GB/s read and write performance, which meant I was capable of saturating the network link, which is plenty good enough for me.
After the hardware upgrade, running FreeNAS 9.1, I was seeing 60MB/s read and write performance both across the network and locally using dd. Not horrible, but not what I was expecting.
After upgrading to FreeNAS 9.2 performance is now at 2.5MB/s write and about 25MB/s read, which is unusable.
gstat looks like this whenever any reading or writing is done:
These are the parameters autotune has enabled:
I've searched the forums and haven't come up with anything exactly like my problem, though I've seen a few threads that suggest a lot of RAM with a relatively small pool may be a problem (though my issues aren't "bursty" at all). And I've seen various opinions on using a RAID controller with ZFS (though this has worked well for me over the years).
I'm hoping someone can point out a tuneable parameter or something to try to get performance back to where it was on this system.
Any help is appreciated.
Thanks!
I recently did an upgrade to my FreeNAS box, which has been performing great for the last few years. I have lately noticed that performance seemed to be slower than I was used to and upon upgrading to 9.2 this morning, performance is in the toilet. I've been using FreeNAS for years now (so I'm not exactly a noob, though I don't claim to understand all the nuances of ZFS, if such a claim is even possible).
Old System:
Core i3 2500S
8GB RAM
3Ware 9650 (all drives in Single mode, write cache enabled)
5x 2TB drives
A single ZFS RAIDZ1 dev/vol
New system:
Core i3 2500S (same as the old one)
16GB RAM
3Ware 9650 (same controller) (all drives in Single mode, write cache enabled)
6x 3TB drives (3x Hitachi and 3x WD)
A single ZFS RAIDZ2 dev/vol with Compression turned on
I've also started doing scheduled snapshots, which I wasn't doing before. Every 4 hours with a 6 week lifetime.
Before the hardware upgrade, running FreeNAS 8.x and 9.0/9.1 I was seeing upwards of 120GB/s read and write performance, which meant I was capable of saturating the network link, which is plenty good enough for me.
After the hardware upgrade, running FreeNAS 9.1, I was seeing 60MB/s read and write performance both across the network and locally using dd. Not horrible, but not what I was expecting.
After upgrading to FreeNAS 9.2 performance is now at 2.5MB/s write and about 25MB/s read, which is unusable.
gstat looks like this whenever any reading or writing is done:
Code:
dT: 2.116s w: 2.000s filter: da.$ L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 1 13 0 0 0.0 10 100 90.3 93.0| da0 1 13 0 0 0.0 9 85 99.5 106.5| da1 0 15 0 0 0.0 11 85 83.2 103.3| da2 0 15 0 0 0.0 11 85 83.0 102.8| da3 0 15 0 0 0.0 11 91 82.8 101.4| da4 1 13 0 0 0.0 10 100 90.4 94.8| da5
These are the parameters autotune has enabled:
Code:
kern.ipc.maxsockbuf 2097152 net.inet.tcp.recvbuf_max 2097152 net.inet.tcp.sendbuf_max 2097152 vfs.zfs.arc_max 10571784283 vm.kmem_size 11746426982 vm.kmem_size_max 14683033728
I've searched the forums and haven't come up with anything exactly like my problem, though I've seen a few threads that suggest a lot of RAM with a relatively small pool may be a problem (though my issues aren't "bursty" at all). And I've seen various opinions on using a RAID controller with ZFS (though this has worked well for me over the years).
I'm hoping someone can point out a tuneable parameter or something to try to get performance back to where it was on this system.
Any help is appreciated.
Thanks!