istgt had crashed and forced a reboot (only way to fix istgt connection failures!), which resulted in some ZFS regressions. Letting the storage to resilver for a while before onlining everything again. Work has begun to bring solo1 online. UPDATE Jabba2 array1 decided to resync as well, ETA for completion at current speed is about 5 ... Read More »
We are going to add several new arrays during the next few days and several new storage servers. We are now targeting smaller individual size with individual SSD caches to leverage more stable performance, and less effect on rest of the nodes. Solo1:5x3Tb 7200RPM with small SSD cache drive, RAID5Jabba2:5x3Tb 7200RPM with small SSD cache drive, ... Read More »
Cache was fixed on the fly - infact, it was slowing down the array with too much activity being forwarded to the ssd drive.
After adding flashcache to one of the arrays it's performing extremely slow. It will be checked up on today.
It will lead to some nodes having downtime as we look into it, but we are hoping to keep it under 2hrs.
We will be adding several arrays today, and hopefully bringing a bunch of nodes into production today as well.
