back online

all nodes were put to boot back online a few moments ago and failed disks replaced.

FS is giving for couple of nodes error of data corruption, but most likely fsck will handle that without data loss.

7th Avq 2013
espoo servers down

the initial storage pool server suffered yet another failure today - a extremely bad batch of drives now reaching 50% failure rate within the month.

the first pool is right now resilvering but FS is warning that data corruption may have occured, it will be brought back online shortly along with the nodes.

 

7th Avq 2013
storage maintenance over

maintenance is over and network speeds has been increased.

5th Avq 2013
Storage maintenance running long

This maintenance is taking longer as expected due to some driver issues etc. for the planned upgrades.

Exact ETA is unknown, but everything will be back operational within several hours.

5th Avq 2013