This morning the / file system was full on one of our AIX servers:
root@host[/root] > df
Filesystem 512-blocks Free %Used Iused %Iused Mounted on
/dev/hd4 524288 0 100% 5311 89% /
I didn’t take more than a few seconds to realize where this came from:
root@host[/root] > cd /
root@host[/] > du -x -k | sort -n | tail -5
root@host[/] > cd dev
root@nim1[/dev] > ls -lSr | tail -1
-rw-r--r-- 1 root system 185118720 Sep 2 15:26 null 2>&1
The database server has been victim of a violent outage in the datacenter where monkeys like to switch off the power on the main switch.
It’s currently being checked and restored, which will take about 12 hours.
To avoid problems with the running database, I stopped the Web service on the web server.
SaveSpell.com will be back on Wednesday, October 17, 2007.
Sorry for the inconvenience.
I made a maintenance where I had to stop new domains’ import. Unfortunately I forgot to enable the script afterwards.
Now things are back in order.
Thank you for your reports.