root is at 99% solaris 9 1

[jhahs]

Our root is at 99% and we have no extra logging going on. Have checked /var/crash, var/tmp, var/adm, (message files are not large), /var/mail. Nothing appears to be out of the ordinary. We have our root drive mirrored. Could one of the mirror drives be going out? below is the metastat and df -h results. Any suggetions??
(sorry about the formating)


# df -h

Filesystem size used avail capacity Mounted on

/dev/md/dsk/d30 14G 14G 234M 99% /
/proc 0K 0K 0K 0% /proc
mnttab 0K 0K 0K 0% /etc/mnttab
fd 0K 0K 0K 0% /dev/fd
swap 2.9G 32K 2.9G 1% /var/run
swap 2.9G 0K 2.9G 0% /tmp
/dev/md/dsk/d32 1.9G 2.2M 1.9G 1% /export/home
/dev/md/dsk/d34 16G 17M 16G 1% /export/home1
/dev/md/dsk/d33 16G 17M 16G 1% /export/home0
/dev/md/dsk/d35 16G 20M 16G 1% /export/home2
/dev/md/dsk/d36 16G 18M 16G 1% /export/home4
/dev/dsk/c3t1d0s7 33G 9.4G 24G 29% /export/home5

# metastat d30

d30: Mirror
Submirror 0: d10
State: Okay
Submirror 1: d20
State: Okay
Pass: 1
Read option: roundrobin (default)
Write option: parallel (default)
Size: 30104968 blocks (14 GB)

d10: Submirror of d30
State: Okay
Size: 30104968 blocks (14 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c0t0d0s0 0 No Okay Yes

d20: Submirror of d30
State: Okay
Size: 30104968 blocks (14 GB)
Stripe 0:
Device Start Block Dbase State Reloc Hot Spare
c2t0d0s0 0 No Okay Yes

Device Relocation Information:
Device Reloc Device ID
c0t0d0 Yes id1,sd@w5005076506c7c569
c2t0d0 Yes id1,sd@w5005076206ccc143

 

[Annihilannic]

Try SamBones' suggestion of

[tt]du -kSx / | sort -rn | head -20[/tt]

to identify the largest directories.

If the amounts don't seem to add up to the size of the filesystem, it's possible that you have some deleted files still occupying space because a process has them open. The best way to identify these is to install lsof (available from

http://www.sunfreeware.com)

and do an lsof | grep deleted.

Annihilannic.

 

[dandan123]

Annihilannic,

If a process has a deleted file open would it be freed once you do a reboot ?

 

[SamBones]

Killing the process would free the file. A reboot would kill the process.

 

[jhahs]

Tried the "lsof | grep deleted" command. nothing shows up. Tried the "du -kSx / | sort -rn | head -20" command. Reports taht the S and x option are not valid. Tried "du -h" nothing really seemed to stick out. We have booted the paint off or this box. Anyother suggestions??

 

[Annihilannic]

Apologies, I quoted the Linux switches, try this for Solaris:

[tt]du -kod /export/home | sort -rn | head -20[/tt]

Annihilannic.

 

[Annihilannic]

Err... obviously not /export/home, but you get the idea... :~/

Annihilannic.

 

[jhahs]

Found it !!! It is /dev/rmt0 and is 11 gigs.

Thanks Annihilannic

 

[spamly]

That same problem has happened to us all. Dumping to a device that doesn't exist... I must do that about once a year.