Re: File system full in Virtual-Chassis 4 EX2200

One of the reason could be the /var/rundb directory on the FPC0 is full and so no further commits can be made until space has been cleaned up. Time to cleanup the /var in the box!

box> show system storage

Filesystem              Size       Used      Avail  Capacity   Mounted on

/dev/ad0s1a             3.2G       315M       2.6G       11%  /

---------SNIP------

/dev/ad0s1e             61M        16M       316M        5%  /config

procfs                  4.0K       4.0K         0B      100%  /proc

/dev/ad1s1f              24G        23G      -1.4G      106%  /var  <<<<<<<<<<< Var is full

Next Preferable Action

----------------------

You can remove previous core-dump files from /var/tmp and free the space

Also Junos safe storage clean-up:

http://www.juniper.net/techpubs/en_US/junos13.2/topics/reference/command-summary/request-system-storage-cleanup.html

request system storage cleanup dry-run <<< to only see the files and it will not delete any

lab> request system storage cleanup dry-run

List of files to delete:

         Size Date         Name

    11B Nov 30 09:05 /var/jail/tmp/alarmd.ts

  55.9K Jan 18 04:15 /var/log/interactive-commands.0.gz

 127.1K Jan 18 04:15 /var/log/messages.0.gz

 286.5K Jan 18 02:15 /var/log/messages.1.gz

 260.0K Jan 17 22:15 /var/log/messages.2.gz

 260.2K Jan 17 19:15 /var/log/messages.3.gz

 258.9K Jan 17 16:45 /var/log/messages.4.gz

 238.8K Jan 17 14:45 /var/log/messages.5.gz

 255.1K Jan 17 13:15 /var/log/messages.6.gz

 362.3K Jan 17 12:00 /var/log/messages.7.gz

 523.9K Jan 16 08:15 /var/log/messages.8.gz

   301B Jan 18 04:15 /var/log/smartd.trace.0.gz

  4563B Jan 18 04:12 /var/log/wtmp.0.gz

   191B Jan 12 05:12 /var/log/wtmp.1.gz

    45B Oct 12 05:53 /var/preserve/jdhcp_client_data

    45B Oct  7 21:00 /var/preserve/jdhcp_client_data_bkp

     0B Jan 12 05:00 /var/tmp/LOCK_FILE

    46B Jan 12 04:59 /var/tmp/kmdchk.log

    57B Jan 17 10:05 /var/tmp/krt_rpf_filter.txt

    42B Jan 12 04:59 /var/tmp/pfe_debug_commands

     0B Jan 12 05:00 /var/tmp/rtsdb/if-rtsdb

lab>

Super Trick:

We can use following command to find out files above 10 mb

root% sh -c 'find /var -size +10485760c 2> /dev/null' | xargs du -h | sort -nr

823M    /var/sw/pkg/jinstall64-14.2R6.5-domestic-signed.tgz

823M    /var/home/labroot/jinstall64-14.2R6.5-domestic-signed.tgz

816M    /var/sw/pkg/jbundle64-14.2R6.5.tgz

741M    /var/sw/pkg/jinstall64-13.3R9.13-domestic-signed.tgz

741M    /var/home/labroot/jinstall64-13.3R9.13-domestic-signed.tgz

734M    /var/sw/pkg/jbundle64-13.3R9.13.tgz

524M    /var/home/lab/jinstall64-vrr-14.2R4.9-domestic-signed.vmdk

100M    /var/db/cfm.db

 96K    /var/db/transport.db

 96K    /var/db/alarm.db

 64K    /var/db/idpd/db/__db.003

 28M    /var/rundb/schema.db

 11M    /var/db/appid/bins/libqmprotocols.so.xlr64slot2

 11M    /var/db/appid/bins/libqmprotocols.so.xlr64slot1

 11M    /var/db/appid/bins/libqmprotocols.so.xlp64slot2

 11M    /var/db/appid/bins/libqmprotocols.so.xlp64slot1

 10M    /var/log/shmlog/pfed/pfed-debug.4.ent

root%

You can also delete the files under /var/sw/pkg/:

root% ls -l  /var/sw/pkg/

total 6612040

-rw-r--r--  1 root  wheel  769086997 Dec  6 23:14 jbundle64-13.3R9.13.tgz

-rw-r--r--  1 root  wheel  855145358 Dec 15 03:24 jbundle64-14.2R6.5.tgz

-rw-r--r--  1 root  wheel  776660773 Dec  6 11:06 jinstall64-13.3R9.13-domestic-signed.tgz

-rw-r--r--  1 root  wheel  862789519 Dec 15 03:17 jinstall64-14.2R6.5-domestic-signed.tgz

-rw-r--r--  1 root  wheel     123046 Dec  6 23:11 jservices-aacl-pic-13.3R9.13.tgz

-rw-r--r--  1 root  wheel     125698 Dec 15 03:22 jservices-aacl-pic-14.2R6.5.tgz

-rw-r--r--  1 root  wheel     125727 Nov  7 05:04 jservices-aacl-pic-14.2R7.5.tgz

-rw-r--r--  1 root  wheel     437860 Dec  6 23:11 jservices-alg-pic-13.3R9.13.tgz

-rw-r--r--  1 root  wheel     466713 Dec 15 03:22 jservices-alg-pic-14.2R6.5.tgz

Let me know if you have any other questions on this.