一次系统磁盘异常使用100%的处理

磁盘异常警报,使用率100%,进入服务器查看如下:

进入/目录使用du -sh * 查看没用发现占用空间过大的目录和文件,如下图:

继续使用df -i 查看inode使用率,如下:

Filesystem       Inodes  IUsed    IFree IUse% Mounted on
/dev/vda1       1310720  65510  1245210    5% /
tmpfs           2041788      4  2041784    1% /dev/shm
/dev/vdb       13107200 193203 12913997    2% /data

inode 的使用并不高,后来想到是不是文件删除之后还有进程在占用?于是使用lsof -a |grep delete,没有发现进程!!!

后来问了别人才知道,带-a参数的问题(-a是打开文件存在的进程,已经删除了的文件不存在,所以就不显示了)

之后使用lsof |grep delete 发现如下:

mysqld     1365       mysql    5u      REG              252,1          0    1053371 /tmp/ibL8JChM (deleted)
mysqld     1365       mysql    6u      REG              252,1          0    1053372 /tmp/ibyBlPxh (deleted)
mysqld     1365       mysql    7u      REG              252,1          0    1053373 /tmp/ibB2f2NM (deleted)
mysqld     1365       mysql    8u      REG              252,1          0    1053374 /tmp/ibKYgw5h (deleted)
mysqld     1365       mysql   12u      REG              252,1          0    1053375 /tmp/ibbAeeIN (deleted)
epmd      11615        root  txt       REG             252,16     151869    7864360 /data/xx_server/dbm/erts-5.10.1/bin/epmd (deleted)
beam.smp  15629        root    0u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15629        root    1u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15629        root    2u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15647        root    0u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15647        root    1u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15647        root    2u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15670        root    0u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15670        root    1u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15670        root    2u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15693        root    0u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15693        root    1u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)
beam.smp  15693        root    2u      CHR              136,1        0t0          4 /dev/pts/1 (deleted)

kill 掉所有的进程之后,磁盘空间恢复正常!

原文地址:https://www.cnblogs.com/lzhn/p/7524638.html