Clean up or resize webapp-01 - 90% disk usage

We need to clean up or resize webapp-01 because it is currently using >90% disk usage

webapp-01: space usage 90.7% matches resource limit [space usage<90.0%]

https://gitter.pagerduty.com/incidents/PZHIETZ


deployer@webapp-01:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            3.7G   12K  3.7G   1% /dev
tmpfs           749M  424K  748M   1% /run
/dev/xvda1      7.8G  6.7G  650M  92% /
none            4.0K     0  4.0K   0% /sys/fs/cgroup
none            5.0M     0  5.0M   0% /run/lock
none            3.7G     0  3.7G   0% /run/shm
none            100M     0  100M   0% /run/user

The logs are currently taking up 2GB

Log size breakdown

deployer@webapp-01:~$ ls -la /var/log/upstart/ --block-size=M
total 1945M
drwxr-xr-x  2 root root     1M Apr  6 06:33 .
drwxrwxr-x 15 root syslog   1M Apr 24 06:46 ..
-rw-r-----  1 root root   204M Apr 24 19:42 gitter-api-1.log.1
-rw-r-----  1 root root    33M Mar 22 03:22 gitter-api-1.log.2.gz
-rw-r-----  1 root root     8M Feb 15 22:28 gitter-api-1.log.3.gz
-rw-r-----  1 root root     6M Feb  5 18:48 gitter-api-1.log.4.gz
-rw-r-----  1 root root     5M Jan 28 15:05 gitter-api-1.log.5.gz
-rw-r-----  1 root root     4M Jan 21 20:55 gitter-api-1.log.6.gz
-rw-r-----  1 root root     3M Nov 13 18:12 gitter-api-1.log.7.gz
-rw-r-----  1 root root   126M Apr 24 19:42 gitter-api-2.log.1
-rw-r-----  1 root root    16M Apr  4 08:43 gitter-api-2.log.2.gz
-rw-r-----  1 root root    27M Mar 15 08:47 gitter-api-2.log.3.gz
-rw-r-----  1 root root    21M Feb 15 22:28 gitter-api-2.log.4.gz
-rw-r-----  1 root root     3M Jan  4 10:55 gitter-api-2.log.5.gz
-rw-r-----  1 root root     5M Dec 30 10:08 gitter-api-2.log.6.gz
-rw-r-----  1 root root    32M Dec 21 09:10 gitter-api-2.log.7.gz
-rw-r-----  1 root root   674M Apr 24 19:41 gitter-api-staging-1.log.1
-rw-r-----  1 root root     6M Feb 15 22:28 gitter-api-staging-1.log.2.gz
-rw-r-----  1 root root     1M Jun 22  2017 gitter-api-staging-1.log.3.gz
-rw-r-----  1 root root     1M Jun 19  2017 gitter-api-staging-1.log.4.gz
-rw-r-----  1 root root     1M Jun 13  2017 gitter-api-staging-1.log.5.gz
-rw-r-----  1 root root     1M Jun  8  2017 gitter-api-staging-1.log.6.gz
-rw-r-----  1 root root     1M Jun  1  2017 gitter-api-staging-1.log.7.gz
-rw-r-----  1 root root   347M Apr 24 19:42 gitter-web-1.log.1
-rw-r-----  1 root root     8M Feb 15 22:28 gitter-web-1.log.2.gz
-rw-r-----  1 root root     1M Jun 22  2017 gitter-web-1.log.3.gz
-rw-r-----  1 root root     5M Jun 19  2017 gitter-web-1.log.4.gz
-rw-r-----  1 root root     8M Jun  1  2017 gitter-web-1.log.5.gz
-rw-r-----  1 root root    11M May  4  2017 gitter-web-1.log.6.gz
-rw-r-----  1 root root     3M Mar 24  2017 gitter-web-1.log.7.gz
-rw-r-----  1 root root   354M Apr 24 19:42 gitter-web-2.log.1
-rw-r-----  1 root root     8M Feb 15 22:28 gitter-web-2.log.2.gz
-rw-r-----  1 root root     1M Jun 22  2017 gitter-web-2.log.3.gz
-rw-r-----  1 root root     5M Jun 19  2017 gitter-web-2.log.4.gz
-rw-r-----  1 root root     8M Jun  1  2017 gitter-web-2.log.5.gz
-rw-r-----  1 root root    11M May  4  2017 gitter-web-2.log.6.gz
-rw-r-----  1 root root     3M Mar 24  2017 gitter-web-2.log.7.gz
-rw-r-----  1 root root     6M Apr 24 19:25 gitter-web-staging-1.log.1
-rw-r-----  1 root root     2M Feb 15 22:28 gitter-web-staging-1.log.2.gz
-rw-r-----  1 root root     1M Jun 22  2017 gitter-web-staging-1.log.3.gz
-rw-r-----  1 root root     1M Jun 19  2017 gitter-web-staging-1.log.4.gz
-rw-r-----  1 root root     1M Jun 13  2017 gitter-web-staging-1.log.5.gz
-rw-r-----  1 root root     1M Jun  8  2017 gitter-web-staging-1.log.6.gz
-rw-r-----  1 root root     1M Jun  1  2017 gitter-web-staging-1.log.7.gz
-rw-r-----  1 root root     1M Mar 15  2017 monit.log.1
-rw-r-----  1 root root     1M Jul 12  2016 monit.log.2.gz
-rw-r-----  1 root root     1M Feb 25  2016 monit.log.3.gz
-rw-r-----  1 root root     1M Jun 20  2016 nginx.log.1
-rw-r-----  1 root root     1M Feb 25  2016 nginx.log.2.gz
-rw-r-----  1 root root     1M Jan 23 06:35 pollinate.log.1
-rw-r-----  1 root root     1M Aug 16  2016 pollinate.log.2.gz
-rw-r-----  1 root root     1M May 10  2016 pollinate.log.3.gz
-rw-r-----  1 root root     1M Mar 30  2016 redis-sentinel.log.1.gz
-rw-r-----  1 root root     1M Mar 30  2016 redis-sentinel.log.2.gz
-rw-r-----  1 root root     1M Mar 24  2016 redis-sentinel.log.3.gz
-rw-r-----  1 root root     1M Mar 21  2016 redis-sentinel.log.4.gz
-rw-r-----  1 root root     1M Mar 19  2016 redis-sentinel.log.5.gz
-rw-r-----  1 root root     1M Mar 17  2016 redis-sentinel.log.6.gz
-rw-r-----  1 root root     1M Mar 12  2016 redis-sentinel.log.7.gz
-rw-r-----  1 root root     1M Apr 22  2016 rsyslog.log.1.gz
-rw-r-----  1 root root     1M Feb 25  2016 rsyslog.log.2.gz
-rw-r-----  1 root root     1M Apr 17 04:00 systemd-logind.log.1
-rw-r-----  1 root root     8M Feb  6 06:33 systemd-logind.log.2.gz
-rw-r-----  1 root root     1M May  3  2016 systemd-logind.log.3.gz
-rw-r-----  1 root root     1M May  2  2016 systemd-logind.log.4.gz
-rw-r-----  1 root root     1M May  1  2016 systemd-logind.log.5.gz
-rw-r-----  1 root root     1M Apr 30  2016 systemd-logind.log.6.gz
-rw-r-----  1 root root     1M Apr 29  2016 systemd-logind.log.7.gz

Find biggest files sorted in currently directory

du -x -h --max-depth=2 . | sort -hr | head -1000
Edited by Eric Eastwood