<div dir="ltr">Hi,<div><br></div><div> This morning I received some alerts about a full disk but there was no detail from which server.</div><div> This afternoon ldap crashed, the wiki was unavailable and I found that the full disk was / on cucumber</div><div><br></div><div><div>aheritier@cucumber:~$ df -h</div><div>Filesystem Size Used Avail Use% Mounted on</div><div>/dev/sda1 895G 850G 0 100% /</div><div>none 3.9G 216K 3.9G 1% /dev</div><div>none 3.9G 0 3.9G 0% /dev/shm</div><div>none 3.9G 75M 3.8G 2% /var/run</div><div>none 3.9G 0 3.9G 0% /var/lock</div><div>none 3.9G 0 3.9G 0% /lib/init/rw</div><div><br></div><div>Strangely Used < Size</div><div><br></div><div>I stopped jenkins service and remove 3Gb of logs because it was recording many exceptions about the no space left on device</div><div><br></div><div><div>WARNING: exception while collecting data: java.io.IOException: No space left on device</div><div>java.io.IOException: No space left on device</div><div><span class="" style="white-space:pre"> </span>at java.io.FileOutputStream.writeBytes(Native Method)</div><div><span class="" style="white-space:pre"> </span>at java.io.FileOutputStream.write(FileOutputStream.java:345)</div><div><span class="" style="white-space:pre"> </span>at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)</div><div><span class="" style="white-space:pre"> </span>at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)</div><div><span class="" style="white-space:pre"> </span>at java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.FilterServletOutputStream.flush(FilterServletOutputStream.java:65)</div><div><span class="" style="white-space:pre"> </span>at java.io.ObjectOutputStream$BlockDataOutputStream.flush(ObjectOutputStream.java:1822)</div><div><span class="" style="white-space:pre"> </span>at java.io.ObjectOutputStream.flush(ObjectOutputStream.java:718)</div><div><span class="" style="white-space:pre"> </span>at java.io.ObjectOutputStream.close(ObjectOutputStream.java:739)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.CounterStorage.writeToFile(CounterStorage.java:83)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Counter.writeToFile(Counter.java:881)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Collector.collectCounterRequestsAndErrorsData(Collector.java:694)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Collector.collectCounterData(Collector.java:673)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Collector.collect(Collector.java:334)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Collector.collectWithoutErrors(Collector.java:306)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.Collector.collectLocalContextWithoutErrors(Collector.java:295)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.FilterContext$CollectTimerTask.run(FilterContext.java:56)</div><div><span class="" style="white-space:pre"> </span>at java.util.TimerThread.mainLoop(Timer.java:555)</div><div><span class="" style="white-space:pre"> </span>at java.util.TimerThread.run(Timer.java:505)</div></div><div><br></div><div>I restarted LDAP and confluence</div><div><br></div><div>I don't know where to do more cleanup on cucumber</div><div><br></div><div>cheers</div><div><br></div>-- <br><div class="gmail_signature"><div>-----</div><div>Arnaud Héritier</div><div><a href="http://aheritier.net" target="_blank">http://aheritier.net</a></div><div>Mail/GTalk: aheritier AT gmail DOT com</div><div>Twitter/Skype : aheritier</div></div>
</div></div>