<div dir="ltr">Hi,<div><br></div><div>  This morning I received some alerts about a full disk but there was no detail from which server.</div><div>  This afternoon ldap crashed, the wiki was unavailable and I found that the full disk was / on cucumber</div><div><br></div><div><div>aheritier@cucumber:~$ df -h</div><div>Filesystem            Size  Used Avail Use% Mounted on</div><div>/dev/sda1             895G  850G     0 100% /</div><div>none                  3.9G  216K  3.9G   1% /dev</div><div>none                  3.9G     0  3.9G   0% /dev/shm</div><div>none                  3.9G   75M  3.8G   2% /var/run</div><div>none                  3.9G     0  3.9G   0% /var/lock</div><div>none                  3.9G     0  3.9G   0% /lib/init/rw</div><div><br></div><div>Strangely Used < Size</div><div><br></div><div>I stopped jenkins service and remove 3Gb of logs because it was recording many exceptions about the no space left on device</div><div><br></div><div><div>WARNING: exception while collecting data: java.io.IOException: No space left on device</div><div>java.io.IOException: No space left on device</div><div><span class="" style="white-space:pre">  </span>at java.io.FileOutputStream.writeBytes(Native Method)</div><div><span class="" style="white-space:pre">      </span>at java.io.FileOutputStream.write(FileOutputStream.java:345)</div><div><span class="" style="white-space:pre">       </span>at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)</div><div><span class="" style="white-space:pre">  </span>at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)</div><div><span class="" style="white-space:pre">       </span>at java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)</div><div><span class="" style="white-space:pre"> </span>at net.bull.javamelody.FilterServletOutputStream.flush(FilterServletOutputStream.java:65)</div><div><span class="" style="white-space:pre">  </span>at java.io.ObjectOutputStream$BlockDataOutputStream.flush(ObjectOutputStream.java:1822)</div><div><span class="" style="white-space:pre">    </span>at java.io.ObjectOutputStream.flush(ObjectOutputStream.java:718)</div><div><span class="" style="white-space:pre">   </span>at java.io.ObjectOutputStream.close(ObjectOutputStream.java:739)</div><div><span class="" style="white-space:pre">   </span>at net.bull.javamelody.CounterStorage.writeToFile(CounterStorage.java:83)</div><div><span class="" style="white-space:pre">  </span>at net.bull.javamelody.Counter.writeToFile(Counter.java:881)</div><div><span class="" style="white-space:pre">       </span>at net.bull.javamelody.Collector.collectCounterRequestsAndErrorsData(Collector.java:694)</div><div><span class="" style="white-space:pre">   </span>at net.bull.javamelody.Collector.collectCounterData(Collector.java:673)</div><div><span class="" style="white-space:pre">    </span>at net.bull.javamelody.Collector.collect(Collector.java:334)</div><div><span class="" style="white-space:pre">       </span>at net.bull.javamelody.Collector.collectWithoutErrors(Collector.java:306)</div><div><span class="" style="white-space:pre">  </span>at net.bull.javamelody.Collector.collectLocalContextWithoutErrors(Collector.java:295)</div><div><span class="" style="white-space:pre">      </span>at net.bull.javamelody.FilterContext$CollectTimerTask.run(FilterContext.java:56)</div><div><span class="" style="white-space:pre">   </span>at java.util.TimerThread.mainLoop(Timer.java:555)</div><div><span class="" style="white-space:pre">  </span>at java.util.TimerThread.run(Timer.java:505)</div></div><div><br></div><div>I restarted LDAP and confluence</div><div><br></div><div>I don't know where to do more cleanup on cucumber</div><div><br></div><div>cheers</div><div><br></div>-- <br><div class="gmail_signature"><div>-----</div><div>Arnaud Héritier</div><div><a href="http://aheritier.net" target="_blank">http://aheritier.net</a></div><div>Mail/GTalk: aheritier AT gmail DOT com</div><div>Twitter/Skype : aheritier</div></div>
</div></div>