Disk Space Cleanup - Sentry.io

One lesson learned the hard way with sentry, is the importance of ample free disk space. Sentry.io should handle cleaning up old data. Although it seem to be a bit hit/miss.

And if you let your disk hit high utilisation before cleaning up (85/90%) it becomes very difficult to make some free space. As when removing old data from postgres, it creates a new instance of the table without the dead data, before removing the original table. Ref VACUUM FULL

Official Way

The recommended way to clean up old data by Sentry is by using the cleanup command. Although, this seems to be a bit hit & miss on how effective it is.

docker compose run -T web cleanup --days 90 -m nodestore -l debug

Postgres Wasted Space

If still struggling for space, you can look to free any dead space from Postgres with the following command.

If you do not have enough space to vacuum the data, you can run a query to identify the wasted space per table. And vacuum each table individually, starting at the smallest.

docker compose exec postgres psql -U postgres -c 'VACUUM FULL;'

Nuclear Option

If you still do not have enough space to even VACUUM your smallest tables. You can look to directly force remove some of the data from disk.

Removing empty dirs, should be fairly safe. Removing from _data has potentially for corruption (although has not happened to me).

DANGER

Note: This approach may cause data loss. Use as a last resort.

# Cleanup Empty Directories - These can take up a surprising amount of space
find /var/lib/docker/volumes/sentry-data/_data/files -type d -empty | xargs -r rmdir

# Cleanup old Data files - Force remove anything outside our retention date
find /var/lib/docker/volumes/sentry-data/_data -type f -mtime +90 -delete