Case study · Storage & Virtualization

Recovering a Virtualized TrueNAS Storage-Capacity Incident

A storage problem inside a virtualized NAS can exist at a completely different layer from where the user sees free space.

Customer
Confidential engagement
Project status
Completed
Published

Challenge

A Proxmox host storage target reached 100% usage while also holding a large virtual disk presented to TrueNAS. The TrueNAS and ZFS layer could still report logical free capacity even though the underlying host filesystem had no room left.

Why it mattered

This supports routine and contained TrueNAS and virtualized-storage troubleshooting. It is not a claim of catastrophic pool recovery, forensic recovery, or guaranteed recovery of irreplaceable data.

Constraints and controls

The recovery needed to preserve the virtual disk while distinguishing host XFS exhaustion from guest ZFS logical capacity.

Approach

  • Mapped the affected VM storage through the Proxmox storage layer to the underlying host filesystem.\n- Distinguished host XFS exhaustion from guest ZFS logical capacity.\n- Preserved the TrueNAS virtual disk while reducing pressure on the exhausted host datastore.\n- Recovered host filesystem capacity, reattached the preserved virtual disk, and returned the TrueNAS pool through the correct import path.\n- Verified pool health and added operating guardrails such as capacity, quota, and autotrim planning.

Work performed

Recovered capacity at the host layer, preserved and reattached the virtual disk, then brought the guest pool back through its proper import path.

Safety precautions

The investigation treated the host filesystem, virtual disk format, virtualized NAS, and pool state as separate but connected layers.

Recovery and rollback controls

Data-preserving sequencing kept the virtual disk intact while host capacity was recovered and the guest pool was returned through the appropriate import path.

Result

The virtual disk was preserved, the TrueNAS storage returned online, and the host recovered substantial usable capacity.

Verification and evidence

Verification included the recovered host capacity, preserved and reattached virtual disk, and pool health after the correct import path.

What this demonstrates and scope boundary

This demonstrates layered troubleshooting, Proxmox storage mapping, XFS capacity diagnosis, qcow2 lifecycle handling, TrueNAS and ZFS administration, and data-preserving recovery sequencing.

Project evidence

Related proof of work

other

Linux Disk-Full & Service Recovery

Diagnosed severe Linux root-filesystem capacity pressure, identified space consumers, reclaimed capacity, and checked filesystem, kernel, service, and Docker state after recovery.

Review this evidence