How It Works
Automatic Detection
Files above the threshold (default: 2MB) are automatically chunked:- Hashed independently
- Stored if new
- Deduplicated if it already exists
Manifest
A manifest file tracks the chunks:Configuration
Threshold
Set the large file threshold in.wit/config:
Chunk Size
Usage
Adding Large Files
Just useadd as normal:
- Detect the file is above threshold
- Split into chunks
- Store chunks efficiently
- Create manifest
Status with Large Files
Diff with Large Files
Benefits
Space Efficiency
Performance
- Adding: Faster for files with partial changes
- Cloning: Only fetch needed chunks
- Checkout: Stream large files from chunks
No External Dependencies
Git LFS requires:- Server support
- Additional setup
- Separate tracking file
- Built-in to the format
- No server changes needed
- Automatic handling
Comparison with Git LFS
Best Practices
Troubleshooting
File not being chunked
File not being chunked
Check the threshold:Ensure the file is larger than this value.
Slow performance with many chunks
Slow performance with many chunks
Try increasing chunk size:
Repository size growing
Repository size growing
Run garbage collection: