Memory efficient MAML using gradient checkpointing
-
Updated
Dec 30, 2019 - Jupyter Notebook
Memory efficient MAML using gradient checkpointing
Simple gradient checkpointing for eager mode execution
Python package for rematerialization-aware gradient checkpointing
Python library for memory-constrained activation checkpoint optimization, recomputation scheduling, and GPU training performance analysis.
Zero-memory, multi-core-CPU local AI training for ordinary laptops.
End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment
Gradient checkpointing and VRAM auto-tuning for spiking neural network training. O(sqrt(T)) activation memory with bit-identical gradients.
Fine-tune NVIDIA Isaac GR00T N1.7 (3B VLA) on a single 24 GB RTX 4090 without root: patches, install script, MuJoCo evaluation, open datasets, 1800 evaluated attempts as JSON
Classify documents longer than your transformer's context window: overlapping windows, cross-window aggregation (max / mean / top-k / log-mean-exp), and window-level gradient checkpointing that cuts training memory. Encoder-agnostic and task-agnostic, with measured speed and accuracy trade-offs.
To associate your repository with the gradient-checkpointing topic, visit your repo's landing page and select "manage topics."