The important moves in artificial intelligence.

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Faster Training and Inference: Habana Gaudi®2 vs Nvidia A100 80GB

Training Stable Diffusion with Dreambooth using Diffusers

From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease

Optimization story: Bloom inference

Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate

Deploying 🤗 ViT on Kubernetes with TF Serving

Efficient training of language models to fill in the middle

The Technology Behind BLOOM Training

DALL·E 2 pre-training mitigations

In order to share the magic of DALL·E 2 with a broad audience, we needed to reduce the risks associated with powerful image generation models. To this end, we put various guardrails in place to prevent generated images from violating our content policy.

Accelerate Large Model Training using DeepSpeed

Techniques for training large neural networks

Large neural networks are at the core of many recent advances in AI, but training them is a difficult engineering and research challenge which requires orchestrating a cluster of GPUs to perform a single synchronized calculation.