Advances in AI architectures have unlocked multimodal functionality, enabling transformer models to process multiple forms of data in the same context. For... Advances in AI...
More like this
Speeding Up Variable-Length Training with Dynamic Context Parallelism and NVIDIA Megatron Core
This post introduces Dynamic Context Parallelism (Dynamic-CP), a scheduling approach in NVIDIA Megatron Core used for LLM post-training or DiT pre-training. It... This post introduces...
More like this
Greyhawkery Comics: Cultists #25
Welcome back fans of Greyhawk! If you've been following the Cultists of Tharizdun strip, you'll know they are currently in the dungeons of Maure Castle...
More like this
Accelerating Diffusion Models with an Open, Plug-and-Play Offering
Recent advances in large-scale diffusion models have revolutionized generative AI across multiple domains, from image synthesis to audio generation, 3D asset... Recent advances in large-scale...
More like this
Adaptive Inference in NVIDIA TensorRT for RTX Enables Automatic Optimization
Deploying AI applications across diverse consumer hardware has traditionally forced a trade-off. You can optimize for specific GPU configurations and achieve... Deploying AI applications across...