1 month ago
TokenSpeed-Kernel: Master Multi-Silicon LLM Inference
Unlock high-performance LLM inference with the TokenSpeed-kernel. Learn how this open-source subsyst...
Tech News
124 articles in this category
1 month ago
PyTorch Monarch Arrives on AMD ROCm for LLM Training
Discover how PyTorch Monarch now enables single-controller distributed training for LLMs on AMD Inst...
1 month ago
Mastering PyTorch's Scalable Test Infrastructure
Learn to leverage PyTorch’s robust test infrastructure. Discover how to test your models across CPU,...
2 months ago
Mastering Transformer Fine-Tuning with NeMo AutoModel
Learn how NVIDIA NeMo AutoModel accelerates Transformer fine-tuning, delivering 3.4x higher throughp...
2 months ago
Run vLLM Server on HF Jobs in One Command
Learn how to quickly deploy a vLLM server on Hugging Face Jobs with a single command. Optimize your...
2 months ago
DeepSeek-V4 on GB300: 5x Throughput with SGLang
Discover how DeepSeek-V4 on NVIDIA GB300 achieves 5x higher throughput using SGLang optimizations. U...
2 months ago
Your LLM Checkpoints: How olmo-eval Standardizes Iterative Evaluation
If you're building LLMs, olmo-eval offers a Python-based workbench to manage your iterative evaluati...
3 months ago
OpenAI frontier models and Codex are now available on AWS
Understanding FAILED_EXTRACTIONWhen your automated content ingestion pipelines signal FAILED_EXTRACT...
3 months ago
Is Your Optimization Stack Ready? LinkedIn Shifts to PyTorch for Extreme Scale
LinkedIn now uses PyTorch and GPU acceleration to solve extreme-scale optimization problems in web a...
3 months ago
Your Agents, Local & Fast: Holo3.1's Quantization Impact
Holo3.1 enables fast, local computer-use agents on your devices using FP8, Q4 GGUF, and NVFP4 quanti...
3 months ago
PyTorch Docathon Delivers 150+ Merged PRs: Your AI Workflow Impact
The PyTorch Docathon 2026 merged 150+ PRs, directly improving the documentation you use. Understand...
3 months ago
Your Reranker Performance: The Ettin Family Delivers State-of-the-Art Speed
Six new Ettin Reranker Family CrossEncoder models provide state-of-the-art performance, optimizing y...