tensor
Who will Lead the Lawsuit against Ripple XRP? SEC Enforcement Director Steps Down
The SEC’s Acting Director of the Division of Enforcement will conclude his tenor by the end of this month.
Enhanced AI Performance with NVIDIA TensorRT 10.0's Weight-Stripped Engines
NVIDIA introduces TensorRT 10.0 with weight-stripped engines, offering >95% compression for AI apps.
NVIDIA H100 GPUs and TensorRT-LLM Achieve Breakthrough Performance for Mixtral 8x7B
NVIDIA's H100 Tensor Core GPUs and TensorRT-LLM software demonstrate record-breaking performance for the Mixtral 8x7B model, leveraging FP8 precision.
NVIDIA TensorRT-LLM Boosts Hebrew LLM Performance
NVIDIA's TensorRT-LLM and Triton Inference Server optimize performance for Hebrew large language models, overcoming unique linguistic challenges.
NVIDIA Enhances TensorRT Model Optimizer v0.15 with Improved Inference Performance
NVIDIA releases TensorRT Model Optimizer v0.15, offering enhanced inference performance through new features like cache diffusion and expanded AI model support.
NVIDIA Enhances Llama 3.1 405B Performance with TensorRT Model Optimizer
NVIDIA's TensorRT Model Optimizer significantly boosts performance of Meta's Llama 3.1 405B large language model on H200 GPUs.
CoreWeave Leads AI Infrastructure with NVIDIA H200 Tensor Core GPUs
CoreWeave becomes the first cloud provider to offer NVIDIA H200 Tensor Core GPUs, advancing AI infrastructure performance and efficiency.
Enhancing Large Language Models with NVIDIA Triton and TensorRT-LLM on Kubernetes
Explore NVIDIA's methodology for optimizing large language models using Triton and TensorRT-LLM, while deploying and scaling these models efficiently in a Kubernetes environment.
NVIDIA's TensorRT-LLM MultiShot Enhances AllReduce Performance with NVSwitch
NVIDIA introduces TensorRT-LLM MultiShot to improve multi-GPU communication efficiency, achieving up to 3x faster AllReduce operations by leveraging NVSwitch technology.
NVIDIA's TensorRT-LLM Enhances AI Efficiency with KV Cache Early Reuse
NVIDIA introduces KV cache early reuse in TensorRT-LLM, significantly speeding up inference times and optimizing memory usage for AI models.
NVIDIA's TensorRT-LLM Multiblock Attention Enhances AI Inference on HGX H200
NVIDIA's TensorRT-LLM introduces multiblock attention, significantly boosting AI inference throughput by up to 3.5x on the HGX H200, tackling challenges of long-sequence lengths.
NVIDIA NIM Revolutionizes AI Model Deployment with Optimized Microservices
NVIDIA NIM streamlines the deployment of fine-tuned AI models, offering performance-optimized microservices for seamless inference, enhancing enterprise AI applications.
NVIDIA TensorRT-LLM Enhances Encoder-Decoder Models with In-Flight Batching
NVIDIA's TensorRT-LLM now supports encoder-decoder models with in-flight batching, offering optimized inference for AI applications. Discover the enhancements for generative AI on NVIDIA GPUs.
NVIDIA Enhances Llama 3.3 70B Model Performance with TensorRT-LLM
Discover how NVIDIA's TensorRT-LLM boosts Llama 3.3 70B model inference throughput by 3x using advanced speculative decoding techniques.
OKX Announces Listing of Tensor (TNSR) for Spot Trading
Leading cryptocurrency exchange OKX has revealed its plans to list Tensor (TNSR) on its spot trading market. The listing will commence on April 8, 2024, with TNSR deposits opening in the morning and spot trading launching in the afternoon. Tensor Protocol, built on the Solana blockchain, serves as a smart contract-based autonomous protocol, facilitating seamless connections between NFT marketplaces and users. Traders are advised to conduct independent research and evaluate risk before engaging in digital asset trading.
StreamingLLM Breakthrough: Handling Over 4 Million Tokens with 22.2x Inference Speedup
SwiftInfer, leveraging StreamingLLM's groundbreaking technology, significantly enhances large language model inference, enabling efficient handling of over 4 million tokens in multi-round conversations with a 22.2x speedup.