NVIDIA L4
Data CenterA PCIe-form-factor data centre GPU based on the Ada Lovelace architecture, built for power efficiency and tuned for AI inference along with graphics workloads.
Key Specifications
VRAM
24 GB GDDR6
Memory Bus
256-bit
FP16
30.29 TFLOPS
FP32
30.29 TFLOPS
TDP
72 W
Best Use Cases
AI Inference
Offers strong tensor core acceleration for serving large language models and generative AI applications at scale with minimal latency.
Virtual Workstations
Supports immersive cloud-hosted graphics, CAD, and video editing experiences through hardware-accelerated encoding and decoding features.
GPU Cloud Services
Well-suited for providers delivering economical, high-density GPU compute instances in the cloud, thanks to low power draw per core.