10 of 15 server configurations in stockInstant deliveryNo setup fees

GPU · sold out

NVIDIA L40S GPU server

A data-center L40S with 48 GB of VRAM on a 24-core EPYC and 256 GB of ECC memory: larger models and heavier pipelines.

  • 24C / 48T · 2.9–4.15 GHz
  • 256 GB DDR5 ECC
  • 2 × 3.84 TB NVMe SSD
  • 48 GB VRAM

Why this server

  • 48 GB of VRAM

    Room for larger models, longer contexts and bigger batches than 20–24 GB cards.

  • 568 Tensor cores

    4th-gen Tensor cores with FP8, built for inference and fine-tuning.

  • 10 Gbps unmetered

    Move datasets and checkpoints quickly with an included 10 Gbps port.

Full specifications

Processor

Model
AMD EPYC 9254
Cores / threads
24 cores, 48 threads
Clock speed
2.9 GHz base, up to 4.15 GHz
Architecture
Zen 4 (Genoa) · 5 nm
L3 cache
128 MB
TDP
200 W

GPU

Model
NVIDIA L40S
Memory
48 GB GDDR6 ECC
CUDA cores
18,176
Tensor / RT cores
568 4th-gen · 142 3rd-gen
Board power
350 W

Memory & storage

Memory
256 GB DDR5 ECC
Memory channels
12-channel platform
Storage
2 × 3.84 TB NVMe
Default layout
Software RAID 1 (RAID 0 or none selectable)
PCIe
PCIe 5.0

Network

Port
10 Gbps, unmetered
IP addresses
1 IPv4 + routed /64 IPv6
DDoS protection
Always-on, included
Private network
Free VLAN in the same location

Access & billing

Access
Full root / Administrator
Out-of-band
IPMI / KVM console, virtual media
Management
Dashboard & API: reboot, reinstall, rescue
Billing
Monthly, no setup fee, cancel anytime

A great fit for

Offered in 2 locations

Same hardware and same price in every location. Not sure which is closest to your users? Try the latency checker.

Similar servers

Compare them side by side
GPU Sold out · restocking

NVIDIA L40S

$1,099/mo

Excl. VAT · no setup fee · cancel anytime

One email, then your address is deleted. No newsletter.

  • Root + IPMI/KVM console
  • DDoS protection included
  • 1 IPv4 + /64 IPv6

Pay with Bitcoin, Lightning, Ethereum, USDT or Litecoin

FAQ

About the L40S 48 GB

All questions
Where is the NVIDIA L40S available?

It is offered in 2 locations: New York and Frankfurt. The price is the same everywhere: $1,099 per month, excluding VAT, with no setup fee.

When will it be back in stock?

Popular configurations are restocked regularly, but we do not publish dates we cannot guarantee. Leave your email on this page to be notified, or deploy the NVIDIA RTX 4000 SFF Ada now and move later: there is no contract.

Which operating systems can I install?

Ubuntu, Debian, AlmaLinux, Rocky Linux, Fedora Server, FreeBSD, Proxmox VE, Proxmox Backup Server and Windows Server install in one click. You can also mount your own ISO through the IPMI console. With 256 GB of memory, this server is also a comfortable Proxmox host.

Does it have ECC memory?

Yes. It ships with 256 GB of DDR5 ECC, which detects and corrects memory errors before they can corrupt data or crash a process.

Can I add IPs, storage or a faster port?

Yes. Additional IPv4 addresses, extra NVMe drives where a bay is free, off-server backup space are available as monthly add-ons, from the order page or later from your dashboard.

Need it now?

The NVIDIA RTX 4000 SFF Ada is in stock right now. No contract, so you can switch when the L40S 48 GB is back.