Memory architecture guide for buyers and engineers

DDR vs LPDDR vs GDDR vs HBM Memory

DDR is the mainstream choice for scalable CPU memory; LPDDR reduces memory-subsystem energy in compact or power-conscious designs; GDDR delivers high board-level bandwidth to discrete GPUs and accelerators; HBM delivers extreme bandwidth density through stacked memory beside compute. They are different controller, signaling, routing, package, power, and validation decisions—not interchangeable RAM upgrades.

AMD Fiji GPU package with four HBM stacks visible beside the central GPU on an interposer
HBM makes the physical difference visible: stacked memory sits beside compute on the same package fabric. Photo: C. Spille/PC Games Hardware, CC BY-SA 4.0 via Wikimedia Commons. This older Fiji package illustrates topology, not current HBM performance.
DDRCapacity + ecosystem

CPU main memory, DIMMs or soldered devices, broad service and qualification paths.

LPDDREnergy + compactness

Low-power states and close integration for mobile, edge, automotive, client, and selected servers.

GDDRPer-pin speed + PCB channels

Discrete packages around a GPU or accelerator create high aggregate board-level bandwidth.

HBMWidth + package density

Stacked DRAM and very wide in-package interfaces feed bandwidth-dense AI and HPC compute.

Short answer

Choose the platform architecture first, then qualify the memory.

A processor or accelerator normally exposes a specific memory controller and PHY. That choice determines the supported family, generation, topology, channel organization, package or module, power rails, firmware training, layout rules, and test plan. Start with workload capacity and data-movement needs, but stop immediately if the controller does not support the candidate memory.

Decision table

The families optimize different bottlenecks.

All four store volatile data in DRAM cells and require refresh. The important difference is the system contract around those cells: interface, channel width, signaling, placement, power behavior, service model, and how much packaging complexity the product can carry.

FamilyDesign centerTypical implementationBest starting point when...Constraint often missed
DDR SDRAMBalanced capacity, bandwidth, ecosystem, and serviceability.Discrete devices or DIMMs connected to a CPU/SoC DDR controller; server designs commonly use ECC RDIMMs.The workload needs scalable general-purpose memory, conventional CPU support, replaceable modules, or broad capacity options.Population rules, rank count, supported DIMMs, training, routing, and speed can change achievable bandwidth.
LPDDRLower memory energy and compact, power-aware integration.Packages close to an SoC, frequently soldered; LPDDR5X can also appear in controlled module formats such as LPCAMM2.Battery life, standby behavior, thermals, board space, or performance per watt drives the product.Soldered capacity is often a design-time commitment; even modular LPDDR requires a compatible controller and form factor.
GDDRHigh per-pin speed and aggregate bandwidth for graphics or parallel compute.Multiple discrete packages on a PCB around a GPU or accelerator, connected through high-speed board channels.A discrete GPU, console, visualization card, or accelerator is architected for a GDDR controller.Board area, channel loss, SI/PI, device count, heat removal, and controller width are part of the memory decision.
HBMVery high bandwidth density and efficient short-reach data movement.Vertically stacked DRAM connected to compute through a very wide in-package interface and advanced package fabric.A memory-bound AI/HPC accelerator or FPGA is sold with HBM integrated into its package architecture.Capacity, yield, thermal path, package supply, repair, allocation, and platform availability are tightly coupled.

Family labels do not define one universal bus width, capacity, latency, power number, or price. Those values belong to a specific generation, device, controller, package, module, population, and operating condition.

Standards boundary: JEDEC publishes the interface standards, but the controlled current standard and the processor or accelerator vendor's supported-memory documentation govern a real design. Do not use a comparison article as a pin-level specification or approval list. See the JEDEC technology focus areas and document search.
Physical evidence

Look at where the memory sits before comparing specifications.

The photographs below are purposeful topology examples. Some show older generations because package placement remains easy to see; they are not presented as current performance references.

SK Hynix DDR5 MRDIMM memory module displayed at Computex 2025
Photo: 4300streetcar, CC BY 4.0.
DDR topology

A module makes capacity and service a platform feature.

A DDR DIMM combines multiple DRAM devices, module routing, SPD information, and—in registered modules—buffering. A server may expose many channels and sockets, but performance depends on installing supported modules in the prescribed population pattern.

  • Verify UDIMM, SODIMM, RDIMM, MRDIMM, ECC, rank, and capacity.
  • Do not infer compatibility from “DDR5” alone.
Raspberry Pi 4 Model B board with its compact LPDDR4 memory placement annotated on the source image
Compact board example with LPDDR4 identified in the source annotations. Photo: Laserlicht, CC BY-SA 4.0.
LPDDR topology

Close placement reduces footprint but changes serviceability.

LPDDR is commonly placed close to the SoC so routing, package, and power behavior can be optimized as one compact subsystem. The trade is that capacity and repair may be locked into the board, although compatible modular LPDDR formats now exist for selected platforms.

  • Validate SoC generation, channel map, package, rail sequence, and training.
  • Specify capacity early when the devices are soldered.
NVIDIA GeForce GTX 780 PCB with discrete graphics memory packages arranged around the GPU
Older GDDR5 board used only to show discrete topology. Photo: GBPublic_PR, CC BY 2.0.
GDDR topology

Bandwidth is assembled from many fast board channels.

Discrete GDDR packages surround the GPU or accelerator. The aggregate result depends on per-pin data rate, the number and width of active channels, controller organization, route quality, power delivery, and cooling around both GPU and memory devices.

  • Count devices and verify bus organization against the controller.
  • Plan PCB stackup and thermal coverage before releasing the BOM.
AMD Fiji GPU package showing HBM stacks next to the GPU on a shared interposer
GPU, HBM stacks, and interposer in one package. C. Spille/PC Games Hardware, CC BY-SA 4.0.
HBM topology

The memory is part of the accelerator package decision.

HBM stacks use through-silicon vias and a wide short-reach connection to the host compute die through an interposer or other advanced package fabric. A buyer normally qualifies the accelerator or module that already contains HBM—not an independent DIMM-like field upgrade.

  • Verify the accelerator's exact HBM generation, capacity, and stack configuration.
  • Treat package cooling, supply, and repair as system requirements.
Do not blend the metrics

Bandwidth, capacity, latency, and energy answer different questions.

Peak bandwidth is a transport ceiling. It does not say whether a model fits, how long a random access takes, how much useful work the software performs, or what the complete memory subsystem consumes.

01

Capacity

Can the working set, model, frame buffer, database, or simulation remain resident? A faster memory tier can still fail if the required data does not fit.

02

Peak bandwidth

How much data can the interface move when enough independent work exists? Width and per-pin rate both matter; overhead and contention reduce effective delivery.

03

Latency

How long does a particular request take through cache, fabric, controller, queue, DRAM, and return path? More bandwidth does not automatically reduce serialized latency.

04

Energy and thermals

What do I/O, PHY, refresh, termination, package, PMIC, cooling, and workload duty cycle consume? A lower I/O voltage alone is not the whole-system answer.

Peak transport calculator

Bandwidth ≈ per-pin transfer rate × active data-bus width ÷ 8.

Theoretical peak interface bandwidth
51.2 GB/s
DDR5-6400 single 64-bit channel
Planning aid only. Sum independently usable channels for a full subsystem, then validate protocol efficiency, read/write mix, refresh, controller policy, access pattern, thermals, and measured workload utilization.
Documented public platform cases

Real implementations reveal the trade-offs more clearly than category slogans.

Evidence boundary: the four cases below use current public manufacturer documentation. The figures are product-specific published specifications, not YURUNOX laboratory measurements, customer outcomes, or universal limits for the memory family.
DDR5 server case · AMD EPYC 9005

Twelve channels are useful only when the population plan preserves them.

AMD documents 12 DDR5 memory channels for EPYC 9005 processors and warns that improper configuration can reduce bandwidth and increase latency. Its population guide recommends balanced configurations and shows one- or two-DIMM-per-channel options, while the server vendor's validated rules remain authoritative.

Decision consequence: an RFQ for “1.5 TB DDR5” is incomplete. DIMM count, equal capacity, rank, DPC, speed, processor SKU, server AVL, and channel map affect the result.
Read AMD's memory population guide →
LPDDR5X data-center case · NVIDIA Grace

LPDDR is not limited to phones when energy and bandwidth drive the CPU design.

NVIDIA documents its Grace CPU Superchip with up to 960 GB of server-class LPDDR5X with ECC and up to 1 TB/s aggregate memory bandwidth. The tuning guide describes each Grace CPU memory subsystem as up to 500 GB/s at about 16 W. Co-packaging improves energy and density but replaces ordinary field-swappable DIMMs with a platform-managed service model.

Decision consequence: LPDDR can serve data-center workloads, but the buyer must accept the exact Grace platform's capacity, resiliency, provisioning, and repair model.
Read the NVIDIA Grace tuning guide →
GDDR7 graphics case · GeForce RTX 5090

A high per-pin rate becomes useful bandwidth through a wide discrete interface.

NVIDIA lists the RTX 5090 with 32 GB of GDDR7 on a 512-bit interface; its launch material states 1,792 GB/s of total memory bandwidth. That figure belongs to the complete graphics card architecture—not to one GDDR package and not to a DDR-compatible CPU memory channel.

Decision consequence: specify the GPU/card or a controller-qualified GDDR device set. Do not compare one GDDR chip's speed label with an HBM stack or a full accelerator.
Review NVIDIA RTX 5090 specifications →
HBM3 accelerator case · AMD Instinct MI300X

An 8,192-bit aggregate interface shows why HBM is a package-level architecture.

AMD's MI300X data sheet specifies up to 192 GB of HBM3, an 8,192-bit memory interface, and 5.3 TB/s maximum peak theoretical memory bandwidth. The same document identifies an OAM module and a 750 W maximum board power, making clear that HBM, compute, cooling, and platform integration must be evaluated together.

Decision consequence: procure the qualified accelerator/platform configuration and cooling envelope. HBM capacity is not a separately swappable memory-module line item.
Read the AMD MI300X data sheet →
The high-bandwidth comparison

GDDR scales fast PCB channels; HBM scales a very wide package interface.

Both can feed massively parallel compute. The right question is which complete GPU or accelerator architecture meets capacity, bandwidth utilization, power, thermals, cost, software, package, manufacturing, and availability requirements.

GDDR: discrete and board-routed

Memory packages sit around the processor and communicate across high-speed PCB channels.

Graphics card PCB showing discrete memory devices arranged around the central GPU
Physical-topology example: GBPublic_PR, CC BY 2.0.
  • Strong fit for graphics, consoles, visualization, and selected accelerators.
  • Bandwidth scales through per-pin rate, channel width, and device count.
  • Requires board area, carefully controlled routes, SI/PI, power, and device cooling.
  • Can offer a practical system trade where HBM-class packaging is not justified.

HBM: stacked and package-routed

Memory stacks sit beside compute on an interposer or advanced package fabric.

HBM stacks and GPU integrated on a common interposer package
Physical-topology example: C. Spille/PC Games Hardware, CC BY-SA 4.0.
  • Strong fit for bandwidth-dense AI, HPC, FPGA, and data-processing accelerators.
  • Bandwidth scales through an exceptionally wide, short-reach interface and multiple stacks.
  • Requires co-designed package fabric, stack integration, test, yield, and thermal paths.
  • Capacity and repair are fixed to the accelerator/package configuration.
Workload-to-platform selector

Start from the dominant constraint, then confirm controller support.

This is a planning aid, not an interface-qualification result. Select the situation closest to the product and use the validation questions to create an engineering requirement.

Likely starting point: DDR

Use the CPU vendor's DDR generation, DIMM type, and population rules.

This direction fits servers, workstations, industrial PCs, networking systems, and other CPU platforms where capacity scaling, established module ecosystems, ECC/RAS, or serviceability matter.

Validate: processor SKU, DDR generation, channel count, DPC, supported module type, rank, capacity, ECC, SPD, speed, temperature, server AVL, BIOS, and lifecycle.
Why there is no drop-in swap

A family change touches every layer from controller to supply chain.

Even a migration within one family can require a new controller, package, layout, firmware, qualification, and supplier approval. Replacing DDR with LPDDR, GDDR, or HBM is an architecture project, not a purchasing substitution.

Controller

Protocol, commands, channels, scheduling, ECC/RAS, supported densities and generations.

PHY

Signaling, voltage, training, timing, termination, lane mapping, and electrical margins.

Board/package

Pinout, package, routes, interposer, stackup, impedance, return path, and decoupling.

Power/thermal

Rails, PMIC, sequencing, refresh, termination, cooling coverage, and temperature limits.

Firmware/test

Initialization, training, SPD, address map, diagnostics, margining, workload, and production test.

Supply/service

Qualified MPN, lifecycle, PCN, allocation, replaceability, repair, and second-source strategy.

Concrete compatibility warning: AMD explicitly states that DDR4 modules from older EPYC systems are not electrically or mechanically compatible with the DDR5 sockets of EPYC 9004/9005 servers. The same discipline applies more broadly: a familiar capacity label does not establish interface compatibility. See AMD Server Memory guidance.
Sourcing and qualification

A usable RFQ identifies the exact platform and memory configuration.

A distributor can help locate and organize evidence for the specified device or module, but cannot make an unsupported family, generation, package, or speed bin compatible. Engineering compatibility and quality evidence must meet at the exact offered lot.

01 · Platform

Controller and approved design

Processor/GPU/FPGA/accelerator MPN, board revision, reference design, BIOS/firmware, and supported-memory list.

02 · Memory identity

Exact family and generation

DDR5, LPDDR5X, GDDR7, HBM3E, or other exact standard; device/module MPN, density, organization, package, and speed bin.

03 · Configuration

Channels, ranks, devices, stacks

Channel count, DPC, rank, x-width, ECC/RAS, GDDR device count and bus, or accelerator HBM stack/capacity configuration.

04 · Environment

Power, temperature, and cooling

Voltage option, PMIC/rails, operating-temperature grade, airflow or cold plate, derating, and workload duty cycle.

05 · Evidence

Traceability and status

Manufacturer, date/lot codes, label/marking, packing condition, authorized-source evidence, datasheet revision, lifecycle, and PCN.

06 · Acceptance

Inspection and functional validation

Visual/marking/package checks, lot control, electrical test scope where required, platform memory test, burn-in or workload validation, and exception owner.

Electronic component inspection evidence organized for buyer review before shipment
Buyer handoff: tie manufacturer evidence, package markings, date/lot information, inspection images, and exceptions to the exact memory MPN and offered lot. Learn about YURUNOX Quality Assurance.
Memory RFQ / technical review request

Platform / board: [manufacturer, model, revision]
Processor / GPU / FPGA / accelerator MPN: [exact part number]
Supported memory family and generation: [exact interface]
Required memory MPN or approved alternates: [exact part numbers]
Capacity and configuration: [per device/module and total]
Organization: [x-width, ranks, channels, DPC, device count or HBM configuration]
Speed bin and voltage option: [exact requirement]
ECC / RAS / SPD / PMIC requirements: [details]
Package or module form factor: [exact type]
Operating temperature and cooling: [range / method]
Lifecycle and delivery requirement: [quantity, destination, date]
Evidence required: [manufacturer, COC, traceability, photos, date/lot code, PCN, inspection/test]
Approved platform document / AVL reference: [document and revision]
Engineering exception owner: [name / function]
Illustrative composite scenarios

Three buyer situations show why “fastest memory” is not a specification.

Scenario label: these are constructed decision walkthroughs based on common platform constraints and the public documentation cited in this guide. They are not YURUNOX customer cases, personal anecdotes, shipment outcomes, or laboratory tests.
Composite scenario 1

A server capacity RFQ ignores channel population

A team requests 1.5 TB of DDR5 for a 12-channel server but quotes the capacity as twenty-four mixed modules from different approved families. Total gigabytes look correct, yet rank, DPC, speed, equal-capacity population, server AVL, and firmware support are unresolved.

Decision path: start from the server vendor's population table; specify identical supported module groups per channel and validate the intended speed and workload.
Composite scenario 2

An edge appliance asks for upgradeable LPDDR

The product needs low standby power and a compact enclosure, but service wants field-replaceable capacity. Soldered LPDDR meets the electrical and space goals while conflicting with the repair model. A modular LPDDR option may help only if the SoC, connector, board, firmware, and mechanical design support it.

Decision path: decide whether energy/space or field replacement is the hard requirement, then select a platform built around that service model.
Composite scenario 3

An AI buyer compares GDDR and HBM by peak GB/s alone

A model appears memory-bound, so the buyer selects the highest advertised bandwidth. Later review shows the working set exceeds local capacity and frequent host transfers dominate. More peak local bandwidth cannot repair a poorly sized memory tier or an unsuitable data-placement plan.

Decision path: profile active capacity, arithmetic intensity, cache reuse, transfer volume, locality, batch size, and software support on candidate platforms.
Part- and platform-specific sourcing review

Send the controller, exact MPN, configuration, and lifecycle requirement.

YURUNOX can help organize sourcing and evidence review for the exact memory device, module, GPU, accelerator, or approved platform requirement. Final compatibility and production release remain subject to the buyer's engineering, quality, and platform-vendor rules.

  • Processor, GPU, FPGA, or accelerator MPN
  • Memory family, generation, device/module MPN
  • Capacity, channels, ranks, x-width, or stack configuration
  • Speed, package, voltage, temperature, and cooling
  • Quantity, destination, lifecycle, and delivery date
  • AVL, traceability, inspection, and test requirements
Frequently asked questions

DDR, LPDDR, GDDR, and HBM questions

Use the exact device or module data sheet, controlled JEDEC standard, processor/accelerator support list, board or package design guide, and validated platform configuration for final decisions.

What is the main difference between DDR, LPDDR, GDDR, and HBM?

The main difference is the system design target and physical interface. DDR is general-purpose CPU memory; LPDDR emphasizes low-power compact systems; GDDR provides high bandwidth through discrete devices around a GPU or accelerator; HBM provides very high bandwidth density through stacked in-package memory. Their controllers, PHYs, packages, routes, power behavior, and validation paths differ.

Is LPDDR better than DDR?

Neither is universally better. LPDDR is often preferable when energy, standby behavior, thermals, and compact integration dominate. DDR is often preferable when capacity scaling, module ecosystem, server RAS, or field serviceability dominate. The processor's supported interface and the product's complete requirements decide.

Why is HBM so fast?

HBM combines vertically stacked DRAM with an exceptionally wide, short-reach in-package interface close to compute. Many parallel data paths create high aggregate bandwidth without relying only on extreme per-pin rates across a PCB. Effective workload performance still depends on capacity, locality, concurrency, caches, fabric, software, and thermals.

Is GDDR the same as graphics-card VRAM?

GDDR is a standardized graphics-memory family frequently used as discrete memory on graphics cards and accelerators. VRAM is a broader informal term for video or graphics memory. A product can use GDDR or HBM as its local graphics memory, so the terms are related but not identical.

Can DDR be replaced with LPDDR, GDDR, or HBM?

Usually no. The controller, PHY, voltage, training, package, pinout, routing, firmware, thermals, and qualification plan are interface-specific. Some processors support more than one family in different designs, but the board must be created and validated for the selected option; it is not a field swap.

Is HBM always better than GDDR for AI?

No. HBM can be compelling for memory-bound AI and HPC when bandwidth density and package integration justify it. GDDR can be a strong fit when a discrete-memory accelerator better meets capacity, platform cost, board design, availability, or workload needs. Compare complete accelerator platforms under the same production workload.

Does more bandwidth reduce memory latency?

Not necessarily. Bandwidth describes data moved per second; latency is the delay for a particular request. A high-bandwidth system can still have significant latency for random, serialized, queued, remote, or poorly localized accesses. Cache behavior and software data placement often dominate.

Can LPDDR memory be upgraded?

Many LPDDR implementations are soldered and not field-upgradeable. Compatible modular approaches such as LPCAMM2 exist for selected platforms, but they require a controller, board, connector, firmware, and mechanical design made for that module. A modular LPDDR product does not become interchangeable with a DDR SODIMM.

How do I calculate theoretical memory bandwidth?

Multiply the per-pin transfer rate by the active data-bus width, then divide by eight to convert bits to bytes. Sum independently usable channels for the full interface. Treat the result as a peak transport ceiling, not guaranteed application throughput.

What should a buyer verify before ordering memory?

Verify the exact platform and controller, family/generation, manufacturer part number, density, organization, speed bin, package/module type, voltage, temperature, ECC/RAS, channel/rank/device configuration, lifecycle, approved source, traceability, and required inspection or platform test. For HBM, qualify the integrated accelerator or package configuration.

Technical references

Primary sources used for the architecture and product review

This guide supports architecture discussion and purchasing preparation; it does not replace the licensed interface standard, original manufacturer data sheet, processor or accelerator design guide, validated module/device list, signal/power-integrity work, firmware validation, workload benchmarking, or buyer quality approval. External images remain hosted by their source platforms and are attributed under the licenses shown in their captions.

Cart (0 items)