AI HARDWARE TIER LIST89款显卡大模型推理天梯榜

全球 AI 显卡显存天梯榜与推理性能排名

综合考量大模型自回归解码最关键的显存物理带宽(决定每秒生成 Token 速度)与显存容量(决定能装下多大参数的模型)。彻底排查 8GB 显存陷阱与高性价比卡。

排序:
排名显卡型号与规格显存容量显存带宽 (GB/s)最大可载 (Q4)评级梯队参考售价操作
1
NVIDIA B200 SXM (192GB)
Blackwell•HBM3e•8192-bit
192 GB
8000 GB/s100%
671B MoES+$45,000
2
NVIDIA B100 SXM (192GB)
Blackwell•HBM3e•8192-bit
192 GB
8000 GB/s100%
671B MoES+$32,000
3
AMD Instinct MI325X (256GB)
CDNA 3•HBM3e•8192-bit
256 GB
6000 GB/s75%
671B MoES+$24,000
#4
AMD Instinct MI300X (192GB)
CDNA 3•HBM3•8192-bit
192 GB
5300 GB/s66%
671B MoES+$20,000
#5
NVIDIA H200 SXM (141GB)
Hopper•HBM3e•6144-bit
141 GB
4800 GB/s60%
671B MoES+$38,000
#6
AMD Instinct MI300A (128GB APU)
CDNA 3•HBM3•8192-bit
128 GB
统一内存
5300 GB/s66%
70B / 123BS+$18,000
#7
Intel Gaudi 3 (128GB)
Gaudi•HBM2e•8192-bit
128 GB
3700 GB/s46%
70B / 123BS+$15,000
#8
AMD Instinct MI250X (128GB)
CDNA 2•HBM2e•8192-bit
128 GB
3200 GB/s40%
70B / 123BS+$12,000
#9
NVIDIA H100 NVL (94GB)
Hopper•HBM3•5120-bit
94 GB
3900 GB/s49%
70B / 123BS+$32,000
#10
NVIDIA H100 SXM5 (80GB)
Hopper•HBM3•5120-bit
80 GB
3350 GB/s42%
70B / 123BS+$30,000
#11
NVIDIA H800 SXM (80GB)
Hopper•HBM3•5120-bit
80 GB
3350 GB/s42%
70B / 123BS+$28,000
#12
Intel Gaudi 2 (96GB)
Gaudi•HBM2e•6144-bit
96 GB
2450 GB/s31%
70B / 123BS$9,000
#13
Apple M2 Ultra (192GB Unified)
Apple Silicon•Unified LPDDR5•800-bit
192 GB
统一内存
800 GB/s10%
671B MoES+$6,999
#14
NVIDIA A100 SXM4 (80GB)
Ampere•HBM2e•5120-bit
80 GB
2039 GB/s25%
70B / 123BS+$12,000
#15
NVIDIA A800 SXM4 (80GB)
Ampere•HBM2e•5120-bit
80 GB
2039 GB/s25%
70B / 123BS+$11,000
#16
NVIDIA A100 PCIe (80GB)
Ampere•HBM2e•5120-bit
80 GB
1935 GB/s24%
70B / 123BS+$14,000
#17
NVIDIA A800 PCIe (80GB)
Ampere•HBM2e•5120-bit
80 GB
1935 GB/s24%
70B / 123BS+$9,500
#18
Apple M2 Ultra (128GB Unified)
Apple Silicon•Unified LPDDR5•800-bit
128 GB
统一内存
800 GB/s10%
70B / 123BS+$5,499
#19
Apple M1 Ultra (128GB Unified)
Apple Silicon•Unified LPDDR5•800-bit
128 GB
统一内存
800 GB/s10%
70B / 123BS+$3,299
#20
AMD Instinct MI210 (64GB)
CDNA 2•HBM2e•4096-bit
64 GB
1600 GB/s20%
70B / 123BS$6,500
#21
Apple M4 Max (128GB Unified)
Apple Silicon•Unified LPDDR5X•512-bit
128 GB
统一内存
546 GB/s7%
70B / 123BS+$3,999
#22
Apple M3 Max (128GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
128 GB
统一内存
400 GB/s5%
70B / 123BS+$3,499
#23
NVIDIA GeForce RTX 5090
Blackwell•GDDR7•512-bit
32 GB
1792 GB/s22%
32B / 70B*S+$1,999
#24
NVIDIA A100 PCIe (40GB)
Ampere•HBM2•5120-bit
40 GB
1555 GB/s19%
32B / 70B*S$6,500
#25
Apple M3 Max (96GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
96 GB
统一内存
400 GB/s5%
70B / 123BS+$3,199
#26
Apple M2 Max (96GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
96 GB
统一内存
400 GB/s5%
70B / 123BS$3,299
#27
NVIDIA RTX 6000 Ada (48GB)
Ada Lovelace•GDDR6 ECC•384-bit
48 GB
960 GB/s12%
70B / 123BS+$6,800
#28
NVIDIA L40S (48GB)
Ada Lovelace•GDDR6 ECC•384-bit
48 GB
864 GB/s11%
70B / 123BS+$7,200
#29
NVIDIA L40 (48GB)
Ada Lovelace•GDDR6 ECC•384-bit
48 GB
864 GB/s11%
70B / 123BS+$6,800
#30
AMD Radeon PRO W7900 (48GB)
RDNA 3•GDDR6 ECC•384-bit
48 GB
864 GB/s11%
70B / 123BS$3,999
#31
Apple M2 Ultra (64GB Unified)
Apple Silicon•Unified LPDDR5•800-bit
64 GB
统一内存
800 GB/s10%
70B / 123BS$3,999
#32
Apple M1 Ultra (64GB Unified)
Apple Silicon•Unified LPDDR5•800-bit
64 GB
统一内存
800 GB/s10%
70B / 123BS$2,399
#33
AMD Instinct MI100 (32GB)
CDNA 1•HBM2•4096-bit
32 GB
1228 GB/s15%
32B / 70B*A$3,500
#34
NVIDIA RTX A6000 (48GB)
Ampere•GDDR6 ECC•384-bit
48 GB
768 GB/s10%
70B / 123BS+$4,200
#35
NVIDIA A40 (48GB)
Ampere•GDDR6 ECC•384-bit
48 GB
696 GB/s9%
70B / 123BS$4,500
#36
NVIDIA Quadro RTX 8000 (48GB)
Turing•GDDR6 ECC•384-bit
48 GB
672 GB/s8%
70B / 123BS$1,900
#37
AMD Instinct MI50 (32GB)
Vega•HBM2•4096-bit
32 GB
1024 GB/s13%
32B / 70B*A$260
#38
NVIDIA Tesla V100 SXM2 (32GB)
Volta•HBM2•4096-bit
32 GB
900 GB/s11%
32B / 70B*A$550
#39
NVIDIA Tesla V100 PCIe (32GB)
Volta•HBM2•4096-bit
32 GB
900 GB/s11%
32B / 70B*A$480
#40
Apple M4 Max (64GB Unified)
Apple Silicon•Unified LPDDR5X•384-bit
64 GB
统一内存
410 GB/s5%
70B / 123BS$3,499
#41
Apple M2 Max (64GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
64 GB
统一内存
400 GB/s5%
70B / 123BS$2,799
#42
Apple M1 Max (64GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
64 GB
统一内存
400 GB/s5%
70B / 123BS$1,799
#43
NVIDIA GeForce RTX 4090
Ada Lovelace•GDDR6X•384-bit
24 GB
1008 GB/s13%
32B / 70B*S+$1,599
#44
NVIDIA GeForce RTX 3090 Ti
Ampere•GDDR6X•384-bit
24 GB
1008 GB/s13%
32B / 70B*S+$899
#45
AMD Radeon RX 7900 XTX
RDNA 3•GDDR6•384-bit
24 GB
960 GB/s12%
32B / 70B*A$899
#46
NVIDIA GeForce RTX 3090
Ampere•GDDR6X•384-bit
24 GB
936 GB/s12%
32B / 70B*S+$699
#47
Apple M3 Max (64GB Unified)
Apple Silicon•Unified LPDDR5•384-bit
64 GB
统一内存
300 GB/s4%
70B / 123BS$2,899
#48
NVIDIA A30 (24GB)
Ampere•HBM2•3072-bit
24 GB
933 GB/s12%
32B / 70B*A$2,800
#49
Apple M4 Pro (64GB Unified)
Apple Silicon•Unified LPDDR5X•256-bit
64 GB
统一内存
273 GB/s3%
70B / 123BS$2,599
#50
NVIDIA GeForce RTX 5080
Blackwell•GDDR7•256-bit
16 GB
1024 GB/s13%
14B / 32B*A$999
#51
AMD Instinct MI50 (16GB)
Vega•HBM2•4096-bit
16 GB
1024 GB/s13%
14B / 32B*B$150
#52
AMD Radeon VII (16GB HBM2)
Vega•HBM2•4096-bit
16 GB
1024 GB/s13%
14B / 32B*B$220
#53
NVIDIA RTX 5000 Ada (32GB)
Ada Lovelace•GDDR6 ECC•256-bit
32 GB
576 GB/s7%
32B / 70B*S$4,000
#54
AMD Radeon PRO W7800 (32GB)
RDNA 3•GDDR6 ECC•256-bit
32 GB
576 GB/s7%
32B / 70B*A$2,499
#55
NVIDIA RTX A5500 (24GB)
Ampere•GDDR6 ECC•384-bit
24 GB
768 GB/s10%
32B / 70B*S$2,600
#56
NVIDIA RTX A5000 (24GB)
Ampere•GDDR6 ECC•384-bit
24 GB
768 GB/s10%
32B / 70B*S$2,200
#57
AMD Radeon PRO W6800 (32GB)
RDNA 2•GDDR6 ECC•256-bit
32 GB
512 GB/s6%
32B / 70B*A$1,400
#58
AMD Radeon RX 7900 XT
RDNA 3•GDDR6•320-bit
20 GB
800 GB/s10%
14B / 32B*B$699
#59
NVIDIA Tesla V100 PCIe (16GB)
Volta•HBM2•4096-bit
16 GB
900 GB/s11%
14B / 32B*B$280
#60
NVIDIA GeForce RTX 5070 Ti
Blackwell•GDDR7•256-bit
16 GB
896 GB/s11%
14B / 32B*A$749
#61
NVIDIA TITAN RTX (24GB)
Turing•GDDR6•384-bit
24 GB
672 GB/s8%
32B / 70B*A$750
#62
NVIDIA Quadro RTX 6000 (24GB)
Turing•GDDR6 ECC•384-bit
24 GB
672 GB/s8%
32B / 70B*A$950
#63
Apple M3 Max (48GB Unified)
Apple Silicon•Unified LPDDR5•384-bit
48 GB
统一内存
300 GB/s4%
32B / 70B*S$2,699
#64
NVIDIA GeForce RTX 3080 Ti
Ampere•GDDR6X•384-bit
12 GB
912 GB/s11%
8B / 14B*B$499
#65
NVIDIA GeForce RTX 3080 (12GB)
Ampere•GDDR6X•384-bit
12 GB
912 GB/s11%
8B / 14B*B$449
#66
NVIDIA A10G (24GB)
Ampere•GDDR6•384-bit
24 GB
600 GB/s8%
32B / 70B*A$1,800
#67
Apple M4 Pro (48GB Unified)
Apple Silicon•Unified LPDDR5X•256-bit
48 GB
统一内存
273 GB/s3%
32B / 70B*S$2,399
#68
NVIDIA GeForce RTX 2080 Ti (22GB Mod)
Turing•GDDR6•352-bit
22 GB
616 GB/s8%
32B / 70B*A$420
#69
NVIDIA RTX A4500 (20GB)
Ampere•GDDR6 ECC•320-bit
20 GB
640 GB/s8%
14B / 32B*A$1,600
#70
NVIDIA GeForce RTX 4080 Super
Ada Lovelace•GDDR6X•256-bit
16 GB
736 GB/s9%
14B / 32B*A$999
#71
NVIDIA Tesla P100 PCIe (16GB)
Pascal•HBM2•4096-bit
16 GB
732 GB/s9%
14B / 32B*C$120
#72
NVIDIA GeForce RTX 4080
Ada Lovelace•GDDR6X•256-bit
16 GB
717 GB/s9%
14B / 32B*A$899
#73
Apple M4 Max (36GB Unified)
Apple Silicon•Unified LPDDR5X•384-bit
36 GB
统一内存
410 GB/s5%
32B / 70B*S$3,199
#74
NVIDIA Tesla K80 (24GB)
Kepler•GDDR5•384-bit
24 GB
480 GB/s6%
32B / 70B*F$60
#75
NVIDIA GeForce RTX 4070 Ti Super
Ada Lovelace•GDDR6X•256-bit
16 GB
672 GB/s8%
14B / 32B*A$799
#76
NVIDIA RTX 4500 Ada (24GB)
Ada Lovelace•GDDR6 ECC•192-bit
24 GB
432 GB/s5%
32B / 70B*A$2,250
#77
NVIDIA Quadro P6000 (24GB)
Pascal•GDDR5X•384-bit
24 GB
432 GB/s5%
32B / 70B*C$500
#78
AMD Radeon RX 7800 XT
RDNA 3•GDDR6•256-bit
16 GB
624 GB/s8%
14B / 32B*B$489
#79
Apple M2 Max (32GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
32 GB
统一内存
400 GB/s5%
32B / 70B*A$1,999
#80
Apple M1 Max (32GB Unified)
Apple Silicon•Unified LPDDR5•512-bit
32 GB
统一内存
400 GB/s5%
32B / 70B*A$1,399
#81
NVIDIA GeForce RTX 3080 (10GB)
Ampere•GDDR6X•320-bit
10 GB
760 GB/s10%
8B / 14B*C$399
#82
Apple M3 Max (36GB Unified)
Apple Silicon•Unified LPDDR5•384-bit
36 GB
统一内存
300 GB/s4%
32B / 70B*A$2,499
#83
NVIDIA RTX 4090 Laptop (16GB)
Ada Lovelace•GDDR6•256-bit
16 GB
576 GB/s7%
14B / 32B*A$2,200
#84
AMD Radeon RX 7900 GRE
RDNA 3•GDDR6•256-bit
16 GB
576 GB/s7%
14B / 32B*B$549
#85
AMD Radeon RX 6950 XT
RDNA 2•GDDR6•256-bit
16 GB
576 GB/s7%
14B / 32B*A$520
#86
NVIDIA GeForce RTX 5070
Blackwell•GDDR7•192-bit
12 GB
672 GB/s8%
8B / 14B*B$549
#87
Intel Arc A770 (16GB)
Alchemist•GDDR6•256-bit
16 GB
560 GB/s7%
14B / 32B*A$289
#88
NVIDIA Tesla P40 (24GB)
Pascal•GDDR5•384-bit
24 GB
346 GB/s4%
32B / 70B*C$160
#89
NVIDIA TITAN V (12GB HBM2)
Volta•HBM2•3072-bit
12 GB
653 GB/s8%
8B / 14B*B$380
#90
NVIDIA RTX 3080 Ti Laptop (16GB)
Ampere•GDDR6•256-bit
16 GB
512 GB/s6%
14B / 32B*A$1,400
#91
AMD Radeon RX 6900 XT
RDNA 2•GDDR6•256-bit
16 GB
512 GB/s6%
14B / 32B*A$440
#92
AMD Radeon RX 6800 XT
RDNA 2•GDDR6•256-bit
16 GB
512 GB/s6%
14B / 32B*B$429
#93
AMD Radeon RX 6800 (16GB)
RDNA 2•GDDR6•256-bit
16 GB
512 GB/s6%
14B / 32B*B$379
#94
NVIDIA L4 (24GB)
Ada Lovelace•GDDR6•192-bit
24 GB
300 GB/s4%
32B / 70B*A$2,500
#95
NVIDIA GeForce RTX 2080 Ti
Turing•GDDR6•352-bit
11 GB
616 GB/s8%
8B / 14B*C$280
#96
NVIDIA RTX 4000 Ada (20GB)
Ada Lovelace•GDDR6 ECC•160-bit
20 GB
360 GB/s5%
14B / 32B*A$1,250
#97
NVIDIA RTX 3080 Laptop (16GB)
Ampere•GDDR6•256-bit
16 GB
448 GB/s6%
14B / 32B*B$1,100
#98
NVIDIA RTX A4000 (16GB)
Ampere•GDDR6 ECC•256-bit
16 GB
448 GB/s6%
14B / 32B*A$1,000
#99
NVIDIA Quadro RTX 5000 (16GB)
Turing•GDDR6 ECC•256-bit
16 GB
448 GB/s6%
14B / 32B*B$550
#100
NVIDIA TITAN Xp (12GB)
Pascal•GDDR5X•384-bit
12 GB
548 GB/s7%
8B / 14B*C$220
#101
Apple M3 Pro (36GB Unified)
Apple Silicon•Unified LPDDR5•192-bit
36 GB
统一内存
150 GB/s2%
32B / 70B*B$2,199
#102
Apple M2 Pro (32GB Unified)
Apple Silicon•Unified LPDDR5•256-bit
32 GB
统一内存
200 GB/s3%
32B / 70B*B$1,699
#103
Apple M1 Pro (32GB Unified)
Apple Silicon•Unified LPDDR5•256-bit
32 GB
统一内存
200 GB/s3%
32B / 70B*B$1,100
#104
NVIDIA GeForce RTX 3070 Ti
Ampere•GDDR6X•256-bit
8 GB
608 GB/s8%
7B (Tight)F$329
#105
NVIDIA GeForce RTX 4070 Ti
Ada Lovelace•GDDR6X•192-bit
12 GB
504 GB/s6%
8B / 14B*B$649
#106
NVIDIA GeForce RTX 4070 Super
Ada Lovelace•GDDR6X•192-bit
12 GB
504 GB/s6%
8B / 14B*B$599
#107
NVIDIA GeForce RTX 4070
Ada Lovelace•GDDR6X•192-bit
12 GB
504 GB/s6%
8B / 14B*B$549
#108
NVIDIA RTX 4000 SFF Ada (20GB)
Ada Lovelace•GDDR6 ECC•160-bit
20 GB
280 GB/s4%
14B / 32B*A$1,250
#109
NVIDIA TITAN X Pascal (12GB)
Pascal•GDDR5X•384-bit
12 GB
480 GB/s6%
8B / 14B*C$180
#110
NVIDIA GeForce GTX 1080 Ti
Pascal•GDDR5X•352-bit
11 GB
484 GB/s6%
8B / 14B*C$160
#111
Intel Arc B580 (12GB Battlemage)
Battlemage•GDDR6•192-bit
12 GB
456 GB/s6%
8B / 14B*S$249
#112
Apple M4 (32GB Unified)
Apple Silicon•Unified LPDDR5X•128-bit
32 GB
统一内存
120 GB/s2%
32B / 70B*B$1,599
#113
Apple M4 Pro (24GB Unified)
Apple Silicon•Unified LPDDR5X•256-bit
24 GB
统一内存
273 GB/s3%
14B / 32B*A$1,999
#114
NVIDIA RTX 4080 Laptop (12GB)
Ada Lovelace•GDDR6•192-bit
12 GB
432 GB/s5%
8B / 14B*B$1,700
#115
AMD Radeon RX 7700 XT
RDNA 3•GDDR6•192-bit
12 GB
432 GB/s5%
8B / 14B*B$399
#116
AMD Radeon RX 6750 XT
RDNA 2•GDDR6•192-bit
12 GB
432 GB/s5%
8B / 14B*B$349
#117
NVIDIA Tesla T4 (16GB)
Turing•GDDR6•256-bit
16 GB
320 GB/s4%
14B / 32B*B$900
#118
Intel Arc A750 (8GB)
Alchemist•GDDR6•256-bit
8 GB
512 GB/s6%
7B (Tight)F$199
#119
Intel Arc A580 (8GB)
Alchemist•GDDR6•256-bit
8 GB
512 GB/s6%
7B (Tight)F$169
#120
NVIDIA GeForce RTX 2080 Super
Turing•GDDR6•256-bit
8 GB
496 GB/s6%
7B (Tight)C$210
#121
NVIDIA GeForce RTX 4060 Ti (16GB)
Ada Lovelace•GDDR6•128-bit
16 GB
288 GB/s4%
14B / 32B*A$449
#122
AMD Radeon PRO W7700 (16GB)
RDNA 3•GDDR6 ECC•128-bit
16 GB
288 GB/s4%
14B / 32B*B$999
#123
AMD Radeon RX 7600 XT
RDNA 3•GDDR6•128-bit
16 GB
288 GB/s4%
14B / 32B*A$329
#124
AMD Radeon RX 6700 XT
RDNA 2•GDDR6•192-bit
12 GB
384 GB/s5%
8B / 14B*B$319
#125
Intel Arc Pro A60 (12GB)
Alchemist•GDDR6•192-bit
12 GB
384 GB/s5%
8B / 14B*B$450
#126
NVIDIA GeForce RTX 3060 (12GB)
Ampere•GDDR6•192-bit
12 GB
360 GB/s5%
8B / 14B*S$279
#127
NVIDIA RTX 3070 Ti Laptop (8GB)
Ampere•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)F$850
#128
NVIDIA RTX 3070 Laptop (8GB)
Ampere•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)F$750
#129
NVIDIA GeForce RTX 3070
Ampere•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)F$289
#130
NVIDIA GeForce RTX 2080
Turing•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)C$180
#131
NVIDIA GeForce RTX 2070 Super
Turing•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)C$170
#132
NVIDIA GeForce RTX 2070
Turing•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)C$150
#133
NVIDIA GeForce RTX 2060 Super
Turing•GDDR6•256-bit
8 GB
448 GB/s6%
7B (Tight)C$160
#134
NVIDIA GeForce RTX 2060 (12GB)
Turing•GDDR6•192-bit
12 GB
336 GB/s4%
8B / 14B*B$170
#135
Intel Arc B570 (10GB Battlemage)
Battlemage•GDDR6•160-bit
10 GB
380 GB/s5%
8B / 14B*B$219
#136
NVIDIA Quadro RTX 4000 (8GB)
Turing•GDDR6•256-bit
8 GB
416 GB/s5%
7B (Tight)C$320
#137
NVIDIA RTX A2000 (12GB)
Ampere•GDDR6 ECC•192-bit
12 GB
288 GB/s4%
8B / 14B*B$460
#138
Apple M4 (24GB Unified)
Apple Silicon•Unified LPDDR5X•128-bit
24 GB
统一内存
120 GB/s2%
14B / 32B*B$1,299
#139
AMD Radeon RX 6700 (10GB)
RDNA 2•GDDR6•160-bit
10 GB
320 GB/s4%
8B / 14B*C$240
#140
Apple M3 (24GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
24 GB
统一内存
100 GB/s1%
14B / 32B*B$1,399
#141
Apple M2 (24GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
24 GB
统一内存
100 GB/s1%
14B / 32B*B$1,199
#142
NVIDIA GeForce GTX 1080
Pascal•GDDR5X•256-bit
8 GB
320 GB/s4%
7B (Tight)F$110
#143
Apple M2 Pro (16GB Unified)
Apple Silicon•Unified LPDDR5•256-bit
16 GB
统一内存
200 GB/s3%
8B / 14B*C$1,299
#144
Apple M1 Pro (16GB Unified)
Apple Silicon•Unified LPDDR5•256-bit
16 GB
统一内存
200 GB/s3%
8B / 14B*C$850
#145
Apple M3 Pro (18GB Unified)
Apple Silicon•Unified LPDDR5•192-bit
18 GB
统一内存
150 GB/s2%
8B / 14B*B$1,799
#146
NVIDIA GeForce RTX 4060 Ti (8GB)
Ada Lovelace•GDDR6•128-bit
8 GB
288 GB/s4%
7B (Tight)F$369
#147
AMD Radeon RX 7600 (8GB)
RDNA 3•GDDR6•128-bit
8 GB
288 GB/s4%
7B (Tight)C$269
#148
NVIDIA RTX 3060 Laptop (6GB)
Ampere•GDDR6•192-bit
6 GB
336 GB/s4%
7B (Tight)F$600
#149
NVIDIA GeForce RTX 2060 (6GB)
Turing•GDDR6•192-bit
6 GB
336 GB/s4%
7B (Tight)F$120
#150
NVIDIA GeForce GTX 1660 Super
Turing•GDDR6•192-bit
6 GB
336 GB/s4%
7B (Tight)F$100
#151
AMD Radeon RX 6650 XT
RDNA 2•GDDR6•128-bit
8 GB
280 GB/s4%
7B (Tight)C$229
#152
NVIDIA GeForce RTX 4060 (8GB)
Ada Lovelace•GDDR6•128-bit
8 GB
272 GB/s3%
7B (Tight)F$299
#153
NVIDIA RTX 4070 Laptop (8GB)
Ada Lovelace•GDDR6•128-bit
8 GB
256 GB/s3%
7B (Tight)F$1,200
#154
NVIDIA RTX 4060 Laptop (8GB)
Ada Lovelace•GDDR6•128-bit
8 GB
256 GB/s3%
7B (Tight)F$950
#155
NVIDIA GeForce GTX 1070 Ti
Pascal•GDDR5•256-bit
8 GB
256 GB/s3%
7B (Tight)F$95
#156
NVIDIA GeForce GTX 1070
Pascal•GDDR5•256-bit
8 GB
256 GB/s3%
7B (Tight)F$85
#157
AMD Radeon RX 6600 XT
RDNA 2•GDDR6•128-bit
8 GB
256 GB/s3%
7B (Tight)C$199
#158
NVIDIA GeForce RTX 3060 (8GB)
Ampere•GDDR6•128-bit
8 GB
240 GB/s3%
7B (Tight)F$219
#159
NVIDIA GeForce GTX 1660 Ti
Turing•GDDR6•192-bit
6 GB
288 GB/s4%
7B (Tight)F$95
#160
NVIDIA RTX A2000 (6GB)
Ampere•GDDR6 ECC•192-bit
6 GB
288 GB/s4%
7B (Tight)C$280
#161
Apple M4 (16GB Unified)
Apple Silicon•Unified LPDDR5X•128-bit
16 GB
统一内存
120 GB/s2%
8B / 14B*B$999
#162
NVIDIA GeForce RTX 3050 (8GB)
Ampere•GDDR6•128-bit
8 GB
224 GB/s3%
7B (Tight)F$179
#163
AMD Radeon RX 6600 (8GB)
RDNA 2•GDDR6•128-bit
8 GB
224 GB/s3%
7B (Tight)C$189
#164
Apple M3 (16GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
16 GB
统一内存
100 GB/s1%
8B / 14B*C$1,199
#165
Apple M2 (16GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
16 GB
统一内存
100 GB/s1%
8B / 14B*C$999
#166
Apple M1 (16GB Unified)
Apple Silicon•Unified LPDDR4X•128-bit
16 GB
统一内存
68.25 GB/s1%
8B / 14B*C$499
#167
NVIDIA RTX 4050 Laptop (6GB)
Ada Lovelace•GDDR6•96-bit
6 GB
192 GB/s2%
7B (Tight)F$750
#168
NVIDIA GeForce GTX 1060 (6GB)
Pascal•GDDR5•192-bit
6 GB
192 GB/s2%
7B (Tight)F$70
#169
Intel Arc Pro A50 (6GB)
Alchemist•GDDR6•96-bit
6 GB
192 GB/s2%
7B (Tight)C$299
#170
Intel Arc Pro A40 (6GB)
Alchemist•GDDR6•96-bit
6 GB
192 GB/s2%
7B (Tight)C$249
#171
Intel Arc A380 (6GB)
Alchemist•GDDR6•96-bit
6 GB
186 GB/s2%
7B (Tight)C$129
#172
NVIDIA GeForce RTX 3050 (6GB)
Ampere•GDDR6•96-bit
6 GB
168 GB/s2%
7B (Tight)F$149
#173
Apple M3 (8GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
8 GB
统一内存
100 GB/s1%
7B (Tight)F$899
#174
Apple M2 (8GB Unified)
Apple Silicon•Unified LPDDR5•128-bit
8 GB
统一内存
100 GB/s1%
7B (Tight)F$699
#175
Intel Arc A310 (4GB)
Alchemist•GDDR6•64-bit
4 GB
124 GB/s2%
7B (Tight)F$99
#176
Apple M1 (8GB Unified)
Apple Silicon•Unified LPDDR4X•128-bit
8 GB
统一内存
68.25 GB/s1%
7B (Tight)F$350

官方本地 AI 硬件综合天梯榜与显存带宽排行 (176 款显卡)

单用户 batch=1 本地大模型自回归解码严格受制于显存物理带宽。显存带宽决定每秒 Token 生成速度 (TPS),而显存容量决定能够直接装入显卡的最大模型尺寸。

排名显卡型号架构代号显存容量显存带宽AI 梯队参考售价实测模拟
#1NVIDIA B200 SXM (192GB)Blackwell192 GB8000 GB/sS+$45,000载入模拟
#2NVIDIA B100 SXM (192GB)Blackwell192 GB8000 GB/sS+$32,000载入模拟
#3AMD Instinct MI325X (256GB)CDNA 3256 GB6000 GB/sS+$24,000载入模拟
#4AMD Instinct MI300X (192GB)CDNA 3192 GB5300 GB/sS+$20,000载入模拟
#5NVIDIA H200 SXM (141GB)Hopper141 GB4800 GB/sS+$38,000载入模拟
#6AMD Instinct MI300A (128GB APU)CDNA 3128 GB5300 GB/sS+$18,000载入模拟
#7Intel Gaudi 3 (128GB)Gaudi128 GB3700 GB/sS+$15,000载入模拟
#8AMD Instinct MI250X (128GB)CDNA 2128 GB3200 GB/sS+$12,000载入模拟
#9NVIDIA H100 NVL (94GB)Hopper94 GB3900 GB/sS+$32,000载入模拟
#10NVIDIA H100 SXM5 (80GB)Hopper80 GB3350 GB/sS+$30,000载入模拟
#11NVIDIA H800 SXM (80GB)Hopper80 GB3350 GB/sS+$28,000载入模拟
#12Intel Gaudi 2 (96GB)Gaudi96 GB2450 GB/sS$9,000载入模拟
#13Apple M2 Ultra (192GB Unified)Apple Silicon192 GB800 GB/sS+$6,999载入模拟
#14NVIDIA A100 SXM4 (80GB)Ampere80 GB2039 GB/sS+$12,000载入模拟
#15NVIDIA A800 SXM4 (80GB)Ampere80 GB2039 GB/sS+$11,000载入模拟
#16NVIDIA A100 PCIe (80GB)Ampere80 GB1935 GB/sS+$14,000载入模拟
#17NVIDIA A800 PCIe (80GB)Ampere80 GB1935 GB/sS+$9,500载入模拟
#18Apple M2 Ultra (128GB Unified)Apple Silicon128 GB800 GB/sS+$5,499载入模拟
#19Apple M1 Ultra (128GB Unified)Apple Silicon128 GB800 GB/sS+$3,299载入模拟
#20AMD Instinct MI210 (64GB)CDNA 264 GB1600 GB/sS$6,500载入模拟
#21Apple M4 Max (128GB Unified)Apple Silicon128 GB546 GB/sS+$3,999载入模拟
#22Apple M3 Max (128GB Unified)Apple Silicon128 GB400 GB/sS+$3,499载入模拟
#23NVIDIA GeForce RTX 5090Blackwell32 GB1792 GB/sS+$1,999载入模拟
#24NVIDIA A100 PCIe (40GB)Ampere40 GB1555 GB/sS$6,500载入模拟
#25Apple M3 Max (96GB Unified)Apple Silicon96 GB400 GB/sS+$3,199载入模拟
#26Apple M2 Max (96GB Unified)Apple Silicon96 GB400 GB/sS$3,299载入模拟
#27NVIDIA RTX 6000 Ada (48GB)Ada Lovelace48 GB960 GB/sS+$6,800载入模拟
#28NVIDIA L40S (48GB)Ada Lovelace48 GB864 GB/sS+$7,200载入模拟
#29NVIDIA L40 (48GB)Ada Lovelace48 GB864 GB/sS+$6,800载入模拟
#30AMD Radeon PRO W7900 (48GB)RDNA 348 GB864 GB/sS$3,999载入模拟
#31Apple M2 Ultra (64GB Unified)Apple Silicon64 GB800 GB/sS$3,999载入模拟
#32Apple M1 Ultra (64GB Unified)Apple Silicon64 GB800 GB/sS$2,399载入模拟
#33AMD Instinct MI100 (32GB)CDNA 132 GB1228 GB/sA$3,500载入模拟
#34NVIDIA RTX A6000 (48GB)Ampere48 GB768 GB/sS+$4,200载入模拟
#35NVIDIA A40 (48GB)Ampere48 GB696 GB/sS$4,500载入模拟
#36NVIDIA Quadro RTX 8000 (48GB)Turing48 GB672 GB/sS$1,900载入模拟
#37AMD Instinct MI50 (32GB)Vega32 GB1024 GB/sA$260载入模拟
#38NVIDIA Tesla V100 SXM2 (32GB)Volta32 GB900 GB/sA$550载入模拟
#39NVIDIA Tesla V100 PCIe (32GB)Volta32 GB900 GB/sA$480载入模拟
#40Apple M4 Max (64GB Unified)Apple Silicon64 GB410 GB/sS$3,499载入模拟
#41Apple M2 Max (64GB Unified)Apple Silicon64 GB400 GB/sS$2,799载入模拟
#42Apple M1 Max (64GB Unified)Apple Silicon64 GB400 GB/sS$1,799载入模拟
#43NVIDIA GeForce RTX 4090Ada Lovelace24 GB1008 GB/sS+$1,599载入模拟
#44NVIDIA GeForce RTX 3090 TiAmpere24 GB1008 GB/sS+$899载入模拟
#45AMD Radeon RX 7900 XTXRDNA 324 GB960 GB/sA$899载入模拟
#46NVIDIA GeForce RTX 3090Ampere24 GB936 GB/sS+$699载入模拟
#47Apple M3 Max (64GB Unified)Apple Silicon64 GB300 GB/sS$2,899载入模拟
#48NVIDIA A30 (24GB)Ampere24 GB933 GB/sA$2,800载入模拟
2025/2026 年 8GB 显存陷阱

8GB 显卡(如 RTX 4060 8G 或 3070 8G)在面对现代大模型时受到致命限制。即使 7B 4-bit 权重就需要 4.8GB,加上 8k 上下文与 Windows 桌面开销(0.8GB),瞬间击穿显存上限,导致毁灭性的 PCIe 降速。

GDDR7 与下一代带宽飞跃

NVIDIA GeForce RTX 5090 Blackwell 架构引入 GDDR7 显存,带宽达到 1,792 GB/s(较 4090 提升 78%)。对于 DeepSeek R1 32B 和 Llama 3.3 70B,生成速度翻倍,消费级硬件即可突破 40+ tok/s。

Apple Silicon 统一内存的独特优势

苹果芯片(M2 Ultra 192GB、M3 Max 128GB)无需多卡集群即可提供超大显存池。虽然带宽低于 RTX 4090,但它是目前唯一能够低成本单机本地加载完整 671B DeepSeek R1 MoE 模型的消费级设备。