ืชืฉืชื™ืช GPU

ืžืขื‘ื“ื™ GPU ื™ื™ืขื•ื“ื™ื™ื ืžืกื•ื’ A100.
ื”ื—ื•ืžืจื” ืฉืœื›ื. ื”ื ืชื•ื ื™ื ืฉืœื›ื.

ืฉืจืชื™ื ืคื™ื–ื™ื™ื ืžืกื•ื’ NVIDIA A100 40GB ื‘ืžืจื›ื–ื™ ื ืชื•ื ื™ื ื™ืฉืจืืœื™ื™ื ื‘ื“ื™ืจื•ื’ Tier III ื”ืžืจื™ืฆื™ื vLLM โ€” ื“ื™ื™ืจ ืื—ื“ ืœื›ืœ ืฉืจืช, ืขื VRAM ื™ื™ืขื•ื“ื™ ื•ืœืœื ืฉื›ื ื™ื ืจื•ืขืฉื™ื.

A100 / H100 / L40Sื“ื™ื™ืจ ื™ื—ื™ื“ื”ื’ืฉื” ื‘-vLLMืื—ืกื•ืŸ ื‘ื™ืฉืจืืœ

ื‘ื—ืจื• ืืช ื”ืกื™ืœื™ืงื•ืŸ ืฉืžืชืื™ื ืœืขื•ืžืก.

ื›ืœ ื“ืจื’ื” ืžื’ื™ืขื” ื›ืฆื•ืžืช bare-metal ืฉืœ ื“ื™ื™ืจ ื™ื—ื™ื“ โ€” ื›ืœ ื”-GPU ืฉืœื›ื, ืœืœื ื—ืœื•ืงืช ื–ืžืŸ ื‘ื™ืŸ ืžืฉื™ืžื•ืช ื–ืจื•ืช.

ืื™ืžื•ืŸ ื—ื–ื™ืช

NVIDIA H100

80GB HBM3 ืขื NVLink. ื”ื“ืจืš ื”ืžื”ื™ืจื” ื‘ื™ื•ืชืจ ืœื›ื•ื•ื ื•ืŸ ืขื“ื™ืŸ ื•ืœื”ืกืงื” ื‘ืชืคื•ืงื” ื’ื‘ื•ื”ื” ืขืœ ื”ืžื•ื“ืœื™ื ื”ืคืชื•ื—ื™ื ื”ื’ื“ื•ืœื™ื ื‘ื™ื•ืชืจ.

80GB HBM3 ยท SXM ยท NVLink
ื”ืกืงื” ื‘ืคืจื•ื“ืงืฉืŸ

NVIDIA A100

40 ืื• 80GB HBM2e โ€” ืกื•ืก ื”ืขื‘ื•ื“ื” ื”ืžื•ื›ื— ืœื”ื’ืฉืช Qwen, Llama ื•-Mistral ืขื vLLM ื‘ืขืœื•ืช ืฆืคื•ื™ื”.

40 / 80GB HBM2e ยท PCIe / SXM
ื”ื’ืฉื” ื—ืกื›ื•ื ื™ืช

NVIDIA L40S

48GB GDDR6 โ€” ื”ืืคืฉืจื•ืช ื”ื—ืกื›ื•ื ื™ืช ืœื”ืกืงื” ื™ืฆื™ื‘ื” ื‘ื’ื•ื“ืœ ื‘ื™ื ื•ื ื™ ื•ืœืขื•ืžืกื™ ื™ืฆื™ืจื” ื‘ืืฆื•ื•ื”.

48GB GDDR6 ยท PCIe

ื“ื™ื™ืจ ืื—ื“ ืœื›ืœ ืฉืจืช. ืœืœื ืฉื›ื ื™ื ืจื•ืขืฉื™ื.

ืขื ื ื™ ืฉื™ืชื•ืฃ ืžื—ืœืงื™ื GPU ืื—ื“ ื‘ื™ืŸ ื“ื™ื™ืจื™ื ืจื‘ื™ื โ€” ื”ื”ืฉื”ื™ื” ืฉืœื›ื ืชืœื•ื™ื” ื‘ื–ืจื™ื. ื›ืืŸ ื”ืขื•ืžืก ืฉืœื›ื ืžืงื•ื‘ืข ืœื—ื•ืžืจืช bare-metal ืžืฉืœื›ื ื‘ืชื•ืš ื’ื‘ื•ืœ ืฉื‘ื‘ืขืœื•ืชื›ื.

ื”ืฆืžืชื™ื ื”ื™ื™ืขื•ื“ื™ื™ื ืฉืœื›ื
H100 ยท 80GBืžืงื•ื‘ืข ืœื›ื
A100 ยท 80GBืžืงื•ื‘ืข ืœื›ื
L40S ยท 48GBืžืงื•ื‘ืข ืœื›ื
GPU ืขื ืŸ ืžืฉื•ืชืฃ
ื”ืžืฉื™ืžื” ืฉืœื›ืื“ื™ื™ืจ Bื“ื™ื™ืจ C
ืชื—ืจื•ืช ยท ื”ืื˜ื”

ื“ื™ื™ืจ ื™ื—ื™ื“ ืคื™ืจื•ืฉื• ืฉื›ืœ ื”ื›ืจื˜ื™ืก โ€” ื›ืœ ื”-VRAM, ืœื™ื‘ื•ืช ื”-SM ื•ื ืชื™ื‘ื™ ื”-PCIe โ€” ืขื•ื ื” ืœืขื•ืžืก ืื—ื“: ืฉืœื›ื. ืœืœื ืžืชื–ืžืŸ ืจื‘-ื“ื™ื™ืจื™, ืœืœื ืคื™ื ื•ื™ ืžืคืชื™ืข ื•ืœืœื ืืคื™ืง ื–ื™ื›ืจื•ืŸ ืžืฉื•ืชืฃ.

ืžื” GPU ื™ื™ืขื•ื“ื™ ื‘ืืžืช ื ื•ืชืŸ ืœื›ื.

1:1
ื™ื—ืก ื“ื™ื™ืจ-GPU โ€” ื›ืœ ื”ื›ืจื˜ื™ืก ืฉืœื›ื
80 GB
HBM ื™ื™ืขื•ื“ื™ ืœื›ืœ ืฆื•ืžืช, ืœืœื ื—ืœื•ืงืช ื–ืžืŸ
IL
ืื—ืกื•ืŸ ื‘ืžืจื›ื– ื ืชื•ื ื™ื ื™ืฉืจืืœื™ ื‘ื“ื™ืจื•ื’ Tier III
vLLM
ื”ื’ืฉื” ืžืžื•ื˜ื‘ืช ืœ-Qwen, Llama ื•-Mistral

ืืœื” ื™ื›ื•ืœื•ืช ืชืฉืชื™ืช, ืœื ืžื“ื“ื™ ืœืงื•ื—ื•ืช. ืชืคื•ืงื” ื•ื”ืฉื”ื™ื” ืชืœื•ื™ื•ืช ื‘ืžื•ื“ืœ, ื‘ื’ื•ื“ืœ ื”ืืฆื•ื•ื” ื•ื‘ืงื•ื•ื ื˜ื™ื–ืฆื™ื” ืฉืœื›ื โ€” ืื ื• ืžืชืื™ืžื™ื ืืช ื”ืฆื•ืžืช ื™ื—ื“ ืืชื›ื ืœืคื ื™ ื›ืœ ื”ืฆืขื”.

ืฉืจื™ื•ืŸ ืงื™ื‘ื•ืœืช

ื”ืžื•ื“ืœ ืฉืœื›ื ืจืื•ื™ ืœื—ื•ืžืจื” ืžืฉืœื•.

ืกืคืจื• ืœื ื• ืขืœ ื”ืžื•ื“ืœ ื•ืขืœ ื”ืขื•ืžืก. ื ืชืื™ื ืฆื•ืžืช GPU ืฉืœ ื“ื™ื™ืจ ื™ื—ื™ื“ ื•ื ื—ื–ื•ืจ ืขื ื”ืฆืขื” โ€” ืœืœื ืกื™ืœื™ืงื•ืŸ ืžืฉื•ืชืฃ ื•ืœืœื ื™ืฆื™ืืช ื ืชื•ื ื™ื ืžืชื—ื•ื ื”ืฉื™ืคื•ื˜ ืฉืœื›ื.