Instance comparison

Compare hardware specs and price across accelerator instance types. Search and add any number of types; the table starts with the xlarge of each family (or the smallest size a family offers). Specs come from DescribeInstanceTypes; on-demand list price is for us-east-1; the cheapest spot is the lowest price seen across regions in the last 24h; and the 24h averages are the mean spot price and mean spot placement score (1–10) over that window across all regions.

dl1.24xlargedl2q.24xlargeg4ad.xlargeg4dn.xlargeg5.xlargeg5g.xlargeg6.xlargeg6e.xlargeg6f.xlargeg7.2xlargeg7e.2xlargegr6.4xlargegr6f.4xlargeinf1.xlargeinf2.xlargep3dn.24xlargep4d.24xlargep4de.24xlargep5.4xlargep5e.48xlargep5en.48xlargep6-b200.48xlargep6-b300.48xlargetrn1.2xlargetrn1n.32xlargetrn2.48xlargevt1.3xlarge
Instance typevCPUsMemory (GiB)ArchAcceleratorCountAccel memory (GiB)NetworkOn-demand $/hrCheapest spot $/hrDiscount24h avg spot $/hr24h avg score
dl1.24xlarge96768x86_64Habana Gaudi HL-20582564x 100 Gigabit$13.11$13.11 (us-west-2)-0%$13.11
dl2q.24xlarge96768x86_64Qualcomm Qualcomm AI1008125100 Gigabit$4.68 (us-west-2)-48%$4.79
g4ad.xlarge416x86_64AMD Radeon Pro V52018Up to 10 Gigabit$0.379$0.077 (us-east-2)-80%$0.153
g4dn.xlarge416x86_64NVIDIA T4116Up to 25 Gigabit$0.526$0.109 (sa-east-1)-88%$0.252
g5.xlarge416x86_64NVIDIA A10G122Up to 10 Gigabit$1.01$0.218 (ap-southeast-3)-85%$0.5931.6
g5g.xlarge48arm64NVIDIA T4g116Up to 10 Gigabit$0.420$0.075 (ap-northeast-2)-86%$0.154
g6.xlarge416x86_64NVIDIA L4122Up to 10 Gigabit$0.805$0.228 (sa-east-1)-83%$0.4721.6
g6e.xlarge432x86_64NVIDIA L40S145Up to 20 Gigabit$1.86$0.597 (ap-south-1)-73%$1.321.7
g6f.xlarge416x86_64NVIDIA L403Up to 10 Gigabit$0.237$0.060 (eu-north-1)-76%$0.137
g7.2xlarge832x86_64NVIDIA RTX PRO 450013260 Gigabit$0.413 (us-east-2)-84%$0.7953.0
g7e.2xlarge864x86_64NVIDIA RTX PRO Server 600019650 Gigabit$3.36$1.13 (eu-south-2)-68%$1.922.1
gr6.4xlarge16128x86_64NVIDIA L4122Up to 25 Gigabit$1.54$0.250 (eu-south-2)-85%$0.547
gr6f.4xlarge16128x86_64NVIDIA L4011Up to 25 Gigabit$1.07$0.150 (eu-north-1)-87%$0.597
inf1.xlarge48x86_64AWS Inferentia18Up to 25 Gigabit$0.228$0.024 (eu-north-1)-90%$0.056
inf2.xlarge416x86_64AWS Inferentia2132Up to 15 Gigabit$0.758$0.076 (us-east-2)-90%$0.281
p3dn.24xlarge96768x86_64NVIDIA V1008256100 Gigabit$31.21$4.92 (us-east-1)-84%$6.80
p4d.24xlarge961152x86_64NVIDIA A10083204x 100 Gigabit$21.96$7.42 (us-east-2)-66%$19.13
p4de.24xlarge961152x86_64NVIDIA A10086404x 100 Gigabit$27.45$9.66 (ap-northeast-1)-74%$23.49
p5.4xlarge16256x86_64NVIDIA H100180100 Gigabit$6.88$2.63 (us-east-1)-62%$5.34
p5e.48xlarge1922048x86_64NVIDIA H200811283200 Gigabit$10.63 (sa-east-1)$26.61
p5en.48xlarge1922048x86_64NVIDIA H200811283200 Gigabit$63.30$10.98 (ap-northeast-2)-87%$31.34
p6-b200.48xlarge1922048x86_64NVIDIA B200814323200 Gigabit$113.93$40.89 (us-west-2)-64%$43.46
p6-b300.48xlarge1924096x86_64NVIDIA B300821496400 Gigabit$142.42$44.71 (us-east-1)-69%$49.51
trn1.2xlarge832x86_64AWS Trainium132Up to 12.5 Gigabit$1.34$0.134 (us-east-2)-90%$0.431
trn1n.32xlarge128512x86_64AWS Trainium1651216x 100 Gigabit$24.78$2.48 (us-east-2)-90%$3.40
trn2.48xlarge1922048x86_64AWS Trainium216819216x 200 Gigabit$8.60 (us-east-2)$8.60
vt1.3xlarge1224x86_64Xilinx U301243.12 Gigabit$0.650$0.171 (us-east-1)-74%$0.435