AWS opens a HyperPod gateway across clusters

AWS said on Nov. 20 that SageMaker HyperPod's Global Inference Gateway is one managed endpoint across registered clusters in one Region or several, with Signature Version 4 and IAM authentication and PrivateLink traffic. It scores healthy clusters using default weights of 0.40 for Region proximity, 0.25 for queue depth, 0.20 for KV-cache headroom, and 0.15 for error rate, and it moves traffic off a failed cluster without a client change. AWS lists 13 Regions and states no separate price in the post.

/ Sources

/ About this story

Compiled by Venture Atlas from the sources above, using automated AI-assisted research. This is a summary of reporting published elsewhere, not original reporting - follow the source links for the full account. See our editorial standards.

Something wrong here? Email apostructura@gmail.com and we will fix it.

/ Related