AWS said on Nov. 20 that SageMaker HyperPod's Global Inference Gateway is one managed endpoint across registered clusters in one Region or several, with Signature Version 4 and IAM authentication and PrivateLink traffic. It scores healthy clusters using default weights of 0.40 for Region proximity, 0.25 for queue depth, 0.20 for KV-cache headroom, and 0.15 for error rate, and it moves traffic off a failed cluster without a client change. AWS lists 13 Regions and states no separate price in the post.
/ Sources
/ About this story
Compiled by Venture Atlas from the sources above, using automated AI-assisted research. This is a summary of reporting published elsewhere, not original reporting - follow the source links for the full account. See our editorial standards.
Something wrong here? Email apostructura@gmail.com and we will fix it.
