Join us from October 8-10 in New York City to learn the latest tips, trends, and news about GraphQL Federation and API platform engineering.Join us for GraphQL Summit 2024 in NYC
Docs
Start for Free

Throughput Guide

Understand GCU performance and scale your graph's capacity


Cloud is currently in invite-only preview. Don't hesitate to get in touch if you'd like to request access or have any questions or feedback.

This guide covers:

  • An overview of Graph Compute Units () and their performance expectations
  • How to calculate the number of GCUs your needs
  • How to manage your supergraph's throughput capacity as needs change

Overview

Cloud Dedicated pricing is based on the amount of (GCUs) needed to run your graph. A GCU is a unit of throughput capacity that takes into account:

  • Processing incoming requests
  • Making a across s
  • Securely routing traffic to your backend services

GCUs run on AWS in the region of your choice.

Performance expectations

While Cloud Dedicated is in preview, these performance expectations may change.

From a single , you can expect the following baseline performance:

  • 25 requests per second (RPS)
  • 150 subgraph RPS
  • Up to 0.5 megabytes of response data per second

GCU performance varies depending on additional factors, such as payload size. For example, requests that return large payloads may decrease throughput below the baseline 25 RPS. Conversely, requests that return small amounts of data may achieve above the baseline 25 RPS.

Apollo recommends load testing your GraphQL workload on Cloud Dedicated before going into production.

Throughput factors

Beyond RPS, complexity and response size influence GCU throughput. For example, the following scenarios would decrease relative GCU throughput:

  • Requests that query more than five subgraphs
  • Requests that return hundreds or thousands of per

Requests like this decrease throughput because they require additional compute resources to execute. Factor in additional GCUs into your GCU calculation if your supergraph receives complex queries or returns large responses.

NOTE

GCUs include burst capacity to handle the occasional complex query. A sustained period of complex queries can exhaust this capacity.

Rate limiting

GCUs aren't rate-limited. However, GCUs do offer a specific amount of throughput capacity. It's possible to temporarily burst GCU throughput for a few seconds. After this period, clients receive 429 errors. Apollo recommends adding retry logic to your clients to minimize dropped requests.

GCU calculation

If you already use , you can calculate your required GCUs using the operation metrics in .

  1. In Studio, go to the Insights page and select Last month as the timeframe.
GraphOS Studio Insights page with timeframe selection
  1. Scroll down to the Request Rate chart. This chart shows the request rate in requests per minute (RPM).
  2. To calculate your required requests per second (RPS), find the peak RPM and divide it by 60.
  3. Since, as a baseline, 1 GCU can serve 25 RPS, divide your peak RPS by 25 to calculate your required GCUs.
GraphOS Studio Insights Request Rate chart with highlighted peak
  • In the example above, the peak is 19,000 RPM.
  • 19,000 / 60 = 317, so the has a peak of 317 RPS.
  • 317 / 25 = 13, so this workload requires at least 13 GCUs to operate.

NOTE

Factor in additional GCUs if your supergraph serves complex or large requests.

Load testing

Before going into production on Cloud Dedicated, Apollo highly recommends running a load test to simulate production traffic. For example, suppose you run a load test of 10% of a typical day's traffic, which runs well on a single GCU. That means you need at least 10 GCUs to operate your graph on a typical day.

Dedicated trials are available to help you run a load test for free. Get in touch to start a trial.

Manage capacity

Cloud Dedicated supports mission-critical production workloads, and you can scale performance to meet the needs of your GraphQL APIs. Dedicated supports up to 10 GCUs per GraphOS .

Dedicated starts with 1 GCU per variant. You can change a variant's GCUs via either:

NOTE

GCU updates takes about one minute to provision.

Edit GCUs in Studio

You can change a graph variant's GCUs from the Cloud Router page in Studio. Click Manage Capacity to the right of Router Capacity.

GraphOS Studio managed GCUs

Then, select the number of GCUs required and click Save changes.

Edit GCUs via API

You can change a graph variant's GCUs with the following from the GraphOS Platform API.

mutation Graph($graphId: ID!, $name: String!, $gcus: Int!) {
graph(id: $graphId) {
variant(name: $name) {
router {
setGcus(gcus: $gcus) {
... on RouterGcusSuccess {
order {
id
}
}
}
}
}
}
}

This mutation requires setting the following :

  • graphId: a graph's ID is the first part of the graph's
    • You can a graph's ID in GraphOS Studio under Settings > This Graph
  • name: the variant name
    • If you haven't set a variant name, the default is current
  • gcus: the number of GCUs to provision for the variant
Previous
Quickstart
Next
Custom Domains
Rate articleRateEdit on GitHubEditForumsDiscord

© 2024 Apollo Graph Inc., d/b/a Apollo GraphQL.

Privacy Policy

Company