Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Nov 1, 2025

This PR contains the following updates:

Package Change Age Confidence
@graphql-hive/gateway (source) 2.1.12 -> 2.1.13 age confidence

Release Notes

graphql-hive/gateway (@​graphql-hive/gateway)

v2.1.13

Compare Source

Patch Changes

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Nov 1, 2025
@github-actions
Copy link

github-actions bot commented Nov 1, 2025

💻 Website Preview

The latest changes are available as preview in: https://546d1a4d.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1829 113816 total, 0 failed avg: 122ms, p95: 298ms
grafbase 1496 95133 total, 0 failed avg: 146ms, p95: 342ms
cosmo 678 43272 total, 0 failed avg: 324ms, p95: 724ms
apollo-router 408 27350 total, 0 failed avg: 516ms, p95: 1166ms ❌ 22 unexpected GraphQL errors, non-compatible response structure (1)
hive-gateway 257 17699 total, 0 failed avg: 791ms, p95: 1717ms
hive-gateway-bun 254 17873 total, 0 failed avg: 784ms, p95: 1671ms
apollo-gateway 148 10221 total, 0 failed avg: 1263ms, p95: 2566ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 338448      ✗ 0     
     data_received..................: 10 GB   161 MB/s
     data_sent......................: 132 MB  2.1 MB/s
     http_req_blocked...............: avg=510.4µs  min=1.11µs  med=2.55µs   max=354.12ms p(90)=3.98µs   p(95)=4.67µs   p(99.9)=179.22ms
     http_req_connecting............: avg=506.97µs min=0s      med=0s       max=354ms    p(90)=0s       p(95)=0s       p(99.9)=179.15ms
     http_req_duration..............: avg=122.3ms  min=1.69ms  med=110.79ms max=445.87ms p(90)=249.11ms p(95)=297.89ms p(99.9)=392.19ms
       { expected_response:true }...: avg=122.3ms  min=1.69ms  med=110.79ms max=445.87ms p(90)=249.11ms p(95)=297.89ms p(99.9)=392.19ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 113816
     http_req_receiving.............: avg=537.77µs min=23.11µs med=41.19µs  max=163.64ms p(90)=96.56µs  p(95)=394.24µs p(99.9)=78.59ms 
     http_req_sending...............: avg=432.25µs min=5.05µs  med=10.15µs  max=137.47ms p(90)=20.99µs  p(95)=128.33µs p(99.9)=69.34ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=121.33ms min=1.63ms  med=109.9ms  max=409.35ms p(90)=247.08ms p(95)=295.51ms p(99.9)=389.42ms
     http_reqs......................: 113816  1829.647491/s
     iteration_duration.............: avg=124.19ms min=1.87ms  med=112.31ms max=767.91ms p(90)=251.7ms  p(95)=300.48ms p(99.9)=427.8ms 
     iterations.....................: 112816  1813.572005/s
     success_rate...................: 100.00% ✓ 112816      ✗ 0     
     vus............................: 70      min=0         max=495 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 282399      ✗ 0    
     data_received..................: 8.4 GB  132 MB/s
     data_sent......................: 111 MB  1.7 MB/s
     http_req_blocked...............: avg=737.48µs min=1.25µs  med=3.07µs   max=561.12ms p(90)=4.64µs   p(95)=5.71µs   p(99.9)=234.36ms
     http_req_connecting............: avg=731.08µs min=0s      med=0s       max=561.08ms p(90)=0s       p(95)=0s       p(99.9)=233.05ms
     http_req_duration..............: avg=146.21ms min=2.62ms  med=135.26ms max=495.83ms p(90)=293.71ms p(95)=341.53ms p(99.9)=440.2ms 
       { expected_response:true }...: avg=146.21ms min=2.62ms  med=135.26ms max=495.83ms p(90)=293.71ms p(95)=341.53ms p(99.9)=440.2ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 95133
     http_req_receiving.............: avg=671.41µs min=26.14µs med=48.32µs  max=162.82ms p(90)=120.2µs  p(95)=453.83µs p(99.9)=90.92ms 
     http_req_sending...............: avg=623.89µs min=5.53µs  med=11.85µs  max=144.58ms p(90)=32.62µs  p(95)=145.3µs  p(99.9)=86.1ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=144.91ms min=2.58ms  med=133.82ms max=491.42ms p(90)=290.7ms  p(95)=339.05ms p(99.9)=433.18ms
     http_reqs......................: 95133   1496.949147/s
     iteration_duration.............: avg=148.88ms min=2.88ms  med=137.56ms max=882.45ms p(90)=296.96ms p(95)=345.54ms p(99.9)=531.48ms
     iterations.....................: 94133   1481.213817/s
     success_rate...................: 100.00% ✓ 94133       ✗ 0    
     vus............................: 86      min=0         max=499
     vus_max........................: 500     min=500       max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 126816     ✗ 0    
     data_received..................: 3.8 GB  60 MB/s
     data_sent......................: 50 MB   790 kB/s
     http_req_blocked...............: avg=119.61µs min=1.25µs  med=2.75µs   max=197.55ms p(90)=4.18µs   p(95)=5.91µs   p(99.9)=38.56ms
     http_req_connecting............: avg=114.2µs  min=0s      med=0s       max=197.51ms p(90)=0s       p(95)=0s       p(99.9)=35.23ms
     http_req_duration..............: avg=324.48ms min=2.78ms  med=294.92ms max=1.28s    p(90)=649.16ms p(95)=723.8ms  p(99.9)=1.03s  
       { expected_response:true }...: avg=324.48ms min=2.78ms  med=294.92ms max=1.28s    p(90)=649.16ms p(95)=723.8ms  p(99.9)=1.03s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 43272
     http_req_receiving.............: avg=736.36µs min=27.02µs med=59.19µs  max=198.19ms p(90)=176.2µs  p(95)=500.63µs p(99.9)=96.96ms
     http_req_sending...............: avg=181.13µs min=5.51µs  med=11.1µs   max=137.99ms p(90)=29.32µs  p(95)=127.03µs p(99.9)=38.66ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=323.56ms min=2.7ms   med=293.96ms max=1.28s    p(90)=647.99ms p(95)=722.53ms p(99.9)=1.03s  
     http_reqs......................: 43272   678.07262/s
     iteration_duration.............: avg=332.74ms min=3.14ms  med=304.37ms max=1.28s    p(90)=653.09ms p(95)=727.85ms p(99.9)=1.03s  
     iterations.....................: 42272   662.402611/s
     success_rate...................: 100.00% ✓ 42272      ✗ 0    
     vus............................: 53      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 26328 / ✗ 22
     ✗ valid response structure
      ↳  99% — ✓ 26349 / ✗ 1

     checks.........................: 99.97% ✓ 79027      ✗ 23   
     data_received..................: 2.4 GB 36 MB/s
     data_sent......................: 32 MB  476 kB/s
     http_req_blocked...............: avg=88.96µs  min=1.37µs  med=2.85µs   max=101.23ms p(90)=4.49µs  p(95)=6.28µs   p(99.9)=24.01ms
     http_req_connecting............: avg=83.85µs  min=0s      med=0s       max=101.17ms p(90)=0s      p(95)=0s       p(99.9)=23.96ms
     http_req_duration..............: avg=515.52ms min=5.98ms  med=477.51ms max=1.92s    p(90)=1.04s   p(95)=1.16s    p(99.9)=1.68s  
       { expected_response:true }...: avg=515.52ms min=5.98ms  med=477.51ms max=1.92s    p(90)=1.04s   p(95)=1.16s    p(99.9)=1.68s  
     http_req_failed................: 0.00%  ✓ 0          ✗ 27350
     http_req_receiving.............: avg=116.47µs min=30.31µs med=50.56µs  max=78.18ms  p(90)=99.96µs p(95)=189.47µs p(99.9)=11.1ms 
     http_req_sending...............: avg=117.57µs min=5.76µs  med=11.3µs   max=86.48ms  p(90)=29.75µs p(95)=118.4µs  p(99.9)=21.81ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=515.29ms min=5.93ms  med=477.39ms max=1.92s    p(90)=1.04s   p(95)=1.16s    p(99.9)=1.68s  
     http_reqs......................: 27350  408.603254/s
     iteration_duration.............: avg=535.54ms min=6.37ms  med=497.11ms max=1.92s    p(90)=1.05s   p(95)=1.17s    p(99.9)=1.69s  
     iterations.....................: 26350  393.663464/s
     success_rate...................: 99.91% ✓ 26328      ✗ 22   
     vus............................: 57     min=0        max=498
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50097      ✗ 0    
     data_received..................: 1.6 GB  23 MB/s
     data_sent......................: 21 MB   303 kB/s
     http_req_blocked...............: avg=175.44µs min=1.29µs  med=2.88µs   max=231.26ms p(90)=5.24µs   p(95)=9.12µs   p(99.9)=45.42ms
     http_req_connecting............: avg=170.02µs min=0s      med=0s       max=231.22ms p(90)=0s       p(95)=0s       p(99.9)=45.36ms
     http_req_duration..............: avg=790.97ms min=6.36ms  med=731.61ms max=5.34s    p(90)=1.59s    p(95)=1.71s    p(99.9)=4.28s  
       { expected_response:true }...: avg=790.97ms min=6.36ms  med=731.61ms max=5.34s    p(90)=1.59s    p(95)=1.71s    p(99.9)=4.28s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17699
     http_req_receiving.............: avg=210.68µs min=27.16µs med=46.56µs  max=176.95ms p(90)=104.04µs p(95)=385.89µs p(99.9)=31.92ms
     http_req_sending...............: avg=251.24µs min=5.68µs  med=11.3µs   max=167.08ms p(90)=37.14µs  p(95)=136.17µs p(99.9)=43.77ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=790.51ms min=6.31ms  med=730.97ms max=5.34s    p(90)=1.59s    p(95)=1.71s    p(99.9)=4.28s  
     http_reqs......................: 17699   257.984927/s
     iteration_duration.............: avg=838.83ms min=8.05ms  med=794.33ms max=5.38s    p(90)=1.61s    p(95)=1.72s    p(99.9)=4.35s  
     iterations.....................: 16699   243.408684/s
     success_rate...................: 100.00% ✓ 16699      ✗ 0    
     vus............................: 93      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 50619      ✗ 0    
     data_received..................: 1.6 GB  22 MB/s
     data_sent......................: 21 MB   299 kB/s
     http_req_blocked...............: avg=124.32µs min=1.31µs med=2.92µs   max=117.77ms p(90)=5.14µs  p(95)=8.7µs    p(99.9)=35.23ms
     http_req_connecting............: avg=118.45µs min=0s     med=0s       max=117.68ms p(90)=0s      p(95)=0s       p(99.9)=35.18ms
     http_req_duration..............: avg=783.9ms  min=7.43ms med=736.2ms  max=5.12s    p(90)=1.56s   p(95)=1.67s    p(99.9)=4.28s  
       { expected_response:true }...: avg=783.9ms  min=7.43ms med=736.2ms  max=5.12s    p(90)=1.56s   p(95)=1.67s    p(99.9)=4.28s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17873
     http_req_receiving.............: avg=165.21µs min=27.1µs med=46.79µs  max=107ms    p(90)=96.1µs  p(95)=154.72µs p(99.9)=21.12ms
     http_req_sending...............: avg=181.65µs min=5.73µs med=11.21µs  max=107.3ms  p(90)=30.26µs p(95)=80.51µs  p(99.9)=28.42ms
     http_req_tls_handshaking.......: avg=0s       min=0s     med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=783.55ms min=7.38ms med=735.61ms max=5.12s    p(90)=1.56s   p(95)=1.67s    p(99.9)=4.27s  
     http_reqs......................: 17873   254.805696/s
     iteration_duration.............: avg=830.71ms min=9.24ms med=797.99ms max=5.17s    p(90)=1.57s   p(95)=1.67s    p(99.9)=4.3s   
     iterations.....................: 16873   240.549237/s
     success_rate...................: 100.00% ✓ 16873      ✗ 0    
     vus............................: 69      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 27663      ✗ 0    
     data_received..................: 898 MB  13 MB/s
     data_sent......................: 12 MB   177 kB/s
     http_req_blocked...............: avg=43.93µs min=1.26µs  med=3.78µs  max=31.7ms  p(90)=6.43µs   p(95)=16.28µs  p(99.9)=11.43ms
     http_req_connecting............: avg=37.19µs min=0s      med=0s      max=31.59ms p(90)=0s       p(95)=0s       p(99.9)=11.37ms
     http_req_duration..............: avg=1.26s   min=7.53ms  med=1.23s   max=16.73s  p(90)=2.28s    p(95)=2.56s    p(99.9)=14.61s 
       { expected_response:true }...: avg=1.26s   min=7.53ms  med=1.23s   max=16.73s  p(90)=2.28s    p(95)=2.56s    p(99.9)=14.61s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 10221
     http_req_receiving.............: avg=91.28µs min=27.12µs med=71.55µs max=9.77ms  p(90)=121.27µs p(95)=155.73µs p(99.9)=2.27ms 
     http_req_sending...............: avg=49.87µs min=6.29µs  med=15.06µs max=50.5ms  p(90)=35.19µs  p(95)=52.81µs  p(99.9)=7.6ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=1.26s   min=7.45ms  med=1.23s   max=16.73s  p(90)=2.28s    p(95)=2.56s    p(99.9)=14.61s 
     http_reqs......................: 10221   148.059471/s
     iteration_duration.............: avg=1.39s   min=8.64ms  med=1.36s   max=16.74s  p(90)=2.32s    p(95)=2.61s    p(99.9)=14.7s  
     iterations.....................: 9221    133.573661/s
     success_rate...................: 100.00% ✓ 9221       ✗ 0    
     vus............................: 82      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14041 total, 0 failed avg: 216ms, p95: 227ms
hive-router 168 13642 total, 0 failed avg: 222ms, p95: 231ms
cosmo 167 13543 total, 0 failed avg: 223ms, p95: 246ms
hive-gateway 160 12313 total, 0 failed avg: 245ms, p95: 277ms
hive-gateway-bun 158 12169 total, 0 failed avg: 248ms, p95: 278ms
apollo-router 139 11343 total, 0 failed avg: 266ms, p95: 313ms
apollo-gateway 124 10175 total, 0 failed avg: 297ms, p95: 328ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41823      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   201 kB/s
     http_req_blocked...............: avg=19.47µs  min=1.18µs   med=1.87µs   max=9.11ms   p(90)=3.34µs   p(95)=4.81µs   p(99.9)=6.87ms  
     http_req_connecting............: avg=16.41µs  min=0s       med=0s       max=9.08ms   p(90)=0s       p(95)=0s       p(99.9)=6.7ms   
     http_req_duration..............: avg=215.57ms min=113.54ms med=214.8ms  max=611.86ms p(90)=224.11ms p(95)=226.88ms p(99.9)=509.66ms
       { expected_response:true }...: avg=215.57ms min=113.54ms med=214.8ms  max=611.86ms p(90)=224.11ms p(95)=226.88ms p(99.9)=509.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14041
     http_req_receiving.............: avg=88.5µs   min=26.22µs  med=46.37µs  max=23.56ms  p(90)=93.94µs  p(95)=235.92µs p(99.9)=5.91ms  
     http_req_sending...............: avg=112.52µs min=5.36µs   med=8.17µs   max=370.37ms p(90)=25.87µs  p(95)=96.71µs  p(99.9)=9.03ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=215.37ms min=113.47ms med=214.68ms max=610.37ms p(90)=223.98ms p(95)=226.69ms p(99.9)=495.99ms
     http_reqs......................: 14041   173.1689/s
     iteration_duration.............: avg=215.87ms min=113.77ms med=215.05ms max=624.63ms p(90)=224.31ms p(95)=227.07ms p(99.9)=529.05ms
     iterations.....................: 13941   171.935591/s
     success_rate...................: 100.00% ✓ 13941      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40626      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   196 kB/s
     http_req_blocked...............: avg=15.21µs  min=1µs      med=1.83µs   max=6.94ms   p(90)=3.42µs   p(95)=4.89µs   p(99.9)=5ms     
     http_req_connecting............: avg=12.82µs  min=0s       med=0s       max=6.91ms   p(90)=0s       p(95)=0s       p(99.9)=4.98ms  
     http_req_duration..............: avg=221.57ms min=157.2ms  med=220.73ms max=606.81ms p(90)=228.44ms p(95)=230.91ms p(99.9)=509.28ms
       { expected_response:true }...: avg=221.57ms min=157.2ms  med=220.73ms max=606.81ms p(90)=228.44ms p(95)=230.91ms p(99.9)=509.28ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13642
     http_req_receiving.............: avg=85.57µs  min=22.9µs   med=40.89µs  max=166.48ms p(90)=89.95µs  p(95)=236.33µs p(99.9)=2.19ms  
     http_req_sending...............: avg=99.6µs   min=4.39µs   med=7.03µs   max=332.97ms p(90)=21.74µs  p(95)=92.15µs  p(99.9)=8.69ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=221.38ms min=157.12ms med=220.64ms max=594.7ms  p(90)=228.28ms p(95)=230.73ms p(99.9)=489.22ms
     http_reqs......................: 13642   168.501632/s
     iteration_duration.............: avg=221.88ms min=157.42ms med=220.96ms max=618.94ms p(90)=228.63ms p(95)=231.11ms p(99.9)=519.78ms
     iterations.....................: 13542   167.266464/s
     success_rate...................: 100.00% ✓ 13542      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40329      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   194 kB/s
     http_req_blocked...............: avg=20.3µs   min=1.43µs   med=2.65µs   max=9.13ms   p(90)=3.81µs   p(95)=4.81µs   p(99.9)=6.78ms  
     http_req_connecting............: avg=16.94µs  min=0s       med=0s       max=9.1ms    p(90)=0s       p(95)=0s       p(99.9)=6.76ms  
     http_req_duration..............: avg=223.26ms min=128.2ms  med=222.01ms max=631.39ms p(90)=240.87ms p(95)=246.23ms p(99.9)=520.5ms 
       { expected_response:true }...: avg=223.26ms min=128.2ms  med=222.01ms max=631.39ms p(90)=240.87ms p(95)=246.23ms p(99.9)=520.5ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 13543
     http_req_receiving.............: avg=500.86µs min=28.34µs  med=59.37µs  max=164.17ms p(90)=332.15µs p(95)=878.79µs p(99.9)=28.14ms 
     http_req_sending...............: avg=112.9µs  min=5.8µs    med=10.68µs  max=278.71ms p(90)=30.52µs  p(95)=119.9µs  p(99.9)=5.07ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.65ms min=126.59ms med=221.54ms max=630.72ms p(90)=240.16ms p(95)=245.58ms p(99.9)=507.81ms
     http_reqs......................: 13543   167.154107/s
     iteration_duration.............: avg=223.7ms  min=128.43ms med=222.42ms max=653.48ms p(90)=241.22ms p(95)=246.51ms p(99.9)=539.54ms
     iterations.....................: 13443   165.919859/s
     success_rate...................: 100.00% ✓ 13443      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36639      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   187 kB/s
     http_req_blocked...............: avg=24.57µs  min=1.15µs   med=2.65µs   max=10.74ms  p(90)=4.27µs   p(95)=5.52µs   p(99.9)=8.11ms  
     http_req_connecting............: avg=21.03µs  min=0s       med=0s       max=10.71ms  p(90)=0s       p(95)=0s       p(99.9)=8.06ms  
     http_req_duration..............: avg=245.31ms min=160.39ms med=237.85ms max=802.95ms p(90)=261.52ms p(95)=277.42ms p(99.9)=684.35ms
       { expected_response:true }...: avg=245.31ms min=160.39ms med=237.85ms max=802.95ms p(90)=261.52ms p(95)=277.42ms p(99.9)=684.35ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12313
     http_req_receiving.............: avg=107.24µs min=24.43µs  med=48.03µs  max=166.25ms p(90)=108.83µs p(95)=182.47µs p(99.9)=5.88ms  
     http_req_sending...............: avg=129.14µs min=5.45µs   med=10.79µs  max=322.93ms p(90)=31.96µs  p(95)=120.99µs p(99.9)=5.81ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=245.08ms min=160.3ms  med=237.74ms max=802.19ms p(90)=261.3ms  p(95)=277.03ms p(99.9)=682.88ms
     http_reqs......................: 12313   160.900989/s
     iteration_duration.............: avg=246.38ms min=161.14ms med=238.28ms max=854.12ms p(90)=262ms    p(95)=278.06ms p(99.9)=712.13ms
     iterations.....................: 12213   159.594232/s
     success_rate...................: 100.00% ✓ 12213      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36207      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   185 kB/s
     http_req_blocked...............: avg=28.17µs  min=1.08µs   med=2.66µs   max=11.56ms  p(90)=4.42µs   p(95)=5.93µs   p(99.9)=9ms     
     http_req_connecting............: avg=24.58µs  min=0s       med=0s       max=11.53ms  p(90)=0s       p(95)=0s       p(99.9)=8.97ms  
     http_req_duration..............: avg=248.18ms min=139.96ms med=239.36ms max=804.83ms p(90)=260.56ms p(95)=277.62ms p(99.9)=706.15ms
       { expected_response:true }...: avg=248.18ms min=139.96ms med=239.36ms max=804.83ms p(90)=260.56ms p(95)=277.62ms p(99.9)=706.15ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12169
     http_req_receiving.............: avg=91.35µs  min=26.51µs  med=48.86µs  max=8.79ms   p(90)=111.58µs p(95)=210.61µs p(99.9)=4.66ms  
     http_req_sending...............: avg=124.67µs min=5.59µs   med=11.16µs  max=189.93ms p(90)=34.01µs  p(95)=126.14µs p(99.9)=8.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=247.96ms min=134.87ms med=239.21ms max=804.11ms p(90)=260.36ms p(95)=277.29ms p(99.9)=704.85ms
     http_reqs......................: 12169   158.662636/s
     iteration_duration.............: avg=249.27ms min=140.28ms med=239.75ms max=846.65ms p(90)=260.94ms p(95)=278.12ms p(99.9)=746.93ms
     iterations.....................: 12069   157.35881/s
     success_rate...................: 100.00% ✓ 12069      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33729      ✗ 0    
     data_received..................: 995 MB  12 MB/s
     data_sent......................: 13 MB   162 kB/s
     http_req_blocked...............: avg=22.19µs  min=1.67µs   med=2.77µs   max=7.8ms    p(90)=4.08µs   p(95)=5.15µs   p(99.9)=6.14ms  
     http_req_connecting............: avg=17.92µs  min=0s       med=0s       max=7.76ms   p(90)=0s       p(95)=0s       p(99.9)=6.12ms  
     http_req_duration..............: avg=266.48ms min=137.03ms med=264.3ms  max=692.47ms p(90)=302.72ms p(95)=312.88ms p(99.9)=595.8ms 
       { expected_response:true }...: avg=266.48ms min=137.03ms med=264.3ms  max=692.47ms p(90)=302.72ms p(95)=312.88ms p(99.9)=595.8ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11343
     http_req_receiving.............: avg=120.5µs  min=31.43µs  med=50.39µs  max=14.81ms  p(90)=148.77µs p(95)=427.07µs p(99.9)=5.52ms  
     http_req_sending...............: avg=110.81µs min=6.82µs   med=10.85µs  max=244.35ms p(90)=38.83µs  p(95)=140.9µs  p(99.9)=5.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=266.25ms min=136.96ms med=264.16ms max=691.27ms p(90)=302.46ms p(95)=312.61ms p(99.9)=594.65ms
     http_reqs......................: 11343   139.365938/s
     iteration_duration.............: avg=267.39ms min=137.26ms med=264.97ms max=716.07ms p(90)=303.21ms p(95)=313.39ms p(99.9)=616.62ms
     iterations.....................: 11243   138.137286/s
     success_rate...................: 100.00% ✓ 11243      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30225      ✗ 0    
     data_received..................: 894 MB  11 MB/s
     data_sent......................: 12 MB   145 kB/s
     http_req_blocked...............: avg=32.58µs  min=1.41µs   med=3.29µs   max=11.42ms  p(90)=4.76µs   p(95)=5.68µs   p(99.9)=8.83ms  
     http_req_connecting............: avg=27.22µs  min=0s       med=0s       max=10.71ms  p(90)=0s       p(95)=0s       p(99.9)=8.63ms  
     http_req_duration..............: avg=296.95ms min=209.72ms med=294.6ms  max=841.77ms p(90)=319.49ms p(95)=328.1ms  p(99.9)=736.69ms
       { expected_response:true }...: avg=296.95ms min=209.72ms med=294.6ms  max=841.77ms p(90)=319.49ms p(95)=328.1ms  p(99.9)=736.69ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10175
     http_req_receiving.............: avg=101.72µs min=30.56µs  med=59.25µs  max=174.69ms p(90)=109.45µs p(95)=141.27µs p(99.9)=2.91ms  
     http_req_sending...............: avg=114.73µs min=6.46µs   med=12.94µs  max=309.53ms p(90)=21.79µs  p(95)=39.24µs  p(99.9)=3.14ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=296.73ms min=209.65ms med=294.5ms  max=840.37ms p(90)=319.32ms p(95)=327.91ms p(99.9)=713.17ms
     http_reqs......................: 10175   124.767468/s
     iteration_duration.............: avg=298.3ms  min=242.16ms med=295.11ms max=896.6ms  p(90)=319.93ms p(95)=328.5ms  p(99.9)=799.9ms 
     iterations.....................: 10075   123.541252/s
     success_rate...................: 100.00% ✓ 10075      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13944 total, 0 failed avg: 217ms, p95: 229ms
hive-router 165 13441 total, 0 failed avg: 225ms, p95: 237ms
cosmo 158 12847 total, 0 failed avg: 235ms, p95: 261ms
hive-gateway 146 11215 total, 0 failed avg: 269ms, p95: 306ms
hive-gateway-bun 143 10991 total, 0 failed avg: 274ms, p95: 372ms
apollo-router 127 10351 total, 0 failed avg: 292ms, p95: 337ms
apollo-gateway 86 7045 total, 0 failed avg: 430ms, p95: 473ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41532      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=19.78µs  min=1.21µs   med=1.99µs   max=9.55ms   p(90)=3.74µs   p(95)=5.27µs   p(99.9)=6.9ms   
     http_req_connecting............: avg=17µs     min=0s       med=0s       max=9.49ms   p(90)=0s       p(95)=0s       p(99.9)=6.88ms  
     http_req_duration..............: avg=216.91ms min=159.06ms med=215.93ms max=635.62ms p(90)=225.99ms p(95)=229.01ms p(99.9)=535.65ms
       { expected_response:true }...: avg=216.91ms min=159.06ms med=215.93ms max=635.62ms p(90)=225.99ms p(95)=229.01ms p(99.9)=535.65ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13944
     http_req_receiving.............: avg=84.79µs  min=26.8µs   med=47.06µs  max=12.26ms  p(90)=102.73µs p(95)=250.54µs p(99.9)=5.43ms  
     http_req_sending...............: avg=127.7µs  min=6.16µs   med=8.34µs   max=404.56ms p(90)=32.28µs  p(95)=96.62µs  p(99.9)=9.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.7ms  min=159ms    med=215.82ms max=634.62ms p(90)=225.81ms p(95)=228.83ms p(99.9)=510.49ms
     http_reqs......................: 13944   172.014183/s
     iteration_duration.............: avg=217.22ms min=159.22ms med=216.19ms max=648.75ms p(90)=226.23ms p(95)=229.21ms p(99.9)=546.74ms
     iterations.....................: 13844   170.780576/s
     success_rate...................: 100.00% ✓ 13844      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40023      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.58µs  min=1.23µs   med=2.38µs   max=9.87ms   p(90)=3.58µs   p(95)=4.92µs   p(99.9)=7.36ms  
     http_req_connecting............: avg=18.73µs  min=0s       med=0s       max=9.83ms   p(90)=0s       p(95)=0s       p(99.9)=7.34ms  
     http_req_duration..............: avg=225.06ms min=125.29ms med=223.89ms max=645.47ms p(90)=233.64ms p(95)=236.62ms p(99.9)=543.53ms
       { expected_response:true }...: avg=225.06ms min=125.29ms med=223.89ms max=645.47ms p(90)=233.64ms p(95)=236.62ms p(99.9)=543.53ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13441
     http_req_receiving.............: avg=79µs     min=26.61µs  med=45.44µs  max=10.7ms   p(90)=93.75µs  p(95)=255.83µs p(99.9)=2.35ms  
     http_req_sending...............: avg=128.27µs min=5.85µs   med=9.82µs   max=413.68ms p(90)=28.94µs  p(95)=105.86µs p(99.9)=6.49ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=224.85ms min=120.01ms med=223.79ms max=644.54ms p(90)=233.51ms p(95)=236.35ms p(99.9)=529.65ms
     http_reqs......................: 13441   165.890441/s
     iteration_duration.............: avg=225.48ms min=125.57ms med=224.17ms max=668.5ms  p(90)=233.84ms p(95)=236.81ms p(99.9)=569.82ms
     iterations.....................: 13341   164.656229/s
     success_rate...................: 100.00% ✓ 13341      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38241      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=23.5µs   min=1.5µs    med=2.62µs   max=10.14ms  p(90)=3.83µs   p(95)=4.82µs   p(99.9)=7.72ms  
     http_req_connecting............: avg=20.28µs  min=0s       med=0s       max=10.11ms  p(90)=0s       p(95)=0s       p(99.9)=7.7ms   
     http_req_duration..............: avg=235.08ms min=115.16ms med=233.71ms max=651.75ms p(90)=255.18ms p(95)=261.25ms p(99.9)=536.6ms 
       { expected_response:true }...: avg=235.08ms min=115.16ms med=233.71ms max=651.75ms p(90)=255.18ms p(95)=261.25ms p(99.9)=536.6ms 
     http_req_failed................: 0.00%   ✓ 0          ✗ 12847
     http_req_receiving.............: avg=321.29µs min=31.3µs   med=59.57µs  max=41.77ms  p(90)=179.86µs p(95)=456.71µs p(99.9)=29.26ms 
     http_req_sending...............: avg=135.33µs min=6.36µs   med=10.76µs  max=294.05ms p(90)=28.92µs  p(95)=124.67µs p(99.9)=4ms     
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=234.63ms min=111.14ms med=233.36ms max=650.77ms p(90)=254.6ms  p(95)=260.83ms p(99.9)=535.7ms 
     http_reqs......................: 12847   158.531063/s
     iteration_duration.............: avg=235.63ms min=115.47ms med=234.13ms max=681.66ms p(90)=255.51ms p(95)=261.58ms p(99.9)=564.38ms
     iterations.....................: 12747   157.29707/s
     success_rate...................: 100.00% ✓ 12747      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33345      ✗ 0    
     data_received..................: 985 MB  13 MB/s
     data_sent......................: 13 MB   171 kB/s
     http_req_blocked...............: avg=29.75µs  min=1.14µs   med=2.68µs   max=11.4ms   p(90)=4.26µs   p(95)=5.95µs   p(99.9)=9.08ms
     http_req_connecting............: avg=26.18µs  min=0s       med=0s       max=11.37ms  p(90)=0s       p(95)=0s       p(99.9)=9.05ms
     http_req_duration..............: avg=268.72ms min=131.18ms med=258.66ms max=1.04s    p(90)=276ms    p(95)=306.47ms p(99.9)=1.04s 
       { expected_response:true }...: avg=268.72ms min=131.18ms med=258.66ms max=1.04s    p(90)=276ms    p(95)=306.47ms p(99.9)=1.04s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11215
     http_req_receiving.............: avg=111.35µs min=26.25µs  med=45.66µs  max=197.59ms p(90)=104.27µs p(95)=386.12µs p(99.9)=4.07ms
     http_req_sending...............: avg=141.45µs min=5.7µs    med=11.17µs  max=198.66ms p(90)=38.94µs  p(95)=157.97µs p(99.9)=8.85ms
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=268.47ms min=131.12ms med=258.52ms max=1.04s    p(90)=275.71ms p(95)=305.25ms p(99.9)=1.04s 
     http_reqs......................: 11215   146.81568/s
     iteration_duration.............: avg=270.05ms min=131.42ms med=259.05ms max=1.04s    p(90)=276.4ms  p(95)=309.86ms p(99.9)=1.04s 
     iterations.....................: 11115   145.506579/s
     success_rate...................: 100.00% ✓ 11115      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 32673      ✗ 0    
     data_received..................: 965 MB  13 MB/s
     data_sent......................: 13 MB   167 kB/s
     http_req_blocked...............: avg=30.71µs  min=1.13µs   med=2.74µs   max=11.69ms  p(90)=4.35µs   p(95)=5.79µs   p(99.9)=9.18ms  
     http_req_connecting............: avg=27.16µs  min=0s       med=0s       max=11.65ms  p(90)=0s       p(95)=0s       p(99.9)=9.15ms  
     http_req_duration..............: avg=274.4ms  min=148.63ms med=263.17ms max=969.76ms p(90)=287.46ms p(95)=372.41ms p(99.9)=964.96ms
       { expected_response:true }...: avg=274.4ms  min=148.63ms med=263.17ms max=969.76ms p(90)=287.46ms p(95)=372.41ms p(99.9)=964.96ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10991
     http_req_receiving.............: avg=113.68µs min=26.28µs  med=45.41µs  max=127.91ms p(90)=106.28µs p(95)=372.08µs p(99.9)=4.85ms  
     http_req_sending...............: avg=120.85µs min=5.4µs    med=10.9µs   max=232.17ms p(90)=36.03µs  p(95)=151.27µs p(99.9)=5.55ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=274.16ms min=148.57ms med=263.03ms max=969.71ms p(90)=287.16ms p(95)=371.36ms p(99.9)=964.9ms 
     http_reqs......................: 10991   143.868773/s
     iteration_duration.............: avg=275.79ms min=148.9ms  med=263.58ms max=969.99ms p(90)=287.91ms p(95)=373.68ms p(99.9)=965.33ms
     iterations.....................: 10891   142.559804/s
     success_rate...................: 100.00% ✓ 10891      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30753      ✗ 0    
     data_received..................: 908 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=22.62µs  min=1.72µs   med=2.7µs    max=7.66ms   p(90)=3.92µs   p(95)=4.74µs   p(99.9)=6.14ms  
     http_req_connecting............: avg=19.28µs  min=0s       med=0s       max=7.63ms   p(90)=0s       p(95)=0s       p(99.9)=6.13ms  
     http_req_duration..............: avg=291.79ms min=150.71ms med=292.48ms max=727.14ms p(90)=327.42ms p(95)=336.67ms p(99.9)=639.66ms
       { expected_response:true }...: avg=291.79ms min=150.71ms med=292.48ms max=727.14ms p(90)=327.42ms p(95)=336.67ms p(99.9)=639.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10351
     http_req_receiving.............: avg=90.73µs  min=36.28µs  med=49.84µs  max=42.49ms  p(90)=99.62µs  p(95)=275.44µs p(99.9)=1.69ms  
     http_req_sending...............: avg=113.61µs min=7.79µs   med=11.09µs  max=274.16ms p(90)=29.81µs  p(95)=139.35µs p(99.9)=3.64ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.59ms min=148.53ms med=292.4ms  max=725.88ms p(90)=327.29ms p(95)=336.37ms p(99.9)=638.59ms
     http_reqs......................: 10351   127.373228/s
     iteration_duration.............: avg=293.02ms min=150.96ms med=293.3ms  max=763.18ms p(90)=327.81ms p(95)=337.12ms p(99.9)=670.31ms
     iterations.....................: 10251   126.142688/s
     success_rate...................: 100.00% ✓ 10251      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20835     ✗ 0   
     data_received..................: 619 MB  7.6 MB/s
     data_sent......................: 8.2 MB  100 kB/s
     http_req_blocked...............: avg=48.73µs  min=1.42µs   med=3.11µs   max=11.94ms  p(90)=4.42µs   p(95)=5.3µs    p(99.9)=10.57ms 
     http_req_connecting............: avg=45.07µs  min=0s       med=0s       max=11.89ms  p(90)=0s       p(95)=0s       p(99.9)=10.54ms 
     http_req_duration..............: avg=430.11ms min=210.44ms med=432.85ms max=953.06ms p(90)=461.14ms p(95)=472.76ms p(99.9)=873.95ms
       { expected_response:true }...: avg=430.11ms min=210.44ms med=432.85ms max=953.06ms p(90)=461.14ms p(95)=472.76ms p(99.9)=873.95ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 7045
     http_req_receiving.............: avg=63.57µs  min=28.19µs  med=52.22µs  max=2.33ms   p(90)=92.26µs  p(95)=106.84µs p(99.9)=606.27µs
     http_req_sending...............: avg=112.59µs min=6.39µs   med=12.45µs  max=247.66ms p(90)=18.19µs  p(95)=23.7µs   p(99.9)=2.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=429.93ms min=210.37ms med=432.76ms max=951.75ms p(90)=461.01ms p(95)=472.64ms p(99.9)=872.43ms
     http_reqs......................: 7045    86.224612/s
     iteration_duration.............: avg=433.94ms min=266.06ms med=433.36ms max=999.39ms p(90)=461.53ms p(95)=473.35ms p(99.9)=949.35ms
     iterations.....................: 6945    85.0007/s
     success_rate...................: 100.00% ✓ 6945      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1790 107829 total, 0 failed avg: 28ms, p95: 50ms
grafbase 1593 96220 total, 0 failed avg: 31ms, p95: 54ms
cosmo 690 41748 total, 0 failed avg: 72ms, p95: 105ms
apollo-router 381 23169 total, 0 failed avg: 129ms, p95: 168ms
hive-gateway 305 18675 total, 0 failed avg: 161ms, p95: 277ms
hive-gateway-bun 288 17617 total, 0 failed avg: 170ms, p95: 244ms
apollo-gateway 118 7235 total, 0 failed avg: 416ms, p95: 489ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 323187      ✗ 0     
     data_received..................: 9.5 GB  157 MB/s
     data_sent......................: 125 MB  2.1 MB/s
     http_req_blocked...............: avg=5.19µs   min=1.12µs  med=2.52µs  max=9.16ms   p(90)=3.72µs   p(95)=4.38µs   p(99.9)=89.31µs
     http_req_connecting............: avg=2.15µs   min=0s      med=0s      max=9.13ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.57ms  min=1.89ms  med=24.73ms max=433.55ms p(90)=43.42ms  p(95)=50.08ms  p(99.9)=92.22ms
       { expected_response:true }...: avg=27.57ms  min=1.89ms  med=24.73ms max=433.55ms p(90)=43.42ms  p(95)=50.08ms  p(99.9)=92.22ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 107829
     http_req_receiving.............: avg=128.43µs min=22.15µs med=42.42µs max=119.83ms p(90)=112.95µs p(95)=353.42µs p(99.9)=15.12ms
     http_req_sending...............: avg=109.8µs  min=4.91µs  med=9.93µs  max=389.86ms p(90)=30.25µs  p(95)=128.12µs p(99.9)=15.27ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=27.34ms  min=1.79ms  med=24.56ms max=423.04ms p(90)=42.98ms  p(95)=49.61ms  p(99.9)=85.34ms
     http_reqs......................: 107829  1790.160723/s
     iteration_duration.............: avg=27.83ms  min=3.29ms  med=24.97ms max=450.44ms p(90)=43.67ms  p(95)=50.33ms  p(99.9)=92.64ms
     iterations.....................: 107729  1788.500538/s
     success_rate...................: 100.00% ✓ 107729      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 288360      ✗ 0    
     data_received..................: 8.5 GB  140 MB/s
     data_sent......................: 112 MB  1.9 MB/s
     http_req_blocked...............: avg=6.03µs   min=1.21µs  med=2.91µs  max=9.71ms   p(90)=4.08µs   p(95)=4.82µs   p(99.9)=116.98µs
     http_req_connecting............: avg=2.49µs   min=0s      med=0s      max=9.67ms   p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=30.89ms  min=3.04ms  med=27.68ms max=489.19ms p(90)=47.33ms  p(95)=54.09ms  p(99.9)=95.07ms 
       { expected_response:true }...: avg=30.89ms  min=3.04ms  med=27.68ms max=489.19ms p(90)=47.33ms  p(95)=54.09ms  p(99.9)=95.07ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 96220
     http_req_receiving.............: avg=146.45µs min=24.06µs med=47.16µs max=54.68ms  p(90)=140.08µs p(95)=391.75µs p(99.9)=16.58ms 
     http_req_sending...............: avg=121.93µs min=5.23µs  med=11.43µs max=226.82ms p(90)=36.74µs  p(95)=138.13µs p(99.9)=18.4ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.62ms  min=3ms     med=27.48ms max=487.96ms p(90)=46.83ms  p(95)=53.5ms   p(99.9)=90.13ms 
     http_reqs......................: 96220   1593.183406/s
     iteration_duration.............: avg=31.2ms   min=7.56ms  med=27.96ms max=534.93ms p(90)=47.63ms  p(95)=54.39ms  p(99.9)=96.65ms 
     iterations.....................: 96120   1591.527634/s
     success_rate...................: 100.00% ✓ 96120       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 124944     ✗ 0    
     data_received..................: 3.7 GB  61 MB/s
     data_sent......................: 49 MB   804 kB/s
     http_req_blocked...............: avg=9.68µs   min=1.25µs  med=2.76µs  max=9.87ms   p(90)=3.82µs   p(95)=4.58µs   p(99.9)=1.86ms  
     http_req_connecting............: avg=6.22µs   min=0s      med=0s      max=9.84ms   p(90)=0s       p(95)=0s       p(99.9)=1.84ms  
     http_req_duration..............: avg=71.58ms  min=2.89ms  med=70.4ms  max=489.55ms p(90)=97.44ms  p(95)=105.31ms p(99.9)=271.47ms
       { expected_response:true }...: avg=71.58ms  min=2.89ms  med=70.4ms  max=489.55ms p(90)=97.44ms  p(95)=105.31ms p(99.9)=271.47ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 41748
     http_req_receiving.............: avg=162.97µs min=30.69µs med=67.14µs max=35ms     p(90)=141.39µs p(95)=369.01µs p(99.9)=17.25ms 
     http_req_sending...............: avg=49.66µs  min=5.92µs  med=11.08µs max=81.86ms  p(90)=29.38µs  p(95)=120.19µs p(99.9)=3.2ms   
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=71.36ms  min=2.81ms  med=70.19ms max=478.57ms p(90)=97.16ms  p(95)=105.03ms p(99.9)=271.24ms
     http_reqs......................: 41748   690.917994/s
     iteration_duration.............: avg=72.05ms  min=5.93ms  med=70.72ms max=511.95ms p(90)=97.72ms  p(95)=105.62ms p(99.9)=291.71ms
     iterations.....................: 41648   689.263021/s
     success_rate...................: 100.00% ✓ 41648      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 69207      ✗ 0    
     data_received..................: 2.0 GB  34 MB/s
     data_sent......................: 27 MB   444 kB/s
     http_req_blocked...............: avg=12.55µs  min=1.58µs  med=2.93µs   max=8.02ms   p(90)=4.34µs   p(95)=5.07µs   p(99.9)=4.5ms   
     http_req_connecting............: avg=8.94µs   min=0s      med=0s       max=7.99ms   p(90)=0s       p(95)=0s       p(99.9)=4.47ms  
     http_req_duration..............: avg=129.23ms min=5.95ms  med=128.58ms max=571.23ms p(90)=158.65ms p(95)=168.08ms p(99.9)=391.95ms
       { expected_response:true }...: avg=129.23ms min=5.95ms  med=128.58ms max=571.23ms p(90)=158.65ms p(95)=168.08ms p(99.9)=391.95ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23169
     http_req_receiving.............: avg=91.22µs  min=33.37µs med=53.42µs  max=288.19ms p(90)=102.54µs p(95)=131.4µs  p(99.9)=1.71ms  
     http_req_sending...............: avg=76.71µs  min=7.23µs  med=11.62µs  max=360.59ms p(90)=20.03µs  p(95)=36.97µs  p(99.9)=2.42ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=129.06ms min=5.9ms   med=128.45ms max=555.5ms  p(90)=158.47ms p(95)=167.93ms p(99.9)=384.75ms
     http_reqs......................: 23169   381.448202/s
     iteration_duration.............: avg=130.11ms min=33.92ms med=128.98ms max=603.85ms p(90)=159.09ms p(95)=168.47ms p(99.9)=418.91ms
     iterations.....................: 23069   379.801829/s
     success_rate...................: 100.00% ✓ 23069      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 55725      ✗ 0    
     data_received..................: 1.6 GB  27 MB/s
     data_sent......................: 22 MB   355 kB/s
     http_req_blocked...............: avg=16.33µs  min=1.02µs  med=2.92µs   max=9.22ms   p(90)=5µs      p(95)=6.24µs   p(99.9)=5.86ms  
     http_req_connecting............: avg=12.49µs  min=0s      med=0s       max=9.18ms   p(90)=0s       p(95)=0s       p(99.9)=5.82ms  
     http_req_duration..............: avg=160.56ms min=6.86ms  med=150.72ms max=613.62ms p(90)=180.15ms p(95)=277.41ms p(99.9)=459.89ms
       { expected_response:true }...: avg=160.56ms min=6.86ms  med=150.72ms max=613.62ms p(90)=180.15ms p(95)=277.41ms p(99.9)=459.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18675
     http_req_receiving.............: avg=111.62µs min=24.54µs med=50.99µs  max=237.01ms p(90)=99.82µs  p(95)=164.76µs p(99.9)=4.55ms  
     http_req_sending...............: avg=106.19µs min=4.58µs  med=11.01µs  max=253.34ms p(90)=22.77µs  p(95)=119.18µs p(99.9)=5.11ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=160.34ms min=6.8ms   med=150.55ms max=591.39ms p(90)=179.96ms p(95)=275.48ms p(99.9)=459.81ms
     http_reqs......................: 18675   305.422212/s
     iteration_duration.............: avg=161.7ms  min=50.81ms med=151.07ms max=636.11ms p(90)=180.5ms  p(95)=279.05ms p(99.9)=463.11ms
     iterations.....................: 18575   303.786752/s
     success_rate...................: 100.00% ✓ 18575      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52551      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 21 MB   336 kB/s
     http_req_blocked...............: avg=20.47µs  min=1.26µs  med=2.75µs   max=11.64ms  p(90)=4.64µs   p(95)=5.78µs   p(99.9)=7.63ms  
     http_req_connecting............: avg=16.73µs  min=0s      med=0s       max=11.58ms  p(90)=0s       p(95)=0s       p(99.9)=7.61ms  
     http_req_duration..............: avg=170.17ms min=7.1ms   med=157.09ms max=1.04s    p(90)=198.08ms p(95)=243.77ms p(99.9)=896.44ms
       { expected_response:true }...: avg=170.17ms min=7.1ms   med=157.09ms max=1.04s    p(90)=198.08ms p(95)=243.77ms p(99.9)=896.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17617
     http_req_receiving.............: avg=98.96µs  min=26.54µs med=46.95µs  max=55.85ms  p(90)=107.37µs p(95)=195.15µs p(99.9)=4.6ms   
     http_req_sending...............: avg=111.23µs min=5.66µs  med=11.35µs  max=248.61ms p(90)=32.66µs  p(95)=131.81µs p(99.9)=6.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=169.96ms min=7.05ms  med=156.95ms max=1.04s    p(90)=197.92ms p(95)=242.54ms p(99.9)=896.38ms
     http_reqs......................: 17617   288.721417/s
     iteration_duration.............: avg=171.45ms min=55.55ms med=157.62ms max=1.04s    p(90)=198.73ms p(95)=245.48ms p(99.9)=896.7ms 
     iterations.....................: 17517   287.082537/s
     success_rate...................: 100.00% ✓ 17517      ✗ 0    
     vus............................: 21      min=21       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21405      ✗ 0   
     data_received..................: 636 MB  10 MB/s
     data_sent......................: 8.4 MB  138 kB/s
     http_req_blocked...............: avg=44.19µs  min=1.39µs   med=3.04µs   max=11.9ms   p(90)=4.93µs   p(95)=5.61µs   p(99.9)=10.26ms 
     http_req_connecting............: avg=40.53µs  min=0s       med=0s       max=11.86ms  p(90)=0s       p(95)=0s       p(99.9)=10.23ms 
     http_req_duration..............: avg=415.53ms min=7.85ms   med=415.11ms max=820.26ms p(90)=471.19ms p(95)=489.43ms p(99.9)=745.41ms
       { expected_response:true }...: avg=415.53ms min=7.85ms   med=415.11ms max=820.26ms p(90)=471.19ms p(95)=489.43ms p(99.9)=745.41ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7235
     http_req_receiving.............: avg=67.87µs  min=31.55µs  med=55.27µs  max=1.29ms   p(90)=102.57µs p(95)=119.25µs p(99.9)=473.69µs
     http_req_sending...............: avg=71.34µs  min=6.65µs   med=12.64µs  max=212.67ms p(90)=20.9µs   p(95)=27.09µs  p(99.9)=4.5ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=415.39ms min=7.78ms   med=415.01ms max=819.31ms p(90)=471.05ms p(95)=489.17ms p(99.9)=744.49ms
     http_reqs......................: 7235    118.232777/s
     iteration_duration.............: avg=421.63ms min=214.13ms med=415.84ms max=849.34ms p(90)=471.79ms p(95)=490.33ms p(99.9)=776.41ms
     iterations.....................: 7135    116.598599/s
     success_rate...................: 100.00% ✓ 7135       ✗ 0   
     vus............................: 40      min=40       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit c1022e1 into main Nov 4, 2025
34 checks passed
@ardatan ardatan deleted the renovate/graphql-hive-gateway-monorepo branch November 4, 2025 00:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant