Skip to content

Conversation

@renovate
Copy link
Contributor

@renovate renovate bot commented Nov 1, 2025

This PR contains the following updates:

Package Change Age Confidence
capture-website-cli 5.1.0 -> 5.2.0 age confidence

Release Notes

sindresorhus/capture-website-cli (capture-website-cli)

v5.2.0

Compare Source

  • Add new flags 20a3930
    --preload-lazy-content   Scroll through entire page to trigger lazy-loaded content before capture
    --referrer               Custom referrer header for navigation
    --throw-on-http-error    Throw error on non-2xx HTTP status codes
    --log-console            Redirect page console output to terminal
    --pdf-format             Paper format: letter|legal|tabloid|ledger|a0|a1|a2|a3|a4|a5|a6  [default: letter]
    --pdf-landscape          Use landscape orientation for PDF
    --pdf-margin             Page margins. Accepts a number/string or four comma-separated values for top, right, bottom, and left.
    --pdf-background         Include background graphics in PDF
    


Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate renovate bot added the dependencies Pull requests that update a dependency file label Nov 1, 2025
@github-actions
Copy link

github-actions bot commented Nov 1, 2025

💻 Website Preview

The latest changes are available as preview in: https://13be6ab8.federation-gateway-benchmark.pages.dev

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1826 110084 total, 0 failed avg: 27ms, p95: 48ms
grafbase 1583 95590 total, 0 failed avg: 31ms, p95: 55ms
cosmo 668 40385 total, 0 failed avg: 74ms, p95: 109ms
apollo-router 387 23507 total, 0 failed avg: 127ms, p95: 166ms
hive-gateway 295 18058 total, 0 failed avg: 166ms, p95: 302ms
hive-gateway-bun 285 17454 total, 0 failed avg: 172ms, p95: 334ms
apollo-gateway 120 7379 total, 0 failed avg: 407ms, p95: 480ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 329952      ✗ 0     
     data_received..................: 9.7 GB  160 MB/s
     data_sent......................: 128 MB  2.1 MB/s
     http_req_blocked...............: avg=4.84µs   min=1.11µs  med=2.44µs  max=8.57ms   p(90)=3.53µs   p(95)=4.12µs   p(99.9)=82.94µs
     http_req_connecting............: avg=1.96µs   min=0s      med=0s      max=8.54ms   p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_duration..............: avg=27.01ms  min=1.81ms  med=24.54ms max=431.73ms p(90)=41.77ms  p(95)=48.08ms  p(99.9)=81.77ms
       { expected_response:true }...: avg=27.01ms  min=1.81ms  med=24.54ms max=431.73ms p(90)=41.77ms  p(95)=48.08ms  p(99.9)=81.77ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 110084
     http_req_receiving.............: avg=123.98µs min=22.86µs med=41.54µs max=37.36ms  p(90)=104.58µs p(95)=332.06µs p(99.9)=15.1ms 
     http_req_sending...............: avg=99.95µs  min=5.03µs  med=9.87µs  max=413.5ms  p(90)=29.04µs  p(95)=121.12µs p(99.9)=13.93ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=26.78ms  min=1.77ms  med=24.37ms max=426.6ms  p(90)=41.38ms  p(95)=47.59ms  p(99.9)=79.79ms
     http_reqs......................: 110084  1826.764469/s
     iteration_duration.............: avg=27.26ms  min=4ms     med=24.79ms max=451.61ms p(90)=42.02ms  p(95)=48.33ms  p(99.9)=82.34ms
     iterations.....................: 109984  1825.105041/s
     success_rate...................: 100.00% ✓ 109984      ✗ 0     
     vus............................: 50      min=50        max=50  
     vus_max........................: 50      min=50        max=50  

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 286470      ✗ 0    
     data_received..................: 8.4 GB  139 MB/s
     data_sent......................: 111 MB  1.8 MB/s
     http_req_blocked...............: avg=6.57µs   min=1.22µs  med=3.05µs  max=11.18ms  p(90)=4.23µs   p(95)=4.97µs   p(99.9)=116.55µs
     http_req_connecting............: avg=2.85µs   min=0s      med=0s      max=11.15ms  p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_duration..............: avg=31.09ms  min=2.76ms  med=27.8ms  max=490.25ms p(90)=48.13ms  p(95)=54.93ms  p(99.9)=93.02ms 
       { expected_response:true }...: avg=31.09ms  min=2.76ms  med=27.8ms  max=490.25ms p(90)=48.13ms  p(95)=54.93ms  p(99.9)=93.02ms 
     http_req_failed................: 0.00%   ✓ 0           ✗ 95590
     http_req_receiving.............: avg=156.85µs min=24.59µs med=48µs    max=437.08ms p(90)=137.95µs p(95)=397.33µs p(99.9)=17.49ms 
     http_req_sending...............: avg=132.11µs min=5.47µs  med=11.73µs max=432.4ms  p(90)=37.35µs  p(95)=139.22µs p(99.9)=18.11ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=30.8ms   min=2.71ms  med=27.59ms max=480.02ms p(90)=47.54ms  p(95)=54.4ms   p(99.9)=88.75ms 
     http_reqs......................: 95590   1583.162314/s
     iteration_duration.............: avg=31.4ms   min=5.38ms  med=28.08ms max=518.23ms p(90)=48.42ms  p(95)=55.23ms  p(99.9)=93.45ms 
     iterations.....................: 95490   1581.506113/s
     success_rate...................: 100.00% ✓ 95490       ✗ 0    
     vus............................: 50      min=50        max=50 
     vus_max........................: 50      min=50        max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 120855     ✗ 0    
     data_received..................: 3.5 GB  59 MB/s
     data_sent......................: 47 MB   777 kB/s
     http_req_blocked...............: avg=11.13µs min=1.27µs  med=2.86µs  max=11.48ms  p(90)=4.05µs   p(95)=4.83µs   p(99.9)=2.61ms  
     http_req_connecting............: avg=7.36µs  min=0s      med=0s      max=11.44ms  p(90)=0s       p(95)=0s       p(99.9)=2.38ms  
     http_req_duration..............: avg=73.98ms min=2.85ms  med=72.85ms max=511.26ms p(90)=100.39ms p(95)=108.84ms p(99.9)=300.17ms
       { expected_response:true }...: avg=73.98ms min=2.85ms  med=72.85ms max=511.26ms p(90)=100.39ms p(95)=108.84ms p(99.9)=300.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 40385
     http_req_receiving.............: avg=160.8µs min=31.46µs med=74.43µs max=46.43ms  p(90)=153.25µs p(95)=387.26µs p(99.9)=14.65ms 
     http_req_sending...............: avg=66.06µs min=5.88µs  med=11.4µs  max=285.32ms p(90)=30.64µs  p(95)=125.74µs p(99.9)=3.85ms  
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=73.76ms min=2.79ms  med=72.65ms max=509.91ms p(90)=100.19ms p(95)=108.43ms p(99.9)=291.58ms
     http_reqs......................: 40385   668.419688/s
     iteration_duration.............: avg=74.47ms min=7.15ms  med=73.18ms max=553.11ms p(90)=100.71ms p(95)=109.18ms p(99.9)=314.44ms
     iterations.....................: 40285   666.76457/s
     success_rate...................: 100.00% ✓ 40285      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 70221      ✗ 0    
     data_received..................: 2.1 GB  34 MB/s
     data_sent......................: 27 MB   450 kB/s
     http_req_blocked...............: avg=13.4µs   min=1.63µs  med=2.94µs   max=9.19ms   p(90)=4.16µs   p(95)=4.93µs   p(99.9)=4.86ms  
     http_req_connecting............: avg=9.85µs   min=0s      med=0s       max=9.16ms   p(90)=0s       p(95)=0s       p(99.9)=4.84ms  
     http_req_duration..............: avg=127.44ms min=5.88ms  med=126.82ms max=588.4ms  p(90)=156.73ms p(95)=165.5ms  p(99.9)=406.44ms
       { expected_response:true }...: avg=127.44ms min=5.88ms  med=126.82ms max=588.4ms  p(90)=156.73ms p(95)=165.5ms  p(99.9)=406.44ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 23507
     http_req_receiving.............: avg=89.84µs  min=33.67µs med=52.52µs  max=289.26ms p(90)=99.11µs  p(95)=126.86µs p(99.9)=1.4ms   
     http_req_sending...............: avg=92.35µs  min=6.76µs  med=11.66µs  max=404.61ms p(90)=19.33µs  p(95)=40.68µs  p(99.9)=2.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=127.26ms min=5.83ms  med=126.71ms max=576.41ms p(90)=156.59ms p(95)=165.37ms p(99.9)=397.97ms
     http_reqs......................: 23507   387.047553/s
     iteration_duration.............: avg=128.27ms min=26.36ms med=127.18ms max=615.93ms p(90)=157.03ms p(95)=165.81ms p(99.9)=413.85ms
     iterations.....................: 23407   385.401033/s
     success_rate...................: 100.00% ✓ 23407      ✗ 0    
     vus............................: 50      min=50       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 53874      ✗ 0    
     data_received..................: 1.6 GB  26 MB/s
     data_sent......................: 21 MB   344 kB/s
     http_req_blocked...............: avg=20.6µs   min=1.21µs  med=2.76µs   max=11.66ms  p(90)=4.59µs   p(95)=5.74µs   p(99.9)=7.51ms  
     http_req_connecting............: avg=16.76µs  min=0s      med=0s       max=11.62ms  p(90)=0s       p(95)=0s       p(99.9)=7.45ms  
     http_req_duration..............: avg=166.05ms min=6.66ms  med=154.76ms max=663.71ms p(90)=188.09ms p(95)=301.67ms p(99.9)=523.36ms
       { expected_response:true }...: avg=166.05ms min=6.66ms  med=154.76ms max=663.71ms p(90)=188.09ms p(95)=301.67ms p(99.9)=523.36ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 18058
     http_req_receiving.............: avg=114.42µs min=26.84µs med=49.15µs  max=276.77ms p(90)=112.86µs p(95)=216.52µs p(99.9)=4.26ms  
     http_req_sending...............: avg=137.19µs min=5.59µs  med=11.38µs  max=426.04ms p(90)=32.15µs  p(95)=126.77µs p(99.9)=4.99ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=165.8ms  min=6.59ms  med=154.61ms max=662.33ms p(90)=187.75ms p(95)=300.22ms p(99.9)=516.57ms
     http_reqs......................: 18058   295.795026/s
     iteration_duration.............: avg=167.34ms min=33.47ms med=155.2ms  max=705.05ms p(90)=188.59ms p(95)=303.23ms p(99.9)=528.32ms
     iterations.....................: 17958   294.156998/s
     success_rate...................: 100.00% ✓ 17958      ✗ 0    
     vus............................: 21      min=21       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 52062      ✗ 0    
     data_received..................: 1.5 GB  25 MB/s
     data_sent......................: 20 MB   332 kB/s
     http_req_blocked...............: avg=20.41µs  min=1.16µs  med=2.83µs   max=11.23ms  p(90)=4.73µs   p(95)=6.04µs   p(99.9)=7.26ms  
     http_req_connecting............: avg=16.55µs  min=0s      med=0s       max=11.2ms   p(90)=0s       p(95)=0s       p(99.9)=7.23ms  
     http_req_duration..............: avg=171.74ms min=7ms     med=159.48ms max=664.19ms p(90)=191.7ms  p(95)=333.7ms  p(99.9)=533.63ms
       { expected_response:true }...: avg=171.74ms min=7ms     med=159.48ms max=664.19ms p(90)=191.7ms  p(95)=333.7ms  p(99.9)=533.63ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 17454
     http_req_receiving.............: avg=119.6µs  min=27µs    med=52.78µs  max=384.13ms p(90)=116.1µs  p(95)=183.51µs p(99.9)=4.09ms  
     http_req_sending...............: avg=134.36µs min=5.55µs  med=11.47µs  max=441.39ms p(90)=32.3µs   p(95)=123.06µs p(99.9)=6.39ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=171.49ms min=6.83ms  med=159.37ms max=663.96ms p(90)=191.49ms p(95)=332.42ms p(99.9)=531.42ms
     http_reqs......................: 17454   285.408372/s
     iteration_duration.............: avg=173.12ms min=50.08ms med=159.92ms max=732.6ms  p(90)=192.17ms p(95)=336.73ms p(99.9)=543.76ms
     iterations.....................: 17354   283.773168/s
     success_rate...................: 100.00% ✓ 17354      ✗ 0    
     vus............................: 13      min=13       max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 21837      ✗ 0   
     data_received..................: 648 MB  11 MB/s
     data_sent......................: 8.6 MB  140 kB/s
     http_req_blocked...............: avg=37.53µs  min=1.41µs  med=2.74µs   max=10.05ms  p(90)=4.42µs   p(95)=5.18µs   p(99.9)=8.65ms  
     http_req_connecting............: avg=34.35µs  min=0s      med=0s       max=10.01ms  p(90)=0s       p(95)=0s       p(99.9)=8.63ms  
     http_req_duration..............: avg=406.87ms min=7.45ms  med=406.06ms max=907.86ms p(90)=461.58ms p(95)=480.38ms p(99.9)=831.87ms
       { expected_response:true }...: avg=406.87ms min=7.45ms  med=406.06ms max=907.86ms p(90)=461.58ms p(95)=480.38ms p(99.9)=831.87ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 7379
     http_req_receiving.............: avg=60.75µs  min=30.08µs med=49.66µs  max=9.02ms   p(90)=90.38µs  p(95)=104.62µs p(99.9)=483.85µs
     http_req_sending...............: avg=161.32µs min=6.21µs  med=11.47µs  max=344.2ms  p(90)=18.54µs  p(95)=22.41µs  p(99.9)=7.01ms  
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=406.65ms min=7.4ms   med=405.95ms max=906.58ms p(90)=461.31ms p(95)=480.23ms p(99.9)=830.61ms
     http_reqs......................: 7379    120.725908/s
     iteration_duration.............: avg=413.17ms min=42.16ms med=406.67ms max=967.49ms p(90)=462.26ms p(95)=481.03ms p(99.9)=930.69ms
     iterations.....................: 7279    119.089834/s
     success_rate...................: 100.00% ✓ 7279       ✗ 0   
     vus............................: 27      min=27       max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 500 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
hive-router 1857 115451 total, 0 failed avg: 121ms, p95: 290ms
grafbase 1645 103823 total, 0 failed avg: 134ms, p95: 314ms
cosmo 700 44765 total, 0 failed avg: 314ms, p95: 697ms
apollo-router 367 24781 total, 0 failed avg: 569ms, p95: 1291ms ❌ 14 unexpected GraphQL errors
hive-gateway-bun 267 18291 total, 0 failed avg: 767ms, p95: 1691ms
hive-gateway 243 17141 total, 0 failed avg: 816ms, p95: 1753ms
apollo-gateway 160 11058 total, 0 failed avg: 1190ms, p95: 2635ms
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 343353      ✗ 0     
     data_received..................: 10 GB   163 MB/s
     data_sent......................: 134 MB  2.2 MB/s
     http_req_blocked...............: avg=491.18µs min=1.13µs  med=2.54µs   max=360.46ms p(90)=3.91µs   p(95)=4.54µs   p(99.9)=176.04ms
     http_req_connecting............: avg=487.21µs min=0s      med=0s       max=360.39ms p(90)=0s       p(95)=0s       p(99.9)=175.98ms
     http_req_duration..............: avg=120.55ms min=1.6ms   med=109.13ms max=440.77ms p(90)=245.78ms p(95)=290.31ms p(99.9)=374.68ms
       { expected_response:true }...: avg=120.55ms min=1.6ms   med=109.13ms max=440.77ms p(90)=245.78ms p(95)=290.31ms p(99.9)=374.68ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 115451
     http_req_receiving.............: avg=521.31µs min=22.89µs med=40.62µs  max=128.97ms p(90)=93.48µs  p(95)=384.21µs p(99.9)=73ms    
     http_req_sending...............: avg=440.52µs min=5.02µs  med=9.95µs   max=154.65ms p(90)=20.87µs  p(95)=124.2µs  p(99.9)=71.74ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=119.59ms min=1.55ms  med=108.19ms max=394.05ms p(90)=243.88ms p(95)=287.87ms p(99.9)=370.53ms
     http_reqs......................: 115451  1857.185643/s
     iteration_duration.............: avg=122.39ms min=1.77ms  med=110.63ms max=713.06ms p(90)=247.72ms p(95)=292.86ms p(99.9)=426.31ms
     iterations.....................: 114451  1841.099289/s
     success_rate...................: 100.00% ✓ 114451      ✗ 0     
     vus............................: 67      min=0         max=497 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 308469      ✗ 0     
     data_received..................: 9.1 GB  145 MB/s
     data_sent......................: 121 MB  1.9 MB/s
     http_req_blocked...............: avg=502.85µs min=992ns   med=2.83µs   max=400.48ms p(90)=4.38µs   p(95)=5.14µs   p(99.9)=177.7ms 
     http_req_connecting............: avg=498.7µs  min=0s      med=0s       max=400.43ms p(90)=0s       p(95)=0s       p(99.9)=177.63ms
     http_req_duration..............: avg=134.17ms min=2.52ms  med=121.42ms max=461.06ms p(90)=266.64ms p(95)=314.11ms p(99.9)=414.77ms
       { expected_response:true }...: avg=134.17ms min=2.52ms  med=121.42ms max=461.06ms p(90)=266.64ms p(95)=314.11ms p(99.9)=414.77ms
     http_req_failed................: 0.00%   ✓ 0           ✗ 103823
     http_req_receiving.............: avg=530.8µs  min=23.33µs med=47.57µs  max=211.98ms p(90)=128.79µs p(95)=425.71µs p(99.9)=76.27ms 
     http_req_sending...............: avg=486.46µs min=4.16µs  med=10.7µs   max=150.37ms p(90)=25.07µs  p(95)=135.66µs p(99.9)=77.92ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=133.15ms min=2.45ms  med=120.45ms max=433.45ms p(90)=264.55ms p(95)=311.22ms p(99.9)=412.08ms
     http_reqs......................: 103823  1645.16067/s
     iteration_duration.............: avg=136.31ms min=3.09ms  med=123.48ms max=781.47ms p(90)=269.04ms p(95)=317.21ms p(99.9)=458.35ms
     iterations.....................: 102823  1629.314849/s
     success_rate...................: 100.00% ✓ 102823      ✗ 0     
     vus............................: 64      min=0         max=496 
     vus_max........................: 500     min=500       max=500 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 131295     ✗ 0    
     data_received..................: 3.9 GB  62 MB/s
     data_sent......................: 52 MB   816 kB/s
     http_req_blocked...............: avg=111.5µs  min=1.21µs  med=2.79µs   max=129.79ms p(90)=4.19µs   p(95)=5.96µs   p(99.9)=35.93ms 
     http_req_connecting............: avg=107.02µs min=0s      med=0s       max=129.61ms p(90)=0s       p(95)=0s       p(99.9)=35.84ms 
     http_req_duration..............: avg=313.73ms min=2.92ms  med=297.13ms max=1.15s    p(90)=617.93ms p(95)=697.21ms p(99.9)=979.71ms
       { expected_response:true }...: avg=313.73ms min=2.92ms  med=297.13ms max=1.15s    p(90)=617.93ms p(95)=697.21ms p(99.9)=979.71ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 44765
     http_req_receiving.............: avg=629.33µs min=27.27µs med=58.02µs  max=183.35ms p(90)=161.23µs p(95)=450.19µs p(99.9)=80.76ms 
     http_req_sending...............: avg=155.13µs min=5.77µs  med=11.21µs  max=114.14ms p(90)=28.93µs  p(95)=121.87µs p(99.9)=28.61ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=312.95ms min=2.83ms  med=295.87ms max=1.15s    p(90)=617.09ms p(95)=696.62ms p(99.9)=979.63ms
     http_reqs......................: 44765   700.638246/s
     iteration_duration.............: avg=321.42ms min=3.2ms   med=305.74ms max=1.15s    p(90)=621.49ms p(95)=700.45ms p(99.9)=983.89ms
     iterations.....................: 43765   684.986772/s
     success_rate...................: 100.00% ✓ 43765      ✗ 0    
     vus............................: 55      min=0        max=499
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 23767 / ✗ 14
     ✓ valid response structure

     checks.........................: 99.98% ✓ 71329      ✗ 14   
     data_received..................: 2.2 GB 32 MB/s
     data_sent......................: 29 MB  429 kB/s
     http_req_blocked...............: avg=57.59µs  min=1.36µs  med=3.24µs   max=119.58ms p(90)=5.23µs   p(95)=6.92µs   p(99.9)=13.44ms
     http_req_connecting............: avg=51.68µs  min=0s      med=0s       max=119.51ms p(90)=0s       p(95)=0s       p(99.9)=13.11ms
     http_req_duration..............: avg=569.03ms min=6.38ms  med=525.6ms  max=2.18s    p(90)=1.16s    p(95)=1.29s    p(99.9)=1.7s   
       { expected_response:true }...: avg=569.03ms min=6.38ms  med=525.6ms  max=2.18s    p(90)=1.16s    p(95)=1.29s    p(99.9)=1.7s   
     http_req_failed................: 0.00%  ✓ 0          ✗ 24781
     http_req_receiving.............: avg=117.3µs  min=28.66µs med=59.68µs  max=108.72ms p(90)=103.43µs p(95)=157.62µs p(99.9)=5.64ms 
     http_req_sending...............: avg=79.21µs  min=6.27µs  med=11.86µs  max=112.13ms p(90)=24.74µs  p(95)=97.82µs  p(99.9)=13.1ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=568.83ms min=6.3ms   med=525.54ms max=2.18s    p(90)=1.16s    p(95)=1.29s    p(99.9)=1.7s   
     http_reqs......................: 24781  367.82726/s
     iteration_duration.............: avg=593.28ms min=6.91ms  med=554.74ms max=2.18s    p(90)=1.17s    p(95)=1.29s    p(99.9)=1.7s   
     iterations.....................: 23781  352.984144/s
     success_rate...................: 99.94% ✓ 23767      ✗ 14   
     vus............................: 80     min=0        max=499
     vus_max........................: 500    min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 51873      ✗ 0    
     data_received..................: 1.6 GB  24 MB/s
     data_sent......................: 21 MB   313 kB/s
     http_req_blocked...............: avg=96.16µs  min=1.23µs  med=2.72µs   max=100.43ms p(90)=4.6µs   p(95)=7.35µs   p(99.9)=24.4ms 
     http_req_connecting............: avg=91.14µs  min=0s      med=0s       max=100.39ms p(90)=0s      p(95)=0s       p(99.9)=24.35ms
     http_req_duration..............: avg=766.64ms min=6.21ms  med=721.04ms max=5.16s    p(90)=1.49s   p(95)=1.69s    p(99.9)=4.18s  
       { expected_response:true }...: avg=766.64ms min=6.21ms  med=721.04ms max=5.16s    p(90)=1.49s   p(95)=1.69s    p(99.9)=4.18s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 18291
     http_req_receiving.............: avg=155.44µs min=27.93µs med=43.27µs  max=55.47ms  p(90)=89.11µs p(95)=150.14µs p(99.9)=20.91ms
     http_req_sending...............: avg=169.18µs min=5.84µs  med=10.82µs  max=79.45ms  p(90)=28.18µs p(95)=108.46µs p(99.9)=29.43ms
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s      p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=766.31ms min=6.16ms  med=720.97ms max=5.16s    p(90)=1.49s   p(95)=1.69s    p(99.9)=4.17s  
     http_reqs......................: 18291   267.50974/s
     iteration_duration.............: avg=811.33ms min=7.56ms  med=781.81ms max=5.18s    p(90)=1.5s    p(95)=1.71s    p(99.9)=4.21s  
     iterations.....................: 17291   252.884528/s
     success_rate...................: 100.00% ✓ 17291      ✗ 0    
     vus............................: 84      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 48423      ✗ 0    
     data_received..................: 1.5 GB  21 MB/s
     data_sent......................: 20 MB   285 kB/s
     http_req_blocked...............: avg=142.52µs min=1.2µs   med=3.2µs    max=139.64ms p(90)=5.51µs   p(95)=8.99µs   p(99.9)=41ms   
     http_req_connecting............: avg=136.82µs min=0s      med=0s       max=139.49ms p(90)=0s       p(95)=0s       p(99.9)=40.94ms
     http_req_duration..............: avg=815.54ms min=7.57ms  med=773.61ms max=5.81s    p(90)=1.6s     p(95)=1.75s    p(99.9)=5.18s  
       { expected_response:true }...: avg=815.54ms min=7.57ms  med=773.61ms max=5.81s    p(90)=1.6s     p(95)=1.75s    p(99.9)=5.18s  
     http_req_failed................: 0.00%   ✓ 0          ✗ 17141
     http_req_receiving.............: avg=219.63µs min=29.82µs med=54.88µs  max=123.27ms p(90)=104.64µs p(95)=292.91µs p(99.9)=27.75ms
     http_req_sending...............: avg=247.11µs min=5.05µs  med=11.35µs  max=142.67ms p(90)=27.11µs  p(95)=143.54µs p(99.9)=45.5ms 
     http_req_tls_handshaking.......: avg=0s       min=0s      med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s     
     http_req_waiting...............: avg=815.07ms min=7.49ms  med=773.31ms max=5.81s    p(90)=1.6s     p(95)=1.75s    p(99.9)=5.17s  
     http_reqs......................: 17141   243.249355/s
     iteration_duration.............: avg=866.3ms  min=7.84ms  med=838.97ms max=5.94s    p(90)=1.61s    p(95)=1.75s    p(99.9)=5.2s   
     iterations.....................: 16141   229.058272/s
     success_rate...................: 100.00% ✓ 16141      ✗ 0    
     vus............................: 88      min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30174      ✗ 0    
     data_received..................: 971 MB  14 MB/s
     data_sent......................: 13 MB   192 kB/s
     http_req_blocked...............: avg=29.52µs min=1.2µs   med=3.69µs  max=28.55ms p(90)=6.14µs   p(95)=12.86µs  p(99.9)=4.09ms
     http_req_connecting............: avg=23.15µs min=0s      med=0s      max=28.48ms p(90)=0s       p(95)=0s       p(99.9)=4.03ms
     http_req_duration..............: avg=1.18s   min=7.2ms   med=1.11s   max=14.81s  p(90)=2.19s    p(95)=2.63s    p(99.9)=13.5s 
       { expected_response:true }...: avg=1.18s   min=7.2ms   med=1.11s   max=14.81s  p(90)=2.19s    p(95)=2.63s    p(99.9)=13.5s 
     http_req_failed................: 0.00%   ✓ 0          ✗ 11058
     http_req_receiving.............: avg=93.67µs min=28.75µs med=66.42µs max=21.6ms  p(90)=113.19µs p(95)=142.23µs p(99.9)=3ms   
     http_req_sending...............: avg=48.58µs min=5.03µs  med=13.73µs max=20.71ms p(90)=27.44µs  p(95)=52.14µs  p(99.9)=6.88ms
     http_req_tls_handshaking.......: avg=0s      min=0s      med=0s      max=0s      p(90)=0s       p(95)=0s       p(99.9)=0s    
     http_req_waiting...............: avg=1.18s   min=7.13ms  med=1.11s   max=14.81s  p(90)=2.19s    p(95)=2.63s    p(99.9)=13.5s 
     http_reqs......................: 11058   160.774549/s
     iteration_duration.............: avg=1.3s    min=7.35ms  med=1.26s   max=14.82s  p(90)=2.22s    p(95)=2.67s    p(99.9)=13.58s
     iterations.....................: 10058   146.235342/s
     success_rate...................: 100.00% ✓ 10058      ✗ 0    
     vus............................: 112     min=0        max=500
     vus_max........................: 500     min=500      max=500

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 173 14043 total, 0 failed avg: 215ms, p95: 226ms
hive-router 169 13691 total, 0 failed avg: 221ms, p95: 231ms
cosmo 165 13442 total, 0 failed avg: 225ms, p95: 250ms
hive-gateway 161 12365 total, 0 failed avg: 244ms, p95: 276ms
hive-gateway-bun 158 12130 total, 0 failed avg: 249ms, p95: 287ms
apollo-router 135 11083 total, 0 failed avg: 273ms, p95: 318ms ❌ 2 unexpected GraphQL errors
apollo-gateway 119 9743 total, 0 failed avg: 310ms, p95: 347ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41829      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   202 kB/s
     http_req_blocked...............: avg=18.64µs  min=1.19µs   med=1.86µs   max=8.99ms   p(90)=3.33µs   p(95)=4.74µs   p(99.9)=6.58ms  
     http_req_connecting............: avg=16.1µs   min=0s       med=0s       max=8.96ms   p(90)=0s       p(95)=0s       p(99.9)=6.55ms  
     http_req_duration..............: avg=215.03ms min=115.87ms med=214.14ms max=615.01ms p(90)=223.69ms p(95)=226.48ms p(99.9)=513.84ms
       { expected_response:true }...: avg=215.03ms min=115.87ms med=214.14ms max=615.01ms p(90)=223.69ms p(95)=226.48ms p(99.9)=513.84ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 14043
     http_req_receiving.............: avg=85.64µs  min=25.49µs  med=46.36µs  max=20.38ms  p(90)=94.07µs  p(95)=258.02µs p(99.9)=5.14ms  
     http_req_sending...............: avg=108.21µs min=5.51µs   med=8.34µs   max=391.31ms p(90)=26.48µs  p(95)=97.48µs  p(99.9)=8.27ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=214.84ms min=111.1ms  med=214.01ms max=613.65ms p(90)=223.54ms p(95)=226.27ms p(99.9)=501.8ms 
     http_reqs......................: 14043   173.596896/s
     iteration_duration.............: avg=215.31ms min=116.03ms med=214.4ms  max=635.6ms  p(90)=223.91ms p(95)=226.68ms p(99.9)=525.68ms
     iterations.....................: 13943   172.360715/s
     success_rate...................: 100.00% ✓ 13943      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40773      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   197 kB/s
     http_req_blocked...............: avg=19.84µs  min=1.21µs   med=2.06µs   max=9.11ms   p(90)=3.42µs   p(95)=4.62µs   p(99.9)=6.9ms   
     http_req_connecting............: avg=17.23µs  min=0s       med=0s       max=9.08ms   p(90)=0s       p(95)=0s       p(99.9)=6.88ms  
     http_req_duration..............: avg=220.91ms min=119.29ms med=219.85ms max=613.49ms p(90)=228.51ms p(95)=231.18ms p(99.9)=517.14ms
       { expected_response:true }...: avg=220.91ms min=119.29ms med=219.85ms max=613.49ms p(90)=228.51ms p(95)=231.18ms p(99.9)=517.14ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13691
     http_req_receiving.............: avg=96.72µs  min=24.85µs  med=42.48µs  max=304.69ms p(90)=88.12µs  p(95)=240.43µs p(99.9)=2.96ms  
     http_req_sending...............: avg=117.48µs min=5.49µs   med=8.29µs   max=347.73ms p(90)=28.23µs  p(95)=97.75µs  p(99.9)=7.06ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=220.69ms min=119.22ms med=219.76ms max=600.88ms p(90)=228.33ms p(95)=231.01ms p(99.9)=485.75ms
     http_reqs......................: 13691   169.108657/s
     iteration_duration.............: avg=221.25ms min=119.59ms med=220.1ms  max=634.75ms p(90)=228.71ms p(95)=231.38ms p(99.9)=536.57ms
     iterations.....................: 13591   167.873475/s
     success_rate...................: 100.00% ✓ 13591      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40026      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   193 kB/s
     http_req_blocked...............: avg=21.05µs  min=1.33µs   med=2.6µs    max=9.4ms    p(90)=3.81µs   p(95)=4.92µs   p(99.9)=7.04ms  
     http_req_connecting............: avg=17.51µs  min=0s       med=0s       max=9.36ms   p(90)=0s       p(95)=0s       p(99.9)=7.02ms  
     http_req_duration..............: avg=224.59ms min=144.95ms med=223.32ms max=626.15ms p(90)=243.34ms p(95)=249.74ms p(99.9)=515.66ms
       { expected_response:true }...: avg=224.59ms min=144.95ms med=223.32ms max=626.15ms p(90)=243.34ms p(95)=249.74ms p(99.9)=515.66ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13442
     http_req_receiving.............: avg=535.39µs min=29.19µs  med=60.16µs  max=190.52ms p(90)=361.15µs p(95)=821.8µs  p(99.9)=29.8ms  
     http_req_sending...............: avg=81.01µs  min=5.97µs   med=10.93µs  max=212.08ms p(90)=32.73µs  p(95)=124.85µs p(99.9)=4.46ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=223.98ms min=141.39ms med=222.77ms max=625.17ms p(90)=242.7ms  p(95)=248.87ms p(99.9)=514.67ms
     http_reqs......................: 13442   165.966671/s
     iteration_duration.............: avg=225.07ms min=145.18ms med=223.7ms  max=655.11ms p(90)=243.68ms p(95)=250.02ms p(99.9)=553.19ms
     iterations.....................: 13342   164.731984/s
     success_rate...................: 100.00% ✓ 13342      ✗ 0    
     vus............................: 24      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36795      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   188 kB/s
     http_req_blocked...............: avg=29.02µs  min=1.15µs   med=2.71µs   max=11.89ms  p(90)=4.41µs   p(95)=5.84µs   p(99.9)=9.08ms  
     http_req_connecting............: avg=25.16µs  min=0s       med=0s       max=11.84ms  p(90)=0s       p(95)=0s       p(99.9)=9.03ms  
     http_req_duration..............: avg=243.96ms min=160.9ms  med=235.52ms max=764.77ms p(90)=258.51ms p(95)=275.52ms p(99.9)=630.64ms
       { expected_response:true }...: avg=243.96ms min=160.9ms  med=235.52ms max=764.77ms p(90)=258.51ms p(95)=275.52ms p(99.9)=630.64ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12365
     http_req_receiving.............: avg=101.36µs min=25.71µs  med=45.98µs  max=141.26ms p(90)=104.92µs p(95)=245.01µs p(99.9)=4.1ms   
     http_req_sending...............: avg=128.44µs min=5.39µs   med=10.79µs  max=306.6ms  p(90)=32.51µs  p(95)=131.82µs p(99.9)=5.48ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=243.73ms min=160.81ms med=235.4ms  max=752.34ms p(90)=258.35ms p(95)=275.31ms p(99.9)=622.69ms
     http_reqs......................: 12365   161.603801/s
     iteration_duration.............: avg=245.07ms min=183.16ms med=235.93ms max=807.73ms p(90)=259.02ms p(95)=275.87ms p(99.9)=731.41ms
     iterations.....................: 12265   160.296856/s
     success_rate...................: 100.00% ✓ 12265      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 36090      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 14 MB   184 kB/s
     http_req_blocked...............: avg=22.93µs  min=1.15µs   med=2.54µs   max=10.12ms  p(90)=4.14µs   p(95)=5.49µs   p(99.9)=7.24ms  
     http_req_connecting............: avg=19.63µs  min=0s       med=0s       max=10.08ms  p(90)=0s       p(95)=0s       p(99.9)=7.21ms  
     http_req_duration..............: avg=248.7ms  min=138.66ms med=243.44ms max=818.2ms  p(90)=270.23ms p(95)=287.02ms p(99.9)=694.59ms
       { expected_response:true }...: avg=248.7ms  min=138.66ms med=243.44ms max=818.2ms  p(90)=270.23ms p(95)=287.02ms p(99.9)=694.59ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12130
     http_req_receiving.............: avg=110.09µs min=25.92µs  med=45.95µs  max=239.77ms p(90)=109.52µs p(95)=252.65µs p(99.9)=4.07ms  
     http_req_sending...............: avg=101.79µs min=5.46µs   med=10.84µs  max=217.07ms p(90)=33.06µs  p(95)=127.63µs p(99.9)=4.73ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=248.49ms min=138.6ms  med=243.29ms max=817.04ms p(90)=270.02ms p(95)=286.39ms p(99.9)=693.42ms
     http_reqs......................: 12130   158.464892/s
     iteration_duration.............: avg=249.93ms min=138.93ms med=243.9ms  max=836.63ms p(90)=270.61ms p(95)=287.66ms p(99.9)=784.09ms
     iterations.....................: 12030   157.158504/s
     success_rate...................: 100.00% ✓ 12030      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✗ no graphql errors
      ↳  99% — ✓ 10981 / ✗ 2
     ✓ valid response structure

     checks.........................: 99.99% ✓ 32947      ✗ 2    
     data_received..................: 972 MB 12 MB/s
     data_sent......................: 13 MB  158 kB/s
     http_req_blocked...............: avg=23.34µs  min=1.46µs   med=2.87µs   max=7.99ms   p(90)=4.53µs   p(95)=5.81µs   p(99.9)=6.33ms  
     http_req_connecting............: avg=18.72µs  min=0s       med=0s       max=7.96ms   p(90)=0s       p(95)=0s       p(99.9)=6.31ms  
     http_req_duration..............: avg=273.01ms min=144.23ms med=273.45ms max=678.86ms p(90)=308.94ms p(95)=318.11ms p(99.9)=588.4ms 
       { expected_response:true }...: avg=273.01ms min=144.23ms med=273.45ms max=678.86ms p(90)=308.94ms p(95)=318.11ms p(99.9)=588.4ms 
     http_req_failed................: 0.00%  ✓ 0          ✗ 11083
     http_req_receiving.............: avg=150.76µs min=29.5µs   med=57.32µs  max=251.62ms p(90)=156.69µs p(95)=450.2µs  p(99.9)=5.45ms  
     http_req_sending...............: avg=93.47µs  min=6.54µs   med=11.62µs  max=251.19ms p(90)=44.05µs  p(95)=141.4µs  p(99.9)=5.05ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=272.77ms min=144.12ms med=273.3ms  max=670.46ms p(90)=308.75ms p(95)=317.77ms p(99.9)=563.53ms
     http_reqs......................: 11083  135.884625/s
     iteration_duration.............: avg=273.98ms min=144.51ms med=274.18ms max=685.64ms p(90)=309.41ms p(95)=318.52ms p(99.9)=618.15ms
     iterations.....................: 10983  134.658562/s
     success_rate...................: 99.98% ✓ 10981      ✗ 2    
     vus............................: 50     min=0        max=50 
     vus_max........................: 50     min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 28929      ✗ 0   
     data_received..................: 856 MB  11 MB/s
     data_sent......................: 11 MB   139 kB/s
     http_req_blocked...............: avg=35.48µs  min=1.48µs   med=4.07µs   max=11.47ms  p(90)=6.06µs   p(95)=7.04µs   p(99.9)=9.69ms  
     http_req_connecting............: avg=29.16µs  min=0s       med=0s       max=11.44ms  p(90)=0s       p(95)=0s       p(99.9)=9.41ms  
     http_req_duration..............: avg=310.46ms min=212.23ms med=307.89ms max=839.27ms p(90)=336.03ms p(95)=346.61ms p(99.9)=726.17ms
       { expected_response:true }...: avg=310.46ms min=212.23ms med=307.89ms max=839.27ms p(90)=336.03ms p(95)=346.61ms p(99.9)=726.17ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 9743
     http_req_receiving.............: avg=106.57µs min=33.04µs  med=76.46µs  max=95.57ms  p(90)=127.05µs p(95)=163.2µs  p(99.9)=2.56ms  
     http_req_sending...............: avg=63.92µs  min=6.46µs   med=15.07µs  max=194.41ms p(90)=28.9µs   p(95)=44.75µs  p(99.9)=4.18ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=310.29ms min=212.14ms med=307.77ms max=838.28ms p(90)=335.82ms p(95)=346.43ms p(99.9)=719.03ms
     http_reqs......................: 9743    119.269656/s
     iteration_duration.............: avg=311.99ms min=220.89ms med=308.58ms max=878ms    p(90)=336.58ms p(95)=347.3ms  p(99.9)=758.84ms
     iterations.....................: 9643    118.045498/s
     success_rate...................: 100.00% ✓ 9643       ✗ 0   
     vus............................: 50      min=0        max=50
     vus_max........................: 50      min=50       max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@github-actions
Copy link

github-actions bot commented Nov 1, 2025

Overview for: constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 50 VUs over 60s

Comparison

Comparison

Gateway RPS ⬇️ Requests Duration Notes
grafbase 172 13939 total, 0 failed avg: 217ms, p95: 229ms
hive-router 167 13542 total, 0 failed avg: 223ms, p95: 235ms
cosmo 158 12796 total, 0 failed avg: 236ms, p95: 261ms
hive-gateway 149 11467 total, 0 failed avg: 263ms, p95: 293ms
hive-gateway-bun 148 11427 total, 0 failed avg: 264ms, p95: 298ms
apollo-router 127 10371 total, 0 failed avg: 291ms, p95: 337ms
apollo-gateway 83 6868 total, 0 failed avg: 440ms, p95: 488ms
Summary for: `grafbase`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 41517      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   200 kB/s
     http_req_blocked...............: avg=19.88µs  min=1.31µs   med=2.05µs   max=9.41ms   p(90)=3.68µs   p(95)=5.11µs   p(99.9)=6.9ms   
     http_req_connecting............: avg=17.11µs  min=0s       med=0s       max=9.38ms   p(90)=0s       p(95)=0s       p(99.9)=6.88ms  
     http_req_duration..............: avg=216.58ms min=164.54ms med=215.53ms max=629.77ms p(90)=225.85ms p(95)=229.13ms p(99.9)=530.37ms
       { expected_response:true }...: avg=216.58ms min=164.54ms med=215.53ms max=629.77ms p(90)=225.85ms p(95)=229.13ms p(99.9)=530.37ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13939
     http_req_receiving.............: avg=88.64µs  min=26.11µs  med=47.43µs  max=22.76ms  p(90)=99.32µs  p(95)=249.56µs p(99.9)=6.13ms  
     http_req_sending...............: avg=153.26µs min=5.64µs   med=8.53µs   max=390.2ms  p(90)=31.61µs  p(95)=102.13µs p(99.9)=9.3ms   
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=216.34ms min=164.47ms med=215.42ms max=629.09ms p(90)=225.65ms p(95)=228.88ms p(99.9)=511.9ms 
     http_reqs......................: 13939   172.275178/s
     iteration_duration.............: avg=216.91ms min=164.71ms med=215.8ms  max=649.47ms p(90)=226.07ms p(95)=229.34ms p(99.9)=548.83ms
     iterations.....................: 13839   171.039256/s
     success_rate...................: 100.00% ✓ 13839      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 40326      ✗ 0    
     data_received..................: 1.2 GB  15 MB/s
     data_sent......................: 16 MB   195 kB/s
     http_req_blocked...............: avg=20.51µs  min=1.17µs   med=2.18µs   max=9.6ms    p(90)=3.24µs   p(95)=4.4µs    p(99.9)=7.06ms  
     http_req_connecting............: avg=17.67µs  min=0s       med=0s       max=9.56ms   p(90)=0s       p(95)=0s       p(99.9)=7.04ms  
     http_req_duration..............: avg=222.84ms min=118.19ms med=221.5ms  max=622.36ms p(90)=232.02ms p(95)=235.08ms p(99.9)=531.89ms
       { expected_response:true }...: avg=222.84ms min=118.19ms med=221.5ms  max=622.36ms p(90)=232.02ms p(95)=235.08ms p(99.9)=531.89ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 13542
     http_req_receiving.............: avg=73.61µs  min=23.82µs  med=43.58µs  max=8.61ms   p(90)=89.5µs   p(95)=238.94µs p(99.9)=2ms     
     http_req_sending...............: avg=155.68µs min=5.55µs   med=9.04µs   max=384.8ms  p(90)=28.14µs  p(95)=96.31µs  p(99.9)=4.76ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=222.61ms min=114.35ms med=221.39ms max=621.62ms p(90)=231.87ms p(95)=234.89ms p(99.9)=511.54ms
     http_reqs......................: 13542   167.514352/s
     iteration_duration.............: avg=223.19ms min=118.42ms med=221.78ms max=628.6ms  p(90)=232.22ms p(95)=235.26ms p(99.9)=539.13ms
     iterations.....................: 13442   166.277353/s
     success_rate...................: 100.00% ✓ 13442      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `cosmo`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 38088      ✗ 0    
     data_received..................: 1.1 GB  14 MB/s
     data_sent......................: 15 MB   184 kB/s
     http_req_blocked...............: avg=22.02µs  min=1.45µs   med=2.6µs    max=9.49ms   p(90)=3.67µs   p(95)=4.61µs   p(99.9)=7.17ms  
     http_req_connecting............: avg=18.84µs  min=0s       med=0s       max=9.46ms   p(90)=0s       p(95)=0s       p(99.9)=7.15ms  
     http_req_duration..............: avg=235.94ms min=159.16ms med=235.58ms max=650.51ms p(90)=255.31ms p(95)=261.29ms p(99.9)=534.49ms
       { expected_response:true }...: avg=235.94ms min=159.16ms med=235.58ms max=650.51ms p(90)=255.31ms p(95)=261.29ms p(99.9)=534.49ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 12796
     http_req_receiving.............: avg=326.55µs min=32.75µs  med=58.3µs   max=242.95ms p(90)=159.78µs p(95)=436.31µs p(99.9)=31.46ms 
     http_req_sending...............: avg=111.6µs  min=6.62µs   med=10.67µs  max=275.17ms p(90)=29.38µs  p(95)=121.46µs p(99.9)=4.16ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=235.5ms  min=159.06ms med=235.24ms max=627.77ms p(90)=254.84ms p(95)=260.77ms p(99.9)=524.06ms
     http_reqs......................: 12796   158.105996/s
     iteration_duration.............: avg=236.49ms min=159.51ms med=236ms    max=659.43ms p(90)=255.71ms p(95)=261.62ms p(99.9)=548.63ms
     iterations.....................: 12696   156.870407/s
     success_rate...................: 100.00% ✓ 12696      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 34101      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   174 kB/s
     http_req_blocked...............: avg=28.27µs  min=1.18µs   med=2.56µs   max=11.4ms   p(90)=4µs      p(95)=5.2µs    p(99.9)=9.06ms  
     http_req_connecting............: avg=24.93µs  min=0s       med=0s       max=11.37ms  p(90)=0s       p(95)=0s       p(99.9)=9.03ms  
     http_req_duration..............: avg=263.41ms min=142.36ms med=254.2ms  max=758.83ms p(90)=273.75ms p(95)=293.04ms p(99.9)=639.91ms
       { expected_response:true }...: avg=263.41ms min=142.36ms med=254.2ms  max=758.83ms p(90)=273.75ms p(95)=293.04ms p(99.9)=639.91ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11467
     http_req_receiving.............: avg=86.97µs  min=26.1µs   med=43.96µs  max=15.29ms  p(90)=100.95µs p(95)=344.55µs p(99.9)=1.97ms  
     http_req_sending...............: avg=127.11µs min=5.37µs   med=10.82µs  max=204.07ms p(90)=36.71µs  p(95)=143.51µs p(99.9)=9.22ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=263.2ms  min=142.29ms med=254.06ms max=757.52ms p(90)=273.55ms p(95)=292.45ms p(99.9)=639.08ms
     http_reqs......................: 11467   149.638973/s
     iteration_duration.............: avg=264.7ms  min=142.69ms med=254.54ms max=779.78ms p(90)=274.16ms p(95)=294.87ms p(99.9)=702.52ms
     iterations.....................: 11367   148.33402/s
     success_rate...................: 100.00% ✓ 11367      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `hive-gateway-bun`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 33981      ✗ 0    
     data_received..................: 1.0 GB  13 MB/s
     data_sent......................: 13 MB   173 kB/s
     http_req_blocked...............: avg=23.31µs  min=929ns    med=2.68µs   max=9.18ms   p(90)=4.51µs   p(95)=6.12µs   p(99.9)=7.06ms  
     http_req_connecting............: avg=19.95µs  min=0s       med=0s       max=9.15ms   p(90)=0s       p(95)=0s       p(99.9)=7.04ms  
     http_req_duration..............: avg=264.37ms min=157.89ms med=254.53ms max=931.22ms p(90)=275.84ms p(95)=298.49ms p(99.9)=918.16ms
       { expected_response:true }...: avg=264.37ms min=157.89ms med=254.53ms max=931.22ms p(90)=275.84ms p(95)=298.49ms p(99.9)=918.16ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 11427
     http_req_receiving.............: avg=93.03µs  min=23.27µs  med=46.23µs  max=15.79ms  p(90)=99.02µs  p(95)=334.11µs p(99.9)=4.54ms  
     http_req_sending...............: avg=109.31µs min=4.24µs   med=10.24µs  max=231.34ms p(90)=26.42µs  p(95)=137.68µs p(99.9)=7.19ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=264.17ms min=157.84ms med=254.43ms max=931.13ms p(90)=275.6ms  p(95)=297.57ms p(99.9)=918.01ms
     http_reqs......................: 11427   148.927131/s
     iteration_duration.............: avg=265.67ms min=158.06ms med=254.86ms max=931.45ms p(90)=276.24ms p(95)=299.64ms p(99.9)=918.54ms
     iterations.....................: 11327   147.62384/s
     success_rate...................: 100.00% ✓ 11327      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-router`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 30813      ✗ 0    
     data_received..................: 910 MB  11 MB/s
     data_sent......................: 12 MB   148 kB/s
     http_req_blocked...............: avg=28.5µs   min=1.7µs    med=2.67µs   max=10.64ms  p(90)=3.89µs   p(95)=4.7µs    p(99.9)=8.57ms  
     http_req_connecting............: avg=25.09µs  min=0s       med=0s       max=10.57ms  p(90)=0s       p(95)=0s       p(99.9)=8.54ms  
     http_req_duration..............: avg=291.33ms min=169.72ms med=292.12ms max=693.73ms p(90)=328.28ms p(95)=337.08ms p(99.9)=625.45ms
       { expected_response:true }...: avg=291.33ms min=169.72ms med=292.12ms max=693.73ms p(90)=328.28ms p(95)=337.08ms p(99.9)=625.45ms
     http_req_failed................: 0.00%   ✓ 0          ✗ 10371
     http_req_receiving.............: avg=94.97µs  min=33.74µs  med=49µs     max=44.73ms  p(90)=96.42µs  p(95)=221.9µs  p(99.9)=3.34ms  
     http_req_sending...............: avg=64.67µs  min=7.38µs   med=10.67µs  max=178.1ms  p(90)=21.07µs  p(95)=129.3µs  p(99.9)=2.26ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=291.17ms min=169.66ms med=291.98ms max=692.91ms p(90)=328.15ms p(95)=336.89ms p(99.9)=624.27ms
     http_reqs......................: 10371   127.47136/s
     iteration_duration.............: avg=292.53ms min=169.97ms med=292.74ms max=737.55ms p(90)=328.72ms p(95)=337.62ms p(99.9)=661.68ms
     iterations.....................: 10271   126.242247/s
     success_rate...................: 100.00% ✓ 10271      ✗ 0    
     vus............................: 50      min=0        max=50 
     vus_max........................: 50      min=50       max=50 

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview
Summary for: `apollo-gateway`

K6 Output

     ✓ response code was 200
     ✓ no graphql errors
     ✓ valid response structure

     checks.........................: 100.00% ✓ 20304     ✗ 0   
     data_received..................: 603 MB  7.4 MB/s
     data_sent......................: 8.0 MB  98 kB/s
     http_req_blocked...............: avg=50.3µs   min=1.4µs    med=3.44µs   max=12.56ms  p(90)=5.49µs   p(95)=6.4µs    p(99.9)=10.68ms 
     http_req_connecting............: avg=46.04µs  min=0s       med=0s       max=12.52ms  p(90)=0s       p(95)=0s       p(99.9)=10.61ms 
     http_req_duration..............: avg=440.28ms min=212.14ms med=442.78ms max=970.47ms p(90)=475.33ms p(95)=487.6ms  p(99.9)=894.49ms
       { expected_response:true }...: avg=440.28ms min=212.14ms med=442.78ms max=970.47ms p(90)=475.33ms p(95)=487.6ms  p(99.9)=894.49ms
     http_req_failed................: 0.00%   ✓ 0         ✗ 6868
     http_req_receiving.............: avg=81.94µs  min=32.94µs  med=62.25µs  max=57.3ms   p(90)=109.02µs p(95)=126.11µs p(99.9)=574.39µs
     http_req_sending...............: avg=43.43µs  min=6.58µs   med=13.79µs  max=55.97ms  p(90)=22.58µs  p(95)=29.55µs  p(99.9)=3.47ms  
     http_req_tls_handshaking.......: avg=0s       min=0s       med=0s       max=0s       p(90)=0s       p(95)=0s       p(99.9)=0s      
     http_req_waiting...............: avg=440.15ms min=212.02ms med=442.71ms max=955.46ms p(90)=475.23ms p(95)=487.54ms p(99.9)=893.33ms
     http_reqs......................: 6868    83.964619/s
     iteration_duration.............: avg=444.21ms min=276.05ms med=443.46ms max=1.03s    p(90)=475.79ms p(95)=488.3ms  p(99.9)=955.2ms 
     iterations.....................: 6768    82.742071/s
     success_rate...................: 100.00% ✓ 6768      ✗ 0   
     vus............................: 50      min=0       max=50
     vus_max........................: 50      min=50      max=50

Performance Overview

Performance Overview

HTTP Overview

HTTP Overview

@ardatan ardatan merged commit 4cc352d into main Nov 4, 2025
34 checks passed
@ardatan ardatan deleted the renovate/capture-website-cli-5.x branch November 4, 2025 00:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant