diff --git a/backend/api_performance_report.md b/backend/api_performance_report.md index 837a696..006fe37 100644 --- a/backend/api_performance_report.md +++ b/backend/api_performance_report.md @@ -1,49 +1,51 @@ -# API Benchmarking Report (2026-04-05 23:55:38) +# API Benchmarking Report (2026-04-06 13:45:31) **Base URL:** `https://api.imageteach.tech:8002` ## Executive Summary | Task | Success Rate | Avg TTFB | Avg Latency | P95 Latency | TPS | RPS | | :--- | :--- | :--- | :--- | :--- | :--- | :--- | -| Completion-Short | 100.0% | 7519.5ms | 7520.1ms | 14075.8ms | 63.9 | 0.58 | -| Completion-Normal | 70.0% | 9184.3ms | 9184.8ms | 14619.5ms | 100.5 | 0.14 | -| Completion-Long | 100.0% | 22419.4ms | 22419.8ms | 39618.0ms | 852.5 | 0.21 | -| OCR-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 5.49 | -| TTS-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 11.27 | -| ASR-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 7.54 | -| Convert-Concurrent | 100.0% | 377.9ms | 378.6ms | 1017.7ms | 26.4 | 5.28 | +| Completion-Short | 90.0% | 9123.6ms | 9123.8ms | 20222.9ms | 7.9 | 0.08 | +| Completion-Normal | 10.0% | 10559.3ms | 10559.6ms | 10559.6ms | 66.4 | 0.66 | +| Completion-Long | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 8.97 | +| OCR-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 6.75 | +| TTS-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 10.17 | +| ASR-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 13.02 | +| Convert-Concurrent | 0.0% | 0.0ms | 0.0ms | 0.0ms | 0.0 | 5.98 | ## Stability & Context Analysis Detailed analysis of how context length affects TTFB and overall performance. ### Completion-Short Details - **Total Samples:** 10 -- **Duration:** 17.36s +- **Duration:** 123.93s +- **Top Errors:** + - `[0]` ### Completion-Normal Details - **Total Samples:** 10 -- **Duration:** 70.66s +- **Duration:** 15.21s - **Top Errors:** - - `[504]` -504 Gateway Time-out + - `[502]` +502 Bad Gateway -

504 Gateway Time-out

+

502 Bad Gateway


openresty
- - `[504]` -504 Gateway Time-out + - `[502]` +502 Bad Gateway -

504 Gateway Time-out

+

502 Bad Gateway


openresty
- - `[504]` -504 Gateway Time-out + - `[502]` +502 Bad Gateway -

504 Gateway Time-out

+

502 Bad Gateway


openresty
@@ -51,32 +53,144 @@ Detailed analysis of how context length affects TTFB and overall performance. ### Completion-Long Details - **Total Samples:** 10 -- **Duration:** 47.09s +- **Duration:** 1.11s +- **Top Errors:** + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + ### OCR-Concurrent Details - **Total Samples:** 10 -- **Duration:** 1.82s +- **Duration:** 1.48s - **Top Errors:** - - `[500]` {"error":"model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details (status code: 500)"} - - `[500]` {"error":"model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details (status code: 500)"} - - `[500]` {"error":"model runner has unexpectedly stopped, this may be due to resource limitations or an internal error, check ollama server logs for details (status code: 500)"} + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + ### TTS-Concurrent Details - **Total Samples:** 10 -- **Duration:** 0.89s +- **Duration:** 0.98s - **Top Errors:** - - `[404]` {"detail":"Not Found"} - - `[404]` {"detail":"Not Found"} - - `[404]` {"detail":"Not Found"} + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + ### ASR-Concurrent Details - **Total Samples:** 10 -- **Duration:** 1.33s +- **Duration:** 0.77s - **Top Errors:** - - `[404]` {"detail":"Not Found"} - - `[404]` {"detail":"Not Found"} - - `[404]` {"detail":"Not Found"} + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + ### Convert-Concurrent Details - **Total Samples:** 10 -- **Duration:** 1.90s \ No newline at end of file +- **Duration:** 1.67s +- **Top Errors:** + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ + + + - `[502]` +502 Bad Gateway + +

502 Bad Gateway

+
openresty
+ +