“ydy0615”
5a26dfde2a
后端变更: - 新增 risk_config.py: 风险配置数据类，支持环境变量驱动 - 新增 risk_control.py: 风险控制控制器，管理并发和预算 - 新增 session_store.py: 匿名会话存储，基于 cookie 的 session ID - 新增 audit_store.py: API 审计日志存储，记录请求和 LLM 调用 - 新增 captcha_api.py: 验证码 API，用于验证用户操作真实性 - 新增 llm_policy.py: LLM 策略配置，管理 completion/pro/vision 模型 - main.py: 集成 middleware、risk/audit/session 模块 (+467/-7) - job_handlers.py: LLM 执行流程重构，新增 risk/audit 集成 (+207/-4) - llm.py: 异步客户端封装，新增 max_output_tokens 参数 (+78/-1) - job_system.py: stream_events 逻辑优化，支持心跳检测 (+12/-4) - pro_completions.py: SSE heartbeat 机制，防止连接超时 (+14/-4) - prompt.py: _normalize_preferences 支持 Mapping 类型 (+13/-0) - tts_asr.py: asyncio loop 初始化，router export (+10/-0) 前端变更: - src/components/CaptchaComponent.vue: 新增验证码组件 (NEW) - src/utils/cookie_policy.js: Cookie 策略工具 (NEW) - SettingsPanel.vue: 集成验证码组件，新增安全设置部分 (+59/-0) - MilkdownEditor.vue: 移除硬编码 API_KEY，新增 credentials (+32/-10) - ProBlockCrepe.vue: 样式简化，移除渐变动画 (+18/-4) - proBlockPlugin.ts: 重构 schema/serializer 引用方式，通过 Ctx 管理 (+40/-10) - api.js: 新增 credentials，重构 headers 条件逻辑 (+50/-14) - config.js: API 基址改为 https://api.imageteach.tech:8002 (+8/-4) - convert.js, docsApi.js, i18n.js: 新增 credentials 和验证码 i18n (+54/-12) - proAccept.js: 重构正则和转义处理，修复捕获组索引 (+14/-4) 配置和基础设施: - docker-compose.yml: 新增端口映射 8001:8001 (+2/-0) - docker/nginx.conf: 改为 307 redirect，优化代理配置 (+8/-6) - vite.config.js: 移除 proxy 配置，直接调用远程 API (+8/-4) - .env.example: 新增 VITE_API_BASE_URL, VITE_API_KEY (+3/-1) - backend/.env.example: 大量 RISK_*, SESSION_*, CORS_* 配置 (+54/-0) - pytest.ini: 扩展 coverage 范围到整个 backend，移除 fail_under (+3/-2) - .coveragerc: 移除 fail_under = 90 (+0/-1) - .gitignore: 新增 docker-data/ (+3/-0) - package.json: 新增 vue3-captcha 依赖 (+3/-1) - AGENTS.md, README.md: 更新 Docker 部署和前端网络约定 (+20/-5) - public/sw.js: Service Worker cache 版本从 v1 升级到 v2 (+0/-1) 测试变更: - test_main_endpoints.py: 新增 session/risk/audit reset，新增测试用例 (+63/-4) - test_main_cancel.py: 新增 reset 调用 (+6/-0) - test_pro_completions.py: 新增 preferences 序列化和测试 (+23/-0) 总计: 45 个文件变更，+1009/-280 行
115 lines
3.2 KiB
Bash
115 lines
3.2 KiB
Bash
# OpenAI-compatible endpoint
|
|
# In Docker, use host.docker.internal instead of localhost for a model service on the host.
|
|
LLM_BASE_URL=https://api.openai.com/v1/
|
|
LLM_API_KEY=sk-your-key
|
|
|
|
# Default model for inline completions
|
|
LLM_MODEL=gpt-4.1-mini
|
|
|
|
# Pro-tier model (defaults to LLM_MODEL if unset)
|
|
PRO_LLM_MODEL=gpt-4.1
|
|
|
|
# Vision model for OCR
|
|
VLM_MODEL=gpt-4.1-mini
|
|
|
|
# API key for the FastAPI app (change in production)
|
|
API_KEY=your-secret-key-here
|
|
|
|
# Browser origins allowed to send anonymous session cookies
|
|
CORS_ALLOW_ORIGINS=https://imageteach.tech,https://www.imageteach.tech,http://localhost:5173,http://127.0.0.1:5173
|
|
|
|
# Anonymous session cookie
|
|
SESSION_COOKIE_NAME=llm_anonymous_session
|
|
SESSION_COOKIE_SECURE=true
|
|
SESSION_COOKIE_SAMESITE=none
|
|
SESSION_COOKIE_DOMAIN=
|
|
SESSION_COOKIE_PATH=/
|
|
SESSION_COOKIE_MAX_AGE_SECONDS=2592000
|
|
SESSION_ROTATION_SECONDS=86400
|
|
|
|
# Job backend
|
|
JOB_BACKEND=redis
|
|
REDIS_URL=redis://localhost:6379/0
|
|
DATABASE_URL=postgresql://llm_in_text:llm_in_text_change_me@localhost:5432/llm_in_text
|
|
DOCS_BACKEND=postgres
|
|
JOB_REDIS_PREFIX=llmtext:jobs
|
|
JOB_CONSUMER_NAME=
|
|
JOB_SHARED_TEMP_DIR=/tmp/llm-in-text-jobs
|
|
JOB_STATE_TTL_SECONDS=600
|
|
JOB_EVENT_TTL_SECONDS=600
|
|
JOB_EVENT_STREAM_MAXLEN=512
|
|
JOB_CANCEL_POLL_SECONDS=0.5
|
|
JOB_BUSY_NORMAL_THRESHOLD=0.25
|
|
JOB_BUSY_HIGH_THRESHOLD=0.75
|
|
JOB_BUSY_FULL_THRESHOLD=1.0
|
|
|
|
# Per-queue concurrency and capacity
|
|
JOB_COMPLETION_CONCURRENCY=2
|
|
JOB_COMPLETION_MAX_QUEUE=16
|
|
JOB_PRO_COMPLETION_CONCURRENCY=1
|
|
JOB_PRO_COMPLETION_MAX_QUEUE=8
|
|
JOB_COMPRESS_CONCURRENCY=1
|
|
JOB_COMPRESS_MAX_QUEUE=8
|
|
JOB_OCR_CONCURRENCY=1
|
|
JOB_OCR_MAX_QUEUE=8
|
|
JOB_CONVERT_CONCURRENCY=1
|
|
JOB_CONVERT_MAX_QUEUE=8
|
|
JOB_TTS_CONCURRENCY=1
|
|
JOB_TTS_MAX_QUEUE=4
|
|
JOB_ASR_CONCURRENCY=1
|
|
JOB_ASR_MAX_QUEUE=4
|
|
|
|
# Timeouts (seconds)
|
|
LLM_COMPLETION_TIMEOUT=600
|
|
LLM_OCR_TIMEOUT=600
|
|
|
|
# Compression limit
|
|
DOC_COMPRESS_CONTEXT_LIMIT=128000
|
|
|
|
# Risk control
|
|
RISK_API_WINDOW_SECONDS=60
|
|
RISK_API_SOFT_LIMIT=90
|
|
RISK_API_HARD_LIMIT=180
|
|
RISK_LLM_WINDOW_SECONDS=600
|
|
RISK_LLM_SOFT_LIMIT=8
|
|
RISK_LLM_HARD_LIMIT=16
|
|
RISK_SESSION_CONCURRENCY_LIMIT=2
|
|
RISK_GLOBAL_CONCURRENCY_LIMIT=12
|
|
RISK_DAILY_BUDGET_GLOBAL_USD=20
|
|
RISK_DAILY_BUDGET_SESSION_USD=2
|
|
RISK_DAILY_BUDGET_IP_USD=5
|
|
RISK_SINGLE_REQUEST_MAX_COST_USD=0.8
|
|
RISK_DELAY_STEP_MS=2500
|
|
RISK_DELAY_CAP_MS=30000
|
|
RISK_MODEL_CIRCUIT_FAILURES=8
|
|
RISK_MODEL_CIRCUIT_TTL_SECONDS=300
|
|
RISK_ENFORCE_REDIS_FAIL_CLOSED=false
|
|
|
|
# Backend-controlled model policy
|
|
RISK_COMPLETION_MODEL=gpt-4.1-mini
|
|
RISK_PRO_MODEL=gpt-4.1
|
|
RISK_VISION_MODEL=gpt-4.1-mini
|
|
RISK_COMPLETION_MAX_INPUT_CHARS=24000
|
|
RISK_COMPLETION_MAX_OUTPUT_TOKENS=768
|
|
RISK_COMPLETION_TEMPERATURE=0.4
|
|
RISK_PRO_MAX_INPUT_CHARS=48000
|
|
RISK_PRO_MAX_OUTPUT_TOKENS=2048
|
|
RISK_PRO_TEMPERATURE=0.6
|
|
RISK_COMPRESS_MAX_INPUT_CHARS=128000
|
|
RISK_COMPRESS_MAX_OUTPUT_TOKENS=1536
|
|
RISK_OCR_MAX_INPUT_BYTES=10485760
|
|
|
|
# Estimated pricing for budget control
|
|
RISK_COMPLETION_INPUT_COST_PER_1K=0.0004
|
|
RISK_COMPLETION_OUTPUT_COST_PER_1K=0.0016
|
|
RISK_PRO_INPUT_COST_PER_1K=0.003
|
|
RISK_PRO_OUTPUT_COST_PER_1K=0.012
|
|
RISK_VISION_INPUT_COST_PER_1K=0.0008
|
|
RISK_VISION_OUTPUT_COST_PER_1K=0.0024
|
|
|
|
# Legacy fallback: if LLM_BASE_URL is not set, OLLAMA_HOST will be auto-converted to /v1/ path
|
|
#OLLAMA_HOST=http://localhost:11434
|
|
|
|
# TTS/ASR settings (see README for full list)
|
|
TTS_ASR_DEVICE=auto
|