root/geo
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(browser-fetch): add lightpanda-backed fetch service and knowledge URL fallback

Browse Source 
Adds a new browser-fetch microservice that wraps Lightpanda for rendering
JS-heavy pages, and wires it into the knowledge URL parser as a fallback
when the upstream link reader returns 403/429/5xx for an allow-listed
domain (e.g. zhuanlan.zhihu.com). Includes config/env plumbing, hot-reload
diff support, and full deploy assets (Dockerfile target, docker-compose,
k3s manifests, image-build/package scripts).
This commit is contained in:
liangxu
2026-05-11 11:11:21 +08:00
parent 708a45ba16
commit 7f08d92958
22 changed files with 1770 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
server/internal/shared/config/reload.go
+6
View File
@@ -80,6 +80,12 @@ func Diff(previous, current *Config) []FieldChange {
if previous.Retrieval != current.Retrieval {
addChange("retrieval", true)
}
if previous.BrowserFetch.QueueSize != current.BrowserFetch.QueueSize ||
previous.BrowserFetch.WorkerConcurrency != current.BrowserFetch.WorkerConcurrency {
addChange("browser_fetch.worker", false)
} else if !reflect.DeepEqual(previous.BrowserFetch, current.BrowserFetch) {
addChange("browser_fetch", true)
}
if previous.Generation.QueueSize != current.Generation.QueueSize ||
previous.Generation.WorkerConcurrency != current.Generation.WorkerConcurrency {
addChange("generation.worker", false)