KAG extract almost finished. but ollama terminal continues gives out "context limit hit - shifting"

[pecanjk]

max_workers = 2 small enough. This happened when KAG extract almost finished. any reason?

[GIN] 2024/12/06 - 11:14:13 | 200 | 6.541379667s | 127.0.0.1 | POST "/api/generate" time=2024-12-06T11:14:13.537+08:00 level=DEBUG source=sched.go:407 msg="context for request finished" time=2024-12-06T11:14:13.537+08:00 level=DEBUG source=sched.go:357 msg="after processing request finished event" modelPath=/home/xxx/.ollama/models/blobs/sha256-dde5aa3fc5ffc17176b5e8bdc82f587b24b2678c6c66101bf7da77af9f7ccdff refCount=1 time=2024-12-06T11:14:17.197+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021 time=2024-12-06T11:14:26.496+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021 time=2024-12-06T11:14:35.197+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021 time=2024-12-06T11:14:44.229+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021 time=2024-12-06T11:14:52.911+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021 time=2024-12-06T11:15:01.782+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021

[pecanjk]

and then the process is stuck

Processing KAGExtractor: 96%|█████████▋| 53/55 [19:30<00:56, 28.25s/it]INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK" INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK" INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK" INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK"

Processing KAGExtractor: 98%|█████████▊| 54/55 [20:03<00:29, 29.73s/it]

no more output from terminal

[thundax-lyp]

需要增加ollama上下文窗口长度，建议先用在线接口做测试，现有的做KGExtractor的系统，提示词长度往往超过8K