dify icon indicating copy to clipboard operation
dify copied to clipboard

Fix: Add a INFO-level log when fallback to gpt2tokenizer

Open halogen22 opened this issue 1 year ago • 0 comments

Summary

To improve user noticefication when fallback to gpt2tokenizer, I added INFO logs to the following script. dify/api/core/model_runtime/model_providers/__base/tokenizers/gpt2_tokenzier.py Fixes #12486

[!Tip] Close issue syntax: Fixes #<issue number> or Resolves #<issue number>, see documentation for more details.

Screenshots

Before After
... ...

Checklist

[!IMPORTANT]
Please review the checklist below before submitting your pull request.

  • [ ] This change requires a documentation update, included: Dify Document
  • [x] I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
  • [x] I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
  • [x] I've updated the documentation accordingly.
  • [x] I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods

halogen22 avatar Jan 08 '25 14:01 halogen22