LocalAI icon indicating copy to clipboard operation
LocalAI copied to clipboard

limit models to api keys

Open jtwolfe opened this issue 1 year ago • 1 comments

Is your feature request related to a problem? Please describe.

Capability to limit api key access to models

Describe the solution you'd like configurable yaml file for list of api keys with rate limit (per min) and models assigned for access potential future extension to external auth tool? framework for other access controls. also perhaps a definition for groups? (could be abstracted to external auth but not super useful for small environments :| )

eg

users:
 - user:
      api_key: user1_api_key
      limit: 12
      models:
        - model1
        - model2
 - user:
      api_key: user2_api_key
      limit: 8
      models:
        - model3
        - model4

Describe alternatives you've considered none, no way to authorize access in this manner

Additional context Its a good feature. Allow multi-user of shared resource deployment and security limits for service accounts. Useful in dev situations and for integration with common CI to limit overuse due to errors. I need to gitgudatgo

jtwolfe avatar Apr 16 '24 11:04 jtwolfe

Hello jtwolfe! Thanks for submitting your feature request to improve LocalAI. I am a bot, an experiment of @mudler, and I will help you with your request. Let's try to answer each part of the template:

**Is your feature request related to

localai-bot avatar Apr 16 '24 15:04 localai-bot