Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Identify model by type (tts, text, ...) #3488

Open
ecyht2 opened this issue Sep 6, 2024 · 2 comments
Open

Identify model by type (tts, text, ...) #3488

ecyht2 opened this issue Sep 6, 2024 · 2 comments
Labels
enhancement New feature or request roadmap

Comments

@ecyht2
Copy link

ecyht2 commented Sep 6, 2024

LocalAI version:
I am using the docker image from dockerhub localai/localai:lastest-cp but I don't think it matters.

Environment, CPU architecture, OS, and Version:
Linux archserver 6.6.49-1-lts #1 SMP PREEMPT_DYNAMIC Wed, 04 Sep 2024 13:18:51 +0000 x86_64 GNU/Linux

Describe the bug
Models are appearing where they shouldn't be in "Select Model". For example, a text model is showing up in TTS, Image Generation, and Talk.
image

To Reproduce

  1. Install a text model.
  2. Go to TTS tab.
  3. Click "Select Model" combo box.
  4. Text model available there.

Expected behavior
Text models should only appear in the "Chat" tab and vice versa for other models.

Logs
N/A

Additional context
N/A

@ecyht2 ecyht2 added bug Something isn't working unconfirmed labels Sep 6, 2024
@dave-gray101
Copy link
Collaborator

I may not be remembering correctly, but I don't believe we currently filter these lists. I have a PR pending review that will add a heuristic function able to guess which use cases are appropriate for each dropdown.

Please note that this pr doesn't actually extend support to changing these dropdowns yet, as I'd like to run a few tests and experiments once the unit test is merged first.

I'll punch in a quick cli command to exercise the functionality in case others are able to help test the functionality against different model configurations to speed this along

@mudler
Copy link
Owner

mudler commented Sep 13, 2024

we don't filter by model category yet - but this is something in our radar and that should be addressed at some point

@mudler mudler added enhancement New feature or request and removed bug Something isn't working unconfirmed labels Sep 13, 2024
@mudler mudler changed the title Wrong Model List Sep 13, 2024
@mudler mudler added the roadmap label Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request roadmap
3 participants