-
-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Templates cannot be outside models directory, models can #2201
Comments
Hello Prowler1000, Thank you for bringing this issue to our attention in the LocalAI project. We are sorry for any inconvenience this might be causing. From your description and provided details, it seems that templates cannot be loaded when placed outside the models directory, despite the fact that models can be loaded just fine when located in different directories. This seems to have introduced an unexpected behavior change and might be affecting existing installations that rely on a certain file structure. To further investigate this issue, we would like to ask you to provide more details on the specific configurations you are using and any error messages you are encountering when trying to use the model. This information will be crucial in helping us understand the root cause of the problem and come up with an appropriate solution. In the meantime, we recommend that you temporarily revert to the previous behavior by ensuring that templates are within the models directory as a workaround. Please update the issue with the additional information, and we will review it as soon as possible. We we can address this issue efficiently, please include 'resolved' in your ticket title. As a bot, this is just one of many experiments @mudler is conducting, so please bear with us as we make improvements. Thanks for your patience and cooperation. Best regards,
|
This is one of my config yamls from before the update Llama-3-HOAS.yaml:
With the file structure as
|
LocalAI version:
v2.13.0
Environment, CPU architecture, OS, and Version:
Intel Xeon E5-2643 v4, GNU/Linux (Unraid 6.12.10)
Describe the bug
Templates fail to load when located outside the models directory (specified with the
LOCALAI_MODELS_PATH
environment variable), however models cab be loaded just fine.To Reproduce
/models/configs
,/models/models
,/models/templates
).LOCALAI_MODELS_PATH
to/models/configs
/models/config
pointing to a model file in/models/models
and a template in/models/templates
.Expected behavior
Either no errors, or total failure, not a combination.
Additional context
This seems to have also been an undocumented change that breaks existing installs depending on their file structure.
The text was updated successfully, but these errors were encountered: