Search results

Scaling performance as sequences exceeds core count

Status: Open.

#115 In microsoft/aici;

· AaronFriel opened on Sep 12, 2024

Support for phi3 - llama.cpp update

Status: Open.

#99 In microsoft/aici;

· superchargez opened on Apr 28, 2024

pytctrl backtracking is non-idempotent

Status: Open.

#93 In microsoft/aici;

· matthai opened on Apr 11, 2024

guidance controller

Status: Open.

#91 In microsoft/aici;

· mmoskal opened on Apr 10, 2024

support native controllers

Status: Open.

#90 In microsoft/aici;

· mmoskal opened on Apr 10, 2024

Exception when no token generated

Status: Open.

#88 In microsoft/aici;

· matthai opened on Apr 5, 2024

confusing error for missing CUDA compute cap 8.0

bugSomething isn't workingSomething isn't working

Status: Open.

#87 In microsoft/aici;

· vargonis opened on Apr 2, 2024

better error on prompt len exceeded in rllm

bugSomething isn't workingSomething isn't working

rLLM

Status: Open.

#81 In microsoft/aici;

· mmoskal opened on Mar 25, 2024

Expose the server on 0.0.0.0 in order to be called from outside

Status: Open.

#80 In microsoft/aici;

· anielennova opened on Mar 21, 2024

can't build pyctrl on WSL (windows 11)

Status: Open.

#79 In microsoft/aici;

· superchargez opened on Mar 19, 2024

duplicate tokens in tokenizers

Status: Open.

#78 In microsoft/aici;

· mmoskal opened on Mar 18, 2024

Server crashes with index out of bounds

Status: Open.

#75 In microsoft/aici;

· samrat opened on Mar 14, 2024