Ollama chat with streaming mode using TextArea component
4 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
I refered the follow URL to implement.
This example shows "Print stream to HTML UI Component". But I'd like to use TextArea component instead.
As the callback function of addChat
function addChat(app, content)
app.TextArea.Value = [app.TextArea.Value, content];
pause(0.1);
drawnow
end
To setup the ollama chat,
app.chat = ollamaChat("gemma3:12b", ...
systemPrompt, ...
Temperature=0.2, ...
StreamFun=@(x) app.addChat(x), ...
TimeOut=600);
Then, in order to generate text like following;
prompt = "Context:" + join(selectedDocs, " ") + newline + ...
"Answer the following question: " + query;
app.history = addUserMessage(app.history, prompt);
[text, response] = generate(app.chat, app.history);
app.addChat(text);
app.history = addResponseMessage(app.history, response);
However, it was not possble to type text retrieved from ollama chat in streaming mode.
I appreciate you could find the solution.
Iori
0 comentarios
Respuestas (0)
Ver también
Categorías
Más información sobre Environment and Settings en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!