1.3 KiB
Multi-turn chat with Ollama Entity Workflow
Multi-Turn Chat using an Entity Workflow. The workflow runs forever unless explicitly ended. The workflow continues as new after a configurable number of chat turns to keep the prompt size small and the Temporal event history small. Each continued-as-new workflow receives a summary of the conversation history so far for context.
Setup
- Install Ollama and the Mistral model (
ollama run mistral). - Install and run Temporal. Follow the instructions in the Temporal documentation to install and run the Temporal server.
- Install the dependencies:
poetry install
Running the example
-
Run the worker:
poetry run python run_worker.py -
In another terminal run the client with a prompt.
Example:
poetry run python send_message.py 'What animals are marsupials?' -
View the worker's output for the response.
-
Give followup prompts by signaling the workflow.
Example:
poetry run python send_message.py 'Do they lay eggs?' -
Get the conversation history summary by querying the workflow.
Example:
poetry run python get_history.py -
To end the chat session, run
poetry run python end_chat.py