Agent Configuration

Configure system prompts, LLM settings, versions, and publishing for your Thotis RAG agents.

Agent types

Thotis RAG supports two engine types:

  • Chat (chat): a conversational assistant that retrieves from datasets and generates answers. Backed by a RagFlow chat assistant.
  • Agent (agent): a workflow-based agent with multi-step reasoning, tool use, and orchestration. Backed by a RagFlow agent with DSL.

System prompt

The system prompt defines the agent's personality, constraints, and instructions. It is sent to the LLM at the beginning of every conversation.

Best practices:

  • Be specific about the domain and tone.
  • Include explicit constraints (e.g. "Only answer questions related to French higher education").
  • Keep it under 2000 tokens for optimal performance.

Opener

The opener is the first message displayed to the user when a new session starts. It sets expectations and can suggest initial questions.

LLM settings

In the Settings tab you can configure:

ParameterDefaultDescription
Modeldeepseek-chatThe LLM model used for completions
Temperature0.1Controls randomness (0 = deterministic, 1 = creative)
Max tokens2048Maximum tokens in the response
Top P0.9Nucleus sampling threshold
Frequency penalty0Penalizes repeated tokens
Presence penalty0Penalizes tokens already in the conversation

Version management

Every change to an agent creates a draft version. Drafts can be validated and published:

  1. Draft: editable, not yet live.
  2. Published: the active version served to users. Only one version can be published at a time.
  3. Rolled back: a previously published version that was replaced.

Publishing workflow

  1. Edit the agent configuration.
  2. Click Publish to validate the draft (checks: system prompt present, datasets bound, RagFlow healthy).
  3. On success, the version is pushed to RagFlow and a runtime manifest is created.
  4. The previous published version is automatically rolled back.

Rollback

You can rollback to the previous version at any time from the Deployments page. Rollback re-publishes the last known good version.