AI Agent¶
Class 5 AI Agent
Overview¶
Traditional human call center agents are effective in handling inquiries but are constrained by availability, response time, and operational costs.
In contrast, ConnexCS AI Call Center Agents deliver instant, 24/7 support with zero downtime. They automate repetitive interactions, and ensure highly scalable, latency-free communication, reducing reliance on human intervention while maintaining service accuracy and efficiency.
With AI-driven automation, businesses can enhance customer experience while significantly lowering operational overhead.
Use Cases¶
- AI Receptionist:
- Front Desk Automation
- Appointment Scheduling
- Customer Query Handling
- After hours support
- Conversational Data Collection
- Scheduling call back
Benefits¶
- 24/7 Availability
- Reduced Operational Costs
- Faster Query Resolution
- Improved Appointment Management
- Automatic collection and updation of records
Steps to create AI Agent¶
- Login to your account.
- Navigate to Class 5 AI Agent.
- Click on the blue
+
icon. - A window will open up where you can create your customizable AI Agent for your customers.
- Fill in the following fields to setup your AI Agent:
- Name: Give a name to your AI Agent.
- Destination: Enter the Extension for the callers to call (essentially, the dial-in number).
- Company: Associate the AI Agent with a customer.
- App: Associate the AI Agent with the Application that you have created in the IDE.
- PBX Server: Select the PBX Server from the drop-down.
- Platform: Use either ConnexCS Converse or ConnexCS Converse Direct to model the AI Agent.
- Host: It's the hosting server where your AI Agent runs and processes interactions.
- Click
Save
.
-
Model: Select a model for the selected platform. A model is a specific version or configuration of an AI system to perform tasks like text generation, real-time interactions etc.
Info
Different Platforms offer specific Models suited to their capabilities.
-
First Message: The initial message spoken by the agent. For example, when the agent begins the conversation.
- LLM Timeout (sec): Refers to the predefined time-frame during which an LLM is granted permission to process a request.
- LLM Retries: Number of attempts the LLM makes in performing back-end tasks.
- End Call Phrases: Phrases or messages used to conclude a call or interaction with a customer.
- Prompt: The prompt field allows you to enter the set of instructions to guide the AI Agent to perform certain tasks. It provides as the foundation for the AI to comprehend the context, interpret the user's purpose, and generate relevant results.
- Click
Save
.
- Transcriber: Select single or multiple transcriber for converting audio to text. You can select the transcriber depending on the selected platform.
- Answer Machine Detection Keywords: If the AI Agent detects a phrase (any phrase entered by the user) like "Please leave a message" at the start of the call, it will automatically disconnect. Enter multiple keywords, each on a new line (use
Enter
to separate). - Transcriber Language: The spoken language the AI Agent listens for when converting speech into text.
- Transcriber Timeout: It defines the maximum time the system waits for a response during speech-to-text transcription before terminating the process. If no speech is detected within this period, the transcriber stops listening and times out. On timeout
<SILENT_TIMEOUT>
will be sent to the LLM. -
Transcriber Silence Threshold (sec): Defines the maximum duration (in seconds) the system will wait for a response from the ASR (Automatic Speech Recognition) engine. If no transcription is received within this threshold, the transcriber will stop waiting and proceed accordingly.
-
End Turn Threshold: A sidecar classifier that detects the probability the user has finished speaking.
- When the classifier gives a low value, it means the system thinks the person is still speaking — maybe just taking a short pause.
- A high value means the system thinks the person has finished talking.
Value | Description |
---|---|
0 | Will never evaluate, will always assume end of speech |
0.1 | Mainly assume that the speech has ended |
0.9 | main assume that the speech will continue |
1 | Always Assume that there is more speech to come |
- Click
Save
.
- Text To Speech(TTS): Select from various TTS models to convert your text into audio. You can select the transcriber depending on the selected platform.
- Filler Words: These are extra words people say in conversations that don’t add meaning but give them time to think. Examples include "um," "uh," "like," "you know," and "well." Select multiple filler words.
- Voice: Select the voice for the text-to-speech service.
- Min Filler Word Delay (sec): If the AI Agent fails to respond within the predefined time frame, the system will insert the selected filler words to maintain engagement with the customer.
- Interrupt Delay (sec): Refers to the time taken by the AI Agent to pause its current operation or response generation when interrupted by a user.
- Click
Save
.
- Built-in Functions:
- Hangup: Use this flag to terminate the call. You can include a prompt such as, "When call ended, hangup.
- Set Variable: Set variables locally. For example, in a prompt, you could ask, "What's your name?" and save the response to the variable
name
. - Transfer: Allows transfering calls to another agent.
- Search Knowledge Base: Allows the AI to query indexed documents in the Knowledge Base and return relevant information in response to a user's question.
- Tool Call Allow List: Select from a list of
functions
available in Apps in IDE. - Guard Rails: Choose from multiple Guard Rails options to define constraints for your AI Agent.
-
Flags: Select from various flags:
- Async Guard Rails: Currently not in use.
- Local Voice Activity Detection: It optimizes VoIP performance by identifying speech in real-time at the user’s device.
- Disable ScriptForge: Disables Scriptforge completely. Enabling this flag will deactivate the Tool Call Support functionality.
- Listen First: Enabling this flag ensures the LLM prioritizes listening to the user before responding.
- Vad Start Interrupt: A VAD Start Interrupt is triggered when the system detects the onset of voice activity, indicating that speech has begun.
- Complete Word on Interrupt: If the AI is interrupted, it will complete the current word before stopping execution.
- Async First Greeting: When
enabled
, only the first message of the main prompt will be executed before proceeding directly to the first task. Whendisabled
, the system will follow the default behavior and execute the entire main prompt sequence.
-
Precache Phrases are predefined phrases that the system processes in advance to enable faster and more efficient playback or response when required.
-
Office Background Volume: This feature enables the playback of background office sounds.
-
Temperature: Refers to a parameter that controls the creativity of the model's output.
- Low temperature (close to 0) makes the model's responses more predictable by selecting the most probable words.
- High temperature (closer to 1 or above) increases randomness, leading to more diverse and creative but potentially less coherent responses.
-
First Task: Select the list of pre-created tasks, so that your AI will perform this task as the first task and rest prompts after this task. Click here to know more about tasks.
-
Knowledge Base: Allows you to select which indexed documents an AI Agent can reference when answering user queries.
-
VarsTOML: Select the variables you want pass into the ScriptForge script.
-
Click
Save
.
Example Prompt
Introduction:
Hello! I’m your AI assistant from ConnexCS, a leader in VoIP and cloud communication solutions. I'm here to assist you with product details, services, and billing inquiries.
Ask the Customer:
Would you like to learn about our VoIP solutions like Class 4 SIP Cloud Switch, WebRTC as a Service, or STIR/SHAKEN compliance, or do you need details on billing and pricing?
Products & Services:
Class 4 SIP Cloud Switch – Scalable VoIP carrier solution.
Class 5 PBX – Multi-tenant business communication platform.
Anycast SIP Load Balancers – High-availability SIP routing.
WebRTC as a Service – Seamless SIP-to-WebRTC integration.
STIR/SHAKEN Compliance – Secure, authenticated VoIP calls.
Carrier-Grade SIP Switching – High-volume global VoIP.
Call Recording & Transcription – Compliance & insights.
Anycast Load Balancing – Prevents service disruptions.
Billing Plans:
Per Channel: $1
per channel/month
Per Minute: $0.0003/min
(usage-based allocation)
Server Cost: $20
per server
AnyEdge: $20
per server
Guidelines:
- Adapt to technical & non-technical users.
- Keep responses clear, professional, and concise.
- Provide pricing & additional details as needed.
- Avoid abbreviations and ensure clarity.
Note: You have NOT YET collected any customer information, ignore any pre-set variables
Add this in the prompt to tell your LLM that no customer information has been gathered so far, and any variables or configurations that might have been pre-set should be disregarded at this stage. This ensures that the process begins with a clean slate, without relying on or being influenced by previously defined or assumed data.
Task¶
A Task refers to a specific goal or objective that the agent is designed to accomplish.
It usually involves processing inputs, making decisions, and taking actions to achieve the desired outcome.
How it works?
flowchart TB
A([📝 Create Initial Task]) --> B([⚙️ Go to Advanced Settings])
B --> C([📌 Set as First Task])
C --> D([🔧 Configure Task Settings])
D --> E([➕ Add Next AI Agent Task])
E --> F{🧠 Is Condition Met?}
F -- ✅ Yes --> G([➡️ Proceed to Next Task])
F -- ❌ No --> H([⏸️ Stop])
G --> I([🔁 Repeat for Next Task])
I --> E
%% Styling
classDef step fill:#E0F7FA,stroke:#00ACC1,stroke-width:2px,color:#004D40;
classDef decision fill:#FFF3E0,stroke:#FB8C00,stroke-width:2px,color:#E65100;
class A,B,C,D,E,G,I,Z step;
class F,H decision;
Steps to Create a Task¶
- Log in to your account.
- Navigate to Class 5 AI Agent.
- Click on Task.
- Click on the blue
+
sign (Add next node). It will update the first task. -
Fill in the following fields to setup the task for your AI Agent:
-
Basic:
-
Name: Enter the name of your task.
-
-
Model:
-
Model: Select a model for the selected platform. A model is a specific version or configuration of an AI system to perform tasks like text generation, real-time interactions, etc.
Info
Different platforms offer specific models suited to their capabilities.
-
First Message: The initial message spoken by the agent. For example, when the agent begins the conversation.
-
Prompt: The prompt field allows you to enter a set of instructions to guide the AI Agent to perform certain tasks. It provides the foundation for the AI to comprehend the context, interpret the user's purpose, and generate relevant results.
-
-
Transcriber
-
Transcriber: Select a single or multiple transcribers for converting audio to text. You can select the transcriber depending on the selected platform.
-
-
Advanced
- Built-in Functions:
- Hangup: Use this flag to terminate the call. You can include a prompt such as, "When call ended, hangup.".
- Set Variable: Set variables locally. Set variables locally. For example, in a prompt, you could ask, "What's your name?" and save the response to the variable
name
. - Transfer: Allows transferring calls to another agent.
-
Tool Call Allow List: Select from a list of
functions
available in Apps in IDE. -
Guard Rails: Choose from multiple Guard Rails options to define constraints for your AI Agent.
-
Flags: Select from various flags:
- Async Guard Rails: Currently not in use.
- Local Voice Activity Detection: Optimizes VoIP performance by identifying speech in real time at the user’s device.
- Disable ScriptForge: Disables ScriptForge completely. Enabling this flag will deactivate the Tool Call Support functionality.
- Listen First: Enabling this flag ensures the LLM prioritizes listening to the user before responding.
- Vad Start Interrupt: A VAD Start Interrupt is triggered when the system detects the onset of voice activity, indicating that speech has begun.
- Complete Word on Interrupt: If the AI is interrupted, it will complete the current word before stopping execution.
- Async First Greeting: When enabled, only the first message of the main prompt will be executed before proceeding directly to the first task. When disabled, the system will follow the default behavior and execute the entire main prompt sequence.
- Include Primary Chat History: Includes the full conversation history from the primary session, allowing the AI to access prior interactions for better context and continuity.
- Include Primary Prompt: Appends the initial prompt from the primary task to the current session, ensuring the AI has visibility into the original instruction or objective.
- Sync Primary Chat History: Enables real-time synchronization with the primary chat session, so updates and responses are reflected across both the original and current contexts.
- Summarize History on Exit: Generates a concise summary of the conversation when the task concludes.
- Bill Task Separately: Marks this task to be billed independently from the rest of the session
-
Office Background Volume: This feature enables the playback of background office sounds.
-
Temperature: Refers to a parameter that controls the creativity of the model's output.
- Low temperature (close to 0) makes the model's responses more predictable by selecting the most probable words.
-
High temperature (closer to 1 or above) increases randomness, leading to more diverse and creative but potentially less coherent responses.
-
VarsTOML: Select the variables you want pass into the ScriptForge script.
- Built-in Functions:
-
Click
Save
. -
To use this created task select it under Advanced First Task.
Note
- If
Include Primary Chat History
ischecked
,Include Primary Prompt
will be ticked automatically. - If
Sync Primary Chat History
ischecked
,Include Primary Chat History
andInclude Primary Prompt
will be ticked automatically.
-
AI Agent Task Conditions¶
In the AI Agent Task configuration, the Condition field defines the rule that determines when a specific task should be executed.
It allows you to control the flow of conversation by linking one task to another based on user input, recognized entities, or system logic.
-
Field Description
-
Condition: The logic that triggers an AI Agent Task. If the condition evaluates as true, the defined task will run.
-
AI Agent Task: Its the current task.
-
Next AI Agent Task: This task will be executed if the condition is met.
-
-
Types of Conditions
-
Default: Executes when no other specific condition is met.
-
Example: If the caller has not given a recognizable input, the AI Agent moves forward with the default task.
-
-
Custom Conditions: Allows branching based on input or context.
-
Common use cases:
-
User Input: If the caller says “yes” or “no.”
-
Entity Recognition: If the system has captured an email address, phone number, or name.
-
System Variables: If a variable (e.g., customerID) exists or matches a value.
-
-
Benefits of Using Conditions
-
Enables dynamic branching in AI conversations.
-
Improves user experience by adapting responses to input.
-
Provides greater control over workflow design.
-
You can pass variables using JSON in the prompt section to configure or initialize them.
Make sure you select SetVariable
under Advanced Built-in Functions Set Variable
Example Use Case
Store the caller's name by calling the setVariable function with name=name
and value=[The customers name]
.
AI Platforms, Models, Voices, TTS, Transcribers¶
Platform | Model | Transcriber | Text To Speech (TTS) | Voice |
---|---|---|---|---|
ConnexCS Converse Direct | Select from the multiple options | ConnexCS Internal | Google, PlayHT |
While accessing the ConnexCS Converse Direct Platform, you will notice that models in the drop-down menu are labeled with "(Tools)". Selecting a model without the (Tools) designation will prevent you from accessing ScriptForge and performing behind-the-scenes tasks.
Chat¶
The Chat interface will provide responses based on the prompts you submit. Each reply will be tailored specifically to the content and context of your input, ensuring relevant and accurate information is delivered efficiently.
To improve the relevance and accuracy of the AI's replies, you can use the Add Context feature.
Before starting, choose a model mode—Standard for fast results (default) or Expert for deeper reasoning with longer response times
How to access the Chat feature?¶
- Login to your account.
- Navigate to Class 5 AI Agent.
- Click on Chat.
-
Click on Start Chat.
-
Before initiating interaction with the AI chatbot, you must configure a few initial settings:
-
Add Context
(optional field): Allows you to provide additional information to the AI before or during a conversation so it can give more accurate, relevant, and helpful responses. You can either addText Input
or upload text files usingFile Upload
option..
ClickAdd to Chat
. -
Select the mode of the model:
Standard
(default): A fast model focused on quick results.Expert
: A reasoning model, takes longer to respond.
Toggle
for fullscreen.
Example for Standard Mode
Example for Expert Mode
How to use Functions for the Large Language Models (LLMs)?¶
To grant access to functions for an AI agent, follow these steps:
-
Create an App from IDE:
- Login to your account
- Navigate to IDE Application.
- Create a new App. Click here to follow the steps.
-
Add a Script Forge: Under the newly created app, add a Script Forge. Click here to know the steps.
-
Define the Function: Within the Script Forge, add the function you want the AI agent to access.
Example Function
1 2 3 4 5 6 7 8 9
/** * Transfer * @param {Object} param - Param Object * @param {string} param.name - The name of the person who you wish to transfer the call to. */ function transfer() { console.log(`We are going to transfer the call`) return { action: 'transfer', destination: '4423456526787365' } }
-
Assign the App to the AI Agent:
- Navigate to your AI agent that you have previously created.
- Under the Basic in the App field app, choose the created App.
-
Allow Function Access:
- Navigate to Advanced tab (in AI Agent), then select the created function in the Tool Call Allow List and grant access from the list.
Example Function
1 2 3 4 5 6 7 8 |
|
Following these steps ensures that the AI agent has the necessary permissions to interact with the designated function.
Example Script
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
|
JSDoc Notation
Using JSDoc for optimizing function usage within LLMs:
-
Provides clear descriptions of each function, parameter, and return type, making the purpose and behavior of LLM-related functions easy to understand.
-
Reduces confusion and errors.
-
With multiple developers working on an LLM project, JSDoc serves as a standardized way to share knowledge.
-
LLM will exactly know how to interact with the code (Scriptforge).
The function description must be brief, sharp, and accurate. Expanding it unnecessarily may create significant risks.
Call Transfer Techniques¶
Calls can be routed to another agent through two different transfer options.
-
Using the built-in
Transfer
function:- Select
Transfer
from the Advanced Built-in Functions tab. - Navigate to the Model tab and insert the given prompt in the Prompt section.
If requested you please call the transfer function with
input phone number
as the parameterdestination
.
Security Warning
Implementing this way will give the LLM the capability to transfer to ANY number. If a carefully executed instructions are passed to the LLM via a caller, it MAY be possible to encourage the LLM to dial a DIFFERENT number.
We would recommend against this method outside testing. Furthermore, it's highly advisable that the routing is additionally protected, to all additional layers of security.
See below for a recommended strategy to implement transfers.
- Select
-
Using Transfer function with Script Forge:
- Login to you account.
- Navigate to IDE ScriptForge.
- The script is as follows:
1 2 3 4 5 6 7 8
/** * Transfer * @param {Object} param - Param Object * @param {string} param.name - The name of the person who you wish to transfer the call to. */ function transfer() { return { action: 'transfer', destination: 'input phone number' } }
- Navigate to Class 5 AI Agent.
- In the Basic tab select the created transfer application from the dropdown in the App field.
- Navigate to the Advanced tab and select the created
transfer function
in the Tool Call Allow List.
How to Enable Reseller Billing for AI Agent Services?¶
Our AI Agent comes equipped with robust reseller capabilities. For instance, if you’ve created and assigned a package to a customer, you can associate their company with the AI Agent. Once this connection is in place, charges for using the AI Agent are automatically deducted. With the package already linked to your customer, managing reselling becomes effortless and efficient.
How does it work?
- Create a package under Setup Config Packages. Click on the blue
+
sign. - Enter the Name of the package (
Test123
in this example). - Enter cost in the Retail field.
- Select the ConnexCS Package like ConnexCS Converse, ConnexCS Converse Direct etc.
- Click
Save
. - Then Navigate to Management Customer Customer [Name] Packages. Click on the blue
+
sign. - Select the Package (
Test123
in this example), Quantity, Start Date, always enable Auto Decrement Credit. - Click
Save
.
Integrating Knowledge Base into Your AI Agent¶
- Create your AI Agent.
- A few more adjustments are needed:
- Select
Search Knowledge Base
from theBuilt-in Functions
option - Select your
Knowlegde Base
from theKnowledge Base
drop-down.
- Select
- Click
Save
.
Info
For the most accurate and helpful results from the integrated knowledge base, try phrasing your prompt like this:
Instructions
You can call the knowledge base only when you are required to and search for info that you require only
Only do one 1 lookup per human interaction.
Keep your replies short
List of available LLMs¶
01.AI¶
- 01.AI: Yi Large
- 01.AI: Yi Large FC
- 01.AI: Yi Large Turbo
- 01.AI: Yi Vision
AI21¶
- AI21: Jamba Large 1.7(Tools)
- AI21: Jamba Mini 1.7(Tools)
- AI21: Jamba 1.5 Large
- AI21: Jamba 1.5 Mini
- AI21: Jamba 1.6 Large
- AI21: Jamba Instruct
- AI21: Jamba Mini 1.6
Aetherwiing¶
- Aetherwiing: Starcannon 12B
Agentica¶
- Agentica: Deepcoder 14B Preview
- Agentica: Deepcoder 14B Preview (free)
AionLabs¶
- AionLabs: Aion-1.0
- AionLabs: Aion-1.0-Mini
- AionLabs: Aion-RP 1.0 (8B)
AlfredPros¶
- AlfredPros: CodeLLaMa 7B Instruct Solidity
AllenAI¶
- AllenAI: Molmo 7B D
- AllenAI: Olmo 2 32B Instruct
Amazon¶
- Amazon: Nova Lite 1.0(Tools)
- Amazon: Nova Micro 1.0(Tools)
- Amazon: Nova Pro 1.0(Tools)
Anthropic¶
- Anthropic: Claude 3 Haiku(Tools)
- Anthropic: Claude 3 Opus(Tools)
- Anthropic: Claude 3.5 Haiku(Tools)
- Anthropic: Claude 3.5 Haiku (2024-10-22)(Tools)
- Anthropic: Claude 3.5 Sonnet(Tools)
- Anthropic: Claude 3.5 Sonnet (2024-06-20)(Tools)
- Anthropic: Claude 3.7 Sonnet(Tools)
- Anthropic: Claude 3.7 Sonnet (thinking)(Tools)
- Anthropic: Claude Opus 4(Tools)
- Anthropic: Claude Opus 4.1(Tools)
- Anthropic: Claude Sonnet 4(Tools)
- Anthropic: Claude 3 Sonnet
- Anthropic: Claude Instant v1
- Anthropic: Claude Instant v1.0
- Anthropic: Claude Instant v1.1
- Anthropic: Claude v1
- Anthropic: Claude v1.2
- Anthropic: Claude v2
- Anthropic: Claude v2.0
- Anthropic: Claude v2.1
Arcee AI¶
- Arcee AI: Virtuoso Large(Tools)
- Arcee AI: Arcee Blitz
- Arcee AI: Caller Large
- Arcee AI: Coder Large
- Arcee AI: Maestro Reasoning
- Arcee AI: Spotlight
- Arcee AI: Virtuoso Medium V2
ArliAI¶
- ArliAI: QwQ 32B RpR v1
- ArliAI: QwQ 32B RpR v1 (free)
Baidu¶
- Baidu: ERNIE 4.5 21B A3B
- Baidu: ERNIE 4.5 300B A47B
- Baidu: ERNIE 4.5 VL 28B A3B
- Baidu: ERNIE 4.5 VL 424B A47B
Bytedance¶
- Bytedance: UI-TARS 72B
- Bytedance: UI-TARS 7B
Cohere¶
- Cohere: Command R(Tools)
- Cohere: Command R (03-2024)(Tools)
- Cohere: Command R (08-2024)(Tools)
- Cohere: Command R+(Tools)
- Cohere: Command R+ (04-2024)(Tools)
- Cohere: Command R+ (08-2024)(Tools)
- Cohere: Command
- Cohere: Command A
- Cohere: Command R7B (12-2024)
DI¶
- DI / Llama-3.3-70B-Instruct-Turbo(Tools)
- DI / Phi4 Multi-Modal Instruct(Tools)
Databricks¶
- Databricks: DBRX 132B Instruct
DeepSeek¶
- DeepSeek: DeepSeek V3 0324(Tools)
- DeepSeek: DeepSeek V3 0324 (free)(Tools)
- DeepSeek: DeepSeek V3.1(Tools)
- DeepSeek: DeepSeek Prover V2
- DeepSeek: Deepseek R1 0528 Qwen3 8B
- DeepSeek: Deepseek R1 0528 Qwen3 8B (free)
- DeepSeek: DeepSeek R1 Zero
- DeepSeek: DeepSeek V3
- DeepSeek: DeepSeek V3 Base
- DeepSeek: DeepSeek V3.1 (free)
- DeepSeek: DeepSeek V3.1 Base
- DeepSeek: R1
- DeepSeek: R1 (free)
- DeepSeek: R1 0528
- DeepSeek: R1 0528 (free)
- DeepSeek: R1 Distill Llama 70B
- DeepSeek: R1 Distill Llama 70B (free)
- DeepSeek: R1 Distill Llama 8B
- DeepSeek: R1 Distill Qwen 1.5B
- DeepSeek: R1 Distill Qwen 14B
- DeepSeek: R1 Distill Qwen 14B (free)
- DeepSeek: R1 Distill Qwen 32B
- DeepSeek: R1 Distill Qwen 7B
EleutherAI¶
- EleutherAI: Llemma 7b
Fireworks¶
- Fireworks: FireLLaVA 13B
G¶
- G / Llama 3.3 70b versatile(Tools)
- G / Meta llama/llama prompt guard 2 22m
- G / Qwen/qwen3 32b
- G / Allam 2 7b
- G / Moonshotai/kimi k2 instruct 0905
- G / Meta llama/llama 4 maverick 17b 128e instruct
- G / Llama 3.1 8b instant
- G / Whisper large v3 turbo
- G / Meta llama/llama prompt guard 2 86m
- G / Playai tts arabic
- G / Deepseek r1 distill llama 70b
- G / Openai/gpt oss 20b
- G / Gemma2 9b it
- G / Fast/compound mini
- G / Fast/compound
- G / Moonshotai/kimi k2 instruct
- G / Playai tts
- G / Whisper large v3
- G / Meta llama/llama 4 scout 17b 16e instruct
- G / Meta llama/llama guard 4 12b
- G / Openai/gpt oss 120b
Google¶
- Google: Gemini 1.5 Flash(Tools)
- Google: Gemini 1.5 Flash 8B(Tools)
- Google: Gemini 1.5 Pro(Tools)
- Google: Gemini 2.0 Flash(Tools)
- Google: Gemini 2.0 Flash Experimental (free)(Tools)
- Google: Gemini 2.0 Flash Lite(Tools)
- Google: Gemini 2.5 Flash(Tools)
- Google: Gemini 2.5 Flash Lite(Tools)
- Google: Gemini 2.5 Flash Lite Preview 06-17(Tools)
- Google: Gemini 2.5 Pro(Tools)
- Google: Gemini 2.5 Pro Experimental(Tools)
- Google: Gemini 2.5 Pro Preview 05-06(Tools)
- Google: Gemini 2.5 Pro Preview 06-05(Tools)
- Google: Gemini 1.5 Flash Experimental
- Google: Gemini 1.5 Pro Experimental
- Google: Gemini 2.5 Flash Image Preview
- Google: Gemini 2.5 Flash Image Preview (free)
- Google: Gemini 2.5 Flash Preview 04-17
- Google: Gemini 2.5 Flash Preview 05-20
- Google: Gemini Experimental 1114
- Google: Gemini Experimental 1121
- Google: Gemma 1 2B
- Google: Gemma 2 27B
- Google: Gemma 2 9B
- Google: Gemma 2 9B (free)
- Google: Gemma 3 12B
- Google: Gemma 3 12B (free)
- Google: Gemma 3 1B
- Google: Gemma 3 27B
- Google: Gemma 3 27B (free)
- Google: Gemma 3 4B
- Google: Gemma 3 4B (free)
- Google: Gemma 3n 2B (free)
- Google: Gemma 3n 4B
- Google: Gemma 3n 4B (free)
- Google: Gemma 7B
- Google: PaLM 2 Chat
- Google: PaLM 2 Chat 32k
- Google: PaLM 2 Code Chat
- Google: PaLM 2 Code Chat 32k
Hugging Face¶
- Hugging Face: Zephyr 7B
Inception¶
- Inception: Mercury(Tools)
- Inception: Mercury Coder(Tools)
Infermatic¶
- Infermatic: Mistral Nemo Inferor 12B
Inflatebot¶
- Inflatebot: Mag Mell R1 12B
Inflection¶
- Inflection: Inflection 3 Pi
- Inflection: Inflection 3 Productivity
LatitudeGames¶
- LatitudeGames: Wayfarer Large 70B Llama 3.3
Liquid¶
- Liquid: LFM 3B
- Liquid: LFM 40B MoE
- Liquid: LFM 7B
Lynn¶
- Lynn: Llama 3 Soliloquy 7B v3 32K
- Lynn: Llama 3 Soliloquy 8B v2
Mancer¶
- Mancer: Weaver (alpha)
Meta¶
- Meta: Llama 3 70B Instruct(Tools)
- Meta: Llama 3 8B Instruct(Tools)
- Meta: Llama 3.1 405B Instruct(Tools)
- Meta: Llama 3.1 70B Instruct(Tools)
- Meta: Llama 3.1 8B Instruct(Tools)
- Meta: Llama 3.3 70B Instruct(Tools)
- Meta: Llama 3.3 70B Instruct (free)(Tools)
- Meta: Llama 3.3 8B Instruct (free)(Tools)
- Meta: Llama 4 Maverick (free)(Tools)
- Meta: Llama 4 Scout(Tools)
- Meta: Llama 4 Scout (free)(Tools)
- Meta: CodeLlama 34B Instruct
- Meta: CodeLlama 70B Instruct
- Meta: Llama 2 13B Chat
- Meta: Llama 2 70B Chat
- Meta: Llama 3 70B (Base)
- Meta: Llama 3 8B (Base)
- Meta: Llama 3.1 405B (base)
- Meta: Llama 3.1 405B Instruct (free)
- Meta: Llama 3.2 11B Vision Instruct
- Meta: Llama 3.2 1B Instruct
- Meta: Llama 3.2 3B Instruct
- Meta: Llama 3.2 3B Instruct (free)
- Meta: Llama 3.2 90B Vision Instruct
- Meta: Llama 4 Maverick
- Meta: Llama Guard 4 12B
- Meta: LlamaGuard 2 8B
Microsoft¶
- Microsoft: Phi-3 Medium 128K Instruct(Tools)
- Microsoft: Phi-3 Mini 128K Instruct(Tools)
- Microsoft: Phi-3.5 Mini 128K Instruct(Tools)
- Microsoft: MAI DS R1
- Microsoft: MAI DS R1 (free)
- Microsoft: Phi 4
- Microsoft: Phi 4 Multimodal Instruct
- Microsoft: Phi 4 Reasoning
- Microsoft: Phi 4 Reasoning Plus
- Microsoft: Phi-3 Medium 4K Instruct
MiniMax¶
- MiniMax: MiniMax M1
- MiniMax: MiniMax-01
Mistral¶
- Mistral: Codestral 2501(Tools)
- Mistral: Codestral 2508(Tools)
- Mistral: Devstral Medium(Tools)
- Mistral: Devstral Small 2505(Tools)
- Mistral: Devstral Small 2505 (free)(Tools)
- Mistral: Magistral Medium 2506(Tools)
- Mistral: Magistral Medium 2506 (thinking)(Tools)
- Mistral: Magistral Small 2506(Tools)
- Mistral: Ministral 8B(Tools)
- Mistral: Mistral 7B Instruct(Tools)
- Mistral: Mistral 7B Instruct (free)(Tools)
- Mistral: Mistral 7B Instruct v0.3(Tools)
- Mistral: Mistral Medium 3(Tools)
- Mistral: Mistral Medium 3.1(Tools)
- Mistral: Mistral Small 3.1 24B(Tools)
- Mistral: Mistral Small 3.1 24B (free)(Tools)
- Mistral: Mistral Small 3.2 24B (free)(Tools)
- Mistral: Mixtral 8x22B Instruct(Tools)
- Mistral: Mixtral 8x7B Instruct(Tools)
- Mistral: Pixtral Large 2411(Tools)
- Mistral: Saba(Tools)
- Mistral: Codestral Mamba
- Mistral: Devstral Small 1.1
- Mistral: Ministral 3B
- Mistral: Mistral 7B Instruct v0.1
- Mistral: Mistral 7B Instruct v0.2
- Mistral: Mistral Nemo
- Mistral: Mistral Nemo (free)
- Mistral: Mistral Small 3
- Mistral: Mistral Small 3 (free)
- Mistral: Mistral Small 3.2 24B
- Mistral: Mixtral 8x22B (base)
- Mistral: Pixtral 12B
MoonshotAI¶
- MoonshotAI: Kimi K2 (free)(Tools)
- MoonshotAI: Kimi Dev 72B
- MoonshotAI: Kimi Dev 72B (free)
- MoonshotAI: Kimi K2
- MoonshotAI: Kimi VL A3B Thinking
- MoonshotAI: Kimi VL A3B Thinking (free)
- MoonshotAI: Moonlight 16B A3B Instruct
Morph¶
- Morph: Fast Apply
- Morph: Morph V3 Fast
- Morph: Morph V3 Large
NVIDIA¶
- NVIDIA: Llama 3.1 Nemotron 70B Instruct(Tools)
- NVIDIA: Llama 3.1 Nemotron Nano 8B v1
- NVIDIA: Llama 3.1 Nemotron Ultra 253B v1
- NVIDIA: Llama 3.1 Nemotron Ultra 253B v1 (free)
- NVIDIA: Llama 3.3 Nemotron Super 49B v1
- NVIDIA: Nemotron-4 340B Instruct
NeverSleep¶
- NeverSleep: Llama 3 Lumimaid 70B
- NeverSleep: Llama 3 Lumimaid 8B
- NeverSleep: Lumimaid v0.2 70B
- NeverSleep: Lumimaid v0.2 8B
Nous¶
- Nous: Hermes 4 405B(Tools)
- Nous: Hermes 4 70B(Tools)
- Nous: Capybara 34B
- Nous: Capybara 7B
- Nous: DeepHermes 3 Llama 3 8B Preview (free)
- Nous: DeepHermes 3 Mistral 24B Preview
- Nous: Hermes 13B
- Nous: Hermes 2 Mistral 7B DPO
- Nous: Hermes 2 Mixtral 8x7B DPO
- Nous: Hermes 2 Mixtral 8x7B SFT
- Nous: Hermes 2 Theta 8B
- Nous: Hermes 2 Vision 7B (alpha)
- Nous: Hermes 2 Yi 34B
- Nous: Hermes 3 405B Instruct
- Nous: Hermes 3 70B Instruct
- Nous: Hermes 70B
NousResearch¶
- NousResearch: Hermes 2 Pro - Llama-3 8B
OpenAI¶
- OpenAI: Codex Mini(Tools)
- OpenAI: GPT-3.5 Turbo(Tools)
- OpenAI: GPT-3.5 Turbo (older v0613)(Tools)
- OpenAI: GPT-3.5 Turbo 16k(Tools)
- OpenAI: GPT-4(Tools)
- OpenAI: GPT-4 (older v0314)(Tools)
- OpenAI: GPT-4 Turbo(Tools)
- OpenAI: GPT-4 Turbo (older v1106)(Tools)
- OpenAI: GPT-4 Turbo Preview(Tools)
- OpenAI: GPT-4.1(Tools)
- OpenAI: GPT-4.1 Mini(Tools)
- OpenAI: GPT-4.1 Nano(Tools)
- OpenAI: GPT-4o(Tools)
- OpenAI: GPT-4o (2024-05-13)(Tools)
- OpenAI: GPT-4o (2024-08-06)(Tools)
- OpenAI: GPT-4o (2024-11-20)(Tools)
- OpenAI: GPT-4o (extended)(Tools)
- OpenAI: GPT-4o Audio(Tools)
- OpenAI: GPT-4o-mini(Tools)
- OpenAI: GPT-4o-mini (2024-07-18)(Tools)
- OpenAI: GPT-5(Tools)
- OpenAI: GPT-5 Mini(Tools)
- OpenAI: GPT-5 Nano(Tools)
- OpenAI: o1(Tools)
- OpenAI: o3(Tools)
- OpenAI: o3 Mini(Tools)
- OpenAI: o3 Mini High(Tools)
- OpenAI: o3 Pro(Tools)
- OpenAI: o4 Mini(Tools)
- OpenAI: o4 Mini High(Tools)
- OpenAI: ChatGPT-4o
- OpenAI: GPT-3.5 Turbo (older v0301)
- OpenAI: GPT-3.5 Turbo 16k
- OpenAI: GPT-3.5 Turbo 16k (older v1106)
- OpenAI: GPT-3.5 Turbo Instruct
- OpenAI: GPT-4 32k
- OpenAI: GPT-4 32k (older v0314)
- OpenAI: GPT-4 Vision
- OpenAI: GPT-4.5 (Preview)
- OpenAI: GPT-4o Search Preview
- OpenAI: GPT-4o-mini Search Preview
- OpenAI: GPT-5 Chat
- OpenAI: gpt-oss-120b
- OpenAI: gpt-oss-120b (free)
- OpenAI: gpt-oss-20b
- OpenAI: gpt-oss-20b (free)
- OpenAI: o1-mini
- OpenAI: o1-mini (2024-09-12)
- OpenAI: o1-preview
- OpenAI: o1-preview (2024-09-12)
- OpenAI: o1-pro
OpenGVLab¶
- OpenGVLab: InternVL3 14B
- OpenGVLab: InternVL3 2B
Other¶
- Mistral Large(Tools)
- Mistral Large 2407(Tools)
- Mistral Large 2411(Tools)
- Mistral Small(Tools)
- Mistral Tiny(Tools)
- No Tools
- Airoboros 70B
- Auto Router
- Bagel 34B v0.2
- Chronos Hermes 13B v2
- Cinematika 7B (alpha)
- Cypher Alpha
- DeepSeek V2.5
- Dolphin 2.6 Mixtral 8x7B 🐬
- Dolphin 2.9.2 Mixtral 8x22B 🐬
- Dolphin Llama 3 70B 🐬
- Dolphin3.0 Mistral 24B
- Dolphin3.0 Mistral 24B (free)
- Dolphin3.0 R1 Mistral 24B
- Dolphin3.0 R1 Mistral 24B (free)
- EVA Llama 3.33 70B
- EVA Qwen2.5 14B
- EVA Qwen2.5 32B
- EVA Qwen2.5 72B
- Fimbulvetr 11B v2
- Goliath 120B
- Horizon Alpha
- Horizon Beta
- Llama 3.1 Tulu 3 405B
- Llama Guard 3 8B
- LLaVA 13B
- LLaVA v1.6 34B
- lzlv 70B
- Magnum 72B
- Magnum v2 72B
- Magnum v4 72B
- Midnight Rose 70B
- Mistral Medium
- Mistral Nemo 12B Celeste
- Mistral OpenOrca 7B
- MythoMax 13B
- MythoMist 7B
- Neural Chat 7B v3.1
- Noromaid 20B
- Noromaid Mixtral 8x7B Instruct
- OLMo 7B Instruct
- OlympicCoder 32B
- OpenChat 3.5 7B
- OpenChat 3.6 8B
- OpenHands LM 32B V0.1
- OpenHermes 2 Mistral 7B
- OpenHermes 2.5 Mistral 7B
- Optimus Alpha
- Psyfighter 13B
- Psyfighter v2 13B
- Qrwkv 72B
- Quasar Alpha
- Qwen 1.5 110B Chat
- Qwen 1.5 14B Chat
- Qwen 1.5 32B Chat
- Qwen 1.5 4B Chat
- Qwen 1.5 72B Chat
- Qwen 1.5 7B Chat
- Qwen 2 72B Instruct
- Qwen 2 7B Instruct
- Qwen2.5 72B Instruct
- Qwen2.5 72B Instruct (free)
- Qwen2.5 7B Instruct
- Qwen2.5 Coder 32B Instruct
- Qwen2.5 Coder 32B Instruct (free)
- Reflection 70B
- ReMM SLERP 13B
- RWKV v5 3B AI Town
- RWKV v5 World 3B
- SorcererLM 8x22B
- StarCoder2 15B Instruct
- StripedHyena Hessian 7B (base)
- StripedHyena Nous 7B
- Switchpoint Router
- Synthia 70B
- Toppy M 7B
- Typhoon2 70B Instruct
- Typhoon2 8B Instruct
- WizardLM-2 7B
- WizardLM-2 8x22B
- Xwin 70B
- Yi 1.5 34B Chat
- Yi 34B (base)
- Yi 34B 200K
- Yi 34B Chat
- Yi 6B (base)
- Zephyr 141B-A35B
Perplexity¶
- Perplexity: Llama 3.1 Sonar 70B Online
- Perplexity: Llama 3.1 Sonar 8B Online
- Perplexity: Llama3 Sonar 70B
- Perplexity: Llama3 Sonar 70B Online
- Perplexity: Llama3 Sonar 8B
- Perplexity: Llama3 Sonar 8B Online
- Perplexity: R1 1776
- Perplexity: Sonar
- Perplexity: Sonar Deep Research
- Perplexity: Sonar Pro
- Perplexity: Sonar Reasoning
- Perplexity: Sonar Reasoning Pro
Phind¶
- Phind: CodeLlama 34B v2
Pygmalion¶
- Pygmalion: Mythalion 13B
Qwen¶
- Qwen: Qwen-Max(Tools)
- Qwen: Qwen-Plus(Tools)
- Qwen: Qwen-Turbo(Tools)
- Qwen: Qwen3 14B(Tools)
- Qwen: Qwen3 235B A22B(Tools)
- Qwen: Qwen3 235B A22B (free)(Tools)
- Qwen: Qwen3 235B A22B Thinking 2507(Tools)
- Qwen: Qwen3 30B A3B Instruct 2507(Tools)
- Qwen: Qwen3 30B A3B Thinking 2507(Tools)
- Qwen: Qwen3 4B (free)(Tools)
- Qwen: Qwen3 Coder 30B A3B Instruct(Tools)
- Qwen: Qwen3 Coder 480B A35B(Tools)
- Qwen: Qwen3 Coder 480B A35B (free)(Tools)
- Qwen: Qwen VL Max
- Qwen: Qwen VL Plus
- Qwen: Qwen2.5 32B Instruct
- Qwen: Qwen2.5 Coder 7B Instruct
- Qwen: Qwen2.5 VL 32B Instruct
- Qwen: Qwen2.5 VL 32B Instruct (free)
- Qwen: Qwen2.5 VL 3B Instruct
- Qwen: Qwen2.5 VL 72B Instruct
- Qwen: Qwen2.5 VL 72B Instruct (free)
- Qwen: Qwen2.5-VL 7B Instruct
- Qwen: Qwen3 0.6B
- Qwen: Qwen3 1.7B
- Qwen: Qwen3 14B (free)
- Qwen: Qwen3 235B A22B Instruct 2507
- Qwen: Qwen3 30B A3B
- Qwen: Qwen3 30B A3B (free)
- Qwen: Qwen3 32B
- Qwen: Qwen3 8B
- Qwen: Qwen3 8B (free)
- Qwen: QwQ 32B
- Qwen: QwQ 32B (free)
- Qwen: QwQ 32B Preview
RWKV v5¶
- RWKV v5: Eagle 7B
Reka¶
- Reka: Flash 3 (free)
SW¶
- SW / Llama 3.3 70b Instruct(Tools)
Sao10K¶
- Sao10K: Llama 3 8B Lunaris
- Sao10K: Llama 3 Stheno 8B v3.3 32K
- Sao10K: Llama 3.1 70B Hanami x1
- Sao10K: Llama 3.1 Euryale 70B v2.2
- Sao10K: Llama 3.3 Euryale 70B
Sao10k¶
- Sao10k: Llama 3 Euryale 70B v2.1
Sarvam AI¶
- Sarvam AI: Sarvam-M
SentientAGI¶
- SentientAGI: Dobby Mini Plus Llama 3.1 8B
Shisa AI¶
- Shisa AI: Shisa V2 Llama 3.3 70B
- Shisa AI: Shisa V2 Llama 3.3 70B (free)
Snowflake¶
- Snowflake: Arctic Instruct
SteelSkull¶
- SteelSkull: L3.3 Electra R1 70B
Swallow¶
- Swallow: Llama 3.1 Swallow 8B Instruct V0.3
THUDM¶
- THUDM: GLM 4 32B
- THUDM: GLM 4 9B
- THUDM: GLM 4.1V 9B Thinking
- THUDM: GLM Z1 32B
- THUDM: GLM Z1 9B
- THUDM: GLM Z1 Rumination 32B
TNG¶
- TNG: DeepSeek R1T Chimera
- TNG: DeepSeek R1T Chimera (free)
- TNG: DeepSeek R1T2 Chimera (free)
Tencent¶
- Tencent: Hunyuan A13B Instruct
- Tencent: Hunyuan A13B Instruct (free)
TheDrummer¶
- TheDrummer: Rocinante 12B(Tools)
- TheDrummer: UnslopNemo 12B(Tools)
- TheDrummer: Anubis 70B V1.1
- TheDrummer: Anubis Pro 105B V1
- TheDrummer: Skyfall 36B V2
- TheDrummer: Valkyrie 49B V1
Venice¶
- Venice: Uncensored (free)
Z.AI¶
- Z.AI: GLM 4 32B(Tools)
- Z.AI: GLM 4.5(Tools)
- Z.AI: GLM 4.5 Air(Tools)
- Z.AI: GLM 4.5V(Tools)
- Z.AI: GLM 4.5 Air (free)
xAI¶
- xAI: Grok 2 1212(Tools)
- xAI: Grok 3(Tools)
- xAI: Grok 3 Beta(Tools)
- xAI: Grok 3 Mini(Tools)
- xAI: Grok 3 Mini Beta(Tools)
- xAI: Grok 4(Tools)
- xAI: Grok Code Fast 1(Tools)
- xAI: Grok 2
- xAI: Grok 2 mini
- xAI: Grok 2 Vision 1212
- xAI: Grok Beta
- xAI: Grok Vision Beta