Skip to main content
You can use our API to send individual queries or have long-running conversations with chat models. You do not need to configure a system prompt for claim normalization tasks or even regular chat queries. Our backend API endpoints are configured with our custom system prompts to handle both generic and claim normalization tasks. Queries run against a model of your choice. You are welcome to use any model from multiple providers.

Available Models

Retrieve a list of available models using the client.models.list() method:
Models List Response

Non-Streaming Responses

Use non-streaming responses for standard chat interactions where you want to receive the complete response at once:

Response Structure

Streaming Responses

Use streaming responses for real-time chat experiences where you want to display text as it’s generated:

Synchronous Streaming

Asynchronous Streaming

Streaming Response Format

Streaming Chunk Example
Streaming Benefits: Streaming responses provide better user experience for long-form content, allow for real-time interaction, and can reduce perceived latency in chat applications.
Memory Management: When using streaming, especially with async operations, ensure you properly close clients and handle exceptions to prevent memory leaks.