Query Agents via SDK

Learn how to efficiently query and retrieve agents using the Maxim SDK, enabling advanced AI workflow management and customization

All Python code snippets in this document are for version 3.4.0+.

Setting Up the SDK

Initializing the SDK

JS/TS

import { Maxim } from "@maximai/maxim-js";

const maxim = new Maxim({ apiKey: "" });

Working with Deployment Variables

For a prompt chain with specific deployment variables

For building query to get prompt chain with specific deployment variables, you can use QueryBuilder.

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const promptChain = await maxim.getPromptChain("prompt-chain-id",
					new QueryBuilder()
						.and()
						.deploymentVar("Environment", "prod")
						.build()});

Adding Multiple Queries

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const promptChain = await maxim.getPromptChain(
	"prompt-chain-id",
	new QueryBuilder().and().deploymentVar("Environment", "prod").deploymentVar("CustomerId", "123").build(),
);

Querying Prompts Chains

Sometimes you have usescases where you need to fetch multiple deployed prompt chains at once using a single query. For example, you might want to fetch all prompts for a specific customer or specific workflow. You can use getPromptChains function for this purpose.

You will need to query using at-least one deploymentVar as a filter. Hence you will need to deploy prompt chain versions before querying them.

Query deployed prompt chains using folder

To get all prompts from a folder, you can use getPromptChains function with folderId as a query parameter.

First capture folder id

There are multiple ways to capture folder id. You can use Maxim dashboard to get folder id.

1. Right click/click on three dots on the folder you want to get id for.
2. Select Edit Folder option.
3. You will see folder id in the form.

JS/TS

import { Maxim } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const folder = await maxim.getFolderById("folder-id");

Getting Folders by Tags

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const folders = await maxim.getFolders(new QueryBuilder().and().tag("CustomerId", "123").build());

All the rules of prompt chain matching algorithm apply here. You can use same overriding techniques as explained above.

Retrieving Deployed Prompts from a Folder

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const folder = await maxim.getFolderById("folder-id");
const promptChains = await maxim.getPromptChains(
	new QueryBuilder()
	.and()
	.folder(folder.id)
	.deploymentVar("Environment", "prod")
	.build(),
);

Filtering Prompt Chains by Deployment Variables

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const folder = await maxim.getFolderById("folder-id");
const promptChains = await maxim.getPromptChains(
		new QueryBuilder()
		.and()
		.folder(folder.id)
		.deploymentVar("Environment", "prod")
		.build());

You have to pass at-least one filter along with folder().

Data Structures

Prompt Chain Structure

JS/TS

export type PromptChain = {
	promptChainId: string;
	version: number;
	versionId: string;
	nodes: ({ order: number } & PromptNode)[];
};
// Prompt node
export type PromptNode = {
	prompt: Prompt;
};
// Prompt
export type Prompt = {
	promptId: string;
	version: number;
	versionId: string;
	messages: { role: string; content: string | CompletionRequestContent[] }[];
	modelParameters: { [key: string]: any };
	model: string;
	tags: PromptTags;
};

Folder Structure

JS/TS

export type Folder = {
	id: string;
	name: string;
	parentFolderId?: string;
	tags: { [key: string]: string };
};

Caching

Using Custom Cache Implementation

Maxim SDK uses in-memory caching by default. You can use your own caching implementation by passing a custom cache object to the SDK. This allows you to remove complete dependency on our backend.

Cache Interface Definition

JS/TS

export interface MaximCache {
	getAllKeys(): Promise<string[]>;
	get(key: string): Promise<string | null>;
	set(key: string, value: string): Promise<void>;
	delete(key: string): Promise<void>;
}

Implementing Custom Cache

JS/TS

import { Maxim } from "@maximai/maxim-js";

const maxim = new Maxim({ apiKey: "api-key", cache: new CustomCache() });

Default In-Memory Cache Implementation

JS/TS

import { MaximCache } from "@maximai/maxim-js";

export class MaximInMemoryCache implements MaximCache {
	private cache: Map<string, string> = new Map();

	getAllKeys(): Promise<string[]> {
		return Promise.resolve(Array.from(this.cache.keys()));
	}

	get(key: string): Promise<string | null> {
		return Promise.resolve(this.cache.get(key) || null);
	}
	set(key: string, value: string): Promise<void> {
		this.cache.set(key, value);
		return Promise.resolve();
	}
}

Matching Algorithm

Before going into the details of how to use the SDK, let’s understand how the matching algorithm works. Maxim SDK uses best matching entity algorithm.

1. Let’s assume that, you have asked for a prompt chain with deployment var env as prod, customerId as "123" and a tag, tenantId as 456 for promptId - "abc".
2. SDK will first try to find a prompt chain matching all conditions.
3. If we don’t find any matching entity, we enforce only deploymentVar conditions (you can override this behaviour, as explained in the next section) and match as many tags as possible.
4. If we still don’t find any prompt chain, we check for a prompt chain version marked as fallback.
5. If we still don’t find any prompt chain, we return null.

Overriding Matching Algorithm

Enforcing Exact Matches

JS/TS

import { QueryBuilder } from "@maximai/maxim-js;

const promptChain = await maxim.getPromptChain(
	"prompt-chain-id",
	new QueryBuilder().and().deploymentVar("Environment", "prod").exactMatch().build(),
);

Variable-Level Overrides

JS/TS

import { Maxim, QueryBuilder } from "@maximai/maxim-js;

const maxim = new Maxim({ apiKey: "" });

const promptChain = await maxim.getPromptChain("prompt-id", new QueryBuilder().and().deploymentVar("Environment", "prod").build());