Get an access key

https://auth.getplum.ai

Sign up here to get a Plum AI API key.

Call the Plum AI - API

Recommended to use Postman

Instead of running curl commands, you can also use the API via the Postman interface.

We recommend Postman over curl.

Step 1: Upload your data

All you need to get started is:

1. The system prompt you’ve been using
2. User prompts (inputs) you’ve sent to the LLM
3. Outputs that the LLM has returned

curl -H "Authorization: YOUR_KEY_HERE" -d '{"data":[{"input":"THE FIRST USER PROMPT HERE", "output":"THE FIRST LLM RESPONSE HERE"},
{"input":"ANOTHER USER PROMPT HERE", "output":"THE SECOND LLM RESPONSE HERE"}], "system_prompt":"YOUR SYSTEM PROMPT HERE"}' beta.getplum.ai/v1/data/seed

You will get a dataset ID in the response. Keep it somewhere safe because you’ll need it later.

Step 2: Generate metric definitions based on your system prompt

The ability to evaluate your model comes from well-defined metrics. Plum creates criteria based on your business use case, which it then uses to score the model.

curl -H "Authorization: YOUR_KEY_HERE" -d '{"system_prompt":"YOUR SYSTEM PROMPT GOES HERE"}' beta.getplum.ai/v1/questions

Keep the metrics ID in the response somewhere safe. You’ll need it in the next step.