Summary
You (as a Planhat admin) can connect your own AI credentials (OpenAI, Azure, Anthropic/Claude, Gemini, etc.) to power Planhat's AI capabilities - including Pi - instead of, or alongside, Planhat's managed models
This gives your organization control over AI infrastructure and data governance, for control and compliance
You can select your choice of model for "Speed" and "Advanced" AI tasks within the AI Governance Hub. You will first need to add your AI credentials as connections within the Settings Tool
Who is this article for?
Anyone who would like to learn about BYOM/BYOLLM capabilities in Planhat OS, including for Pi
It's particularly relevant to admins/builders (e.g. Ops) who configure their Planhat tenant for their organization
Related articles
Other articles particularly relevant to this article are:
Article contents
What is "bring your own LLM" (BYOLLM) / "bring your own model" (BYOM) in Planhat OS?
You (as an admin within your Planhat tenant) can choose which AI models are used for "Speed" (quick/simple) and "Advanced" (more complex) tasks within your Planhat tenant (i.e. across your organization).
In many Planhat tenants, these two settings are left as the default "Planhat", which means that Planhat/Pi will automatically apply the most appropriate model, using Planhat's own LLM connections (Planhat's managed models).
However, some enterprises may want to use their own LLM connections, for control and compliance.
You select your choice of model within the "AI Governance Hub" in the Agents Module (Agents Tool). The settings are called "Model selection", under the "Model configuration" heading.
You need to have set up your AI connections in the "Connections" part of the Settings Tool for you to select them as your models. Your own AI provider can be OpenAI, Azure, Anthropic/Claude, Gemini, etc.
📌 Important to note
AI models in BYOM are not to be confused with Planhat data models (Company, End User, and so on), which is a separate concept.
Which Planhat AI features do these settings apply to?
Your AI model selection here affects AI functionality across your Planhat OS tenant:
Pi - Planhat's built-in AI Agent that you chat to in Sessions, and that can create Automation Agents for you in the Agents Module
Why select your own LLM/model instead of using the default Planhat settings?
In many cases, leaving these settings on the default "Planhat" is the appropriate choice.
Nevertheless, some enterprise organizations or security teams prefer to use their own LLM connection. The ability to choose your own AI provider gives you control over your AI infrastructure and data governance.
Bringing your own LLM (AI connection) can also reduce the usage of Planhat AI credits, which are consumed when you carry out certain actions within Planhat. However, it's important to note that even if you BYOLLM, using Pi will still consume "Pi Answers" - we discuss this more next.
Credits/cost implications for Pi
Background context
Pi gives you the ability to chat with AI in Sessions. Your User Type determines the number of "Pi Answers" available. The number of available Pi Answers resets daily. Simple queries are free - they don't count as part of the Pi Answers allowance.
The AI credits and Automation credits that are consumed in Custom Automations are separate from Pi - these credits are not used by Pi.
Pi and BYOLLM
Even if you BYOLLM, when you carry out complex tasks using Pi, this will consume Pi Answers.
It's important to note that the "cost" of Pi is more than simply AI token processing. On top of connecting to different LLM providers, Pi includes a large amount of complex structure - reasoning etc. - built by Planhat on top of this starting point. Pi is an entire "harness" around the raw LLM - this proprietary "scaffolding" is what makes Pi so powerful. The tool orchestration, process understanding, logic, and so on, is the majority of the value.
Raw token cost is a minority of what is delivered with Pi. Planhat is delivering specialized intelligence, not reselling AI tokens.
How to set up BYOLLM/BYOM
There are two stages to this:
Here we'll actually start by explaining stage 2, so you are familiar with the BYOLLM/BYOM settings that are the focus of this article, and then we will go back to stage 1 and show you where you set up connections in Planhat OS.
📌 Important to note
These steps are to be carried out by a Planhat admin (a user with the Administrator Role and associated permissions), rather than general users within your tenant
These settings are configured per tenant, not per user
Choosing models in the "AI Governance Hub"
📌 Important to note
At time of writing, access to these settings is controlled by a feature flag, so speak to your Planhat representative if you need help with this. Also, your Role needs the "Admin Access" workflow permission to view these settings.
At the top of the Agents Module (also called the Agents Tool), you will see a part call called "Governance" (formerly called "Analytics").
Mouse over this, and click on the "More" that appears.
This opens up a panel on the right-hand side. (You can click the "x" in the top right of the main Agents Module to close that panel so that the configuration panel has more space.)
In this article, we're focusing on the "Model selection" settings, which you'll find under the "Model configuration" heading, as you can see annotated in the screenshot above.
Clicking on "Model selection" to open up this setting, you'll see there are two dropdown menus where you can select an AI model. The default is "Planhat", but you can change either or both of these to your choice of model.
📌 Important to note
Remember, BYO models being selected here need to be first configured as connections. We will show you where you set this up in Planhat OS next in this article.
🚀 Tip
By default, you will see "Planhat" selected for both "Speed" and "Advanced".
If you leave the settings as "Planhat", this means the AI features will use Planhat's AI connections, rather than your own. Planhat will automatically select the most appropriate AI model for each task being carried out.
You can select your own LLM/model for both or either of these.
"Speed"
Here you pick a model optimized for high-volume and relatively simple tasks at a reasonable cost, such as Conversation classification.
Model requirements: at least a 250K-token context window, support for thinking/reasoning mode, and support for structured (strict) JSON responses.
"Advanced"
Here you select a model optimized for complex tasks that require more intelligence, such as using Pi to generate HTML artifacts or Custom Automations.
Model requirements: support for tool/function calling, in addition to all requirements listed above for the Speed model. A frontier model is recommended here for the best results.
Where to set up connections in Planhat OS
AI models being selected in these dropdown menus need to be first configured as connections - this is where you connect Planhat to your own external LLM.
To navigate to the connections part of Planhat OS:
Open the "Settings" Tool (which you may have pinned, or otherwise you can access via the main Tools menu (under "More")
Click the image to view it enlarged
Click on "Connections & Integrations"
Click on "Connections & Integrations" again
Click on "Connections"
To add a new connection, click "+ New connection", and select the appropriate service provider
Complete the form that opens up
Frequently Asked Questions (FAQs)
Q: Can I do BYOM (bring your own model) or BYOLLM (bring your own LLM) for Pi?
A: Yes - you can select your own LLM/model in the AI Governance Hub, and this applies to Pi as well as other AI features in Planhat OS
Q: If I select my own AI connection (LLM/model), does that mean no credits ("Pi Answers") will be consumed for Pi?
A: No - this is because most of the value of Pi comes from the Planhat-built proprietary "harness" built on top of the raw AI connection
Q: Can any/all Planhat user set up BYOM/BYOLLM?
A: No - this is to be set up by a Planhat admin - general users are not expected to have sufficient Role permissions to access these settings
Q: Are BYOM/BYOLLM setting configured per Planhat user?
A: No, they are per tenant (organization)
[Tags for search purposes: BYO LLM, BYO-LLM]










