Use Salesforce and Other Premium Models

Dev Assistant supports multiple models to improve code generation quality and accuracy of Salesforce-related answers. Our architecture enables integration of both Salesforce-hosted models and premium third-party models, with automatic model selection. Model selection defaults to a Salesforce-hosted model after certain number of requests or when token limit is reached. Multi-model architecture offers these benefits:

• Higher quality code generation and Salesforce-specific guidance.
• Cost optimization through tiered model access.
• Maintained trust with default routing through Einstein Trust Layer.
• Architecture that can adapt as LLM technology evolves.

Users have access to Salesforce-hosted models. Third party models are available up to specified token or request limits; when these limits are reached, the system automatically falls back to Salesforce-hosted models. Limits are per org, and available tokens reset after a pre-defined time.

Anthropic models on Amazon are operated on Amazon Bedrock infrastructure entirely within the Salesforce Trust Boundary. In contrast, other models are operated by Salesforce partners, inside a shared trust zone.