AWS Bedrock

Overview

AWS Bedrock is a managed service that provides access to foundation models from Amazon, Anthropic, Meta, Mistral, and others through a unified API. Floopy supports Bedrock via custom base URL configuration, allowing you to route requests through your own Bedrock endpoint.

Setup

Bedrock requires a custom base URL because each AWS account has a unique endpoint based on region and account ID.

1. Go to Settings > Providers in the dashboard.
2. Click Add provider and select AWS Bedrock.
3. Enter your Bedrock endpoint URL (e.g., https://bedrock-runtime.us-east-1.amazonaws.com).
4. Paste your AWS credentials and click Save.

Supported Models

Models available depend on your AWS account’s Bedrock model access. Common models include:

Usage

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.floopy.ai/v1",
  apiKey: process.env.FLOOPY_API_KEY,
});

const response = await client.chat.completions.create({
  model: "anthropic.claude-3-5-sonnet-20241022-v2:0",
  messages: [{ role: "user", content: "Explain quantum computing." }],
});

from openai import OpenAI

client = OpenAI(base_url="https://api.floopy.ai/v1", api_key=os.environ["FLOOPY_API_KEY"])

response = client.chat.completions.create(
    model="anthropic.claude-3-5-sonnet-20241022-v2:0",
    messages=[{"role": "user", "content": "Explain quantum computing."}],
)

curl https://api.floopy.ai/v1/chat/completions \
  -H "Authorization: Bearer $FLOOPY_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "anthropic.claude-3-5-sonnet-20241022-v2:0", "messages": [{"role": "user", "content": "Explain quantum computing."}]}'

Provider-Specific Features

• Custom base URL — Your Bedrock endpoint is configured per-organization in provider settings.
• Multi-provider access — Access models from Anthropic, Meta, Mistral, Amazon, and others through a single Bedrock configuration.
• AWS integration — Leverage existing AWS IAM roles, VPC endpoints, and compliance controls.
• Region selection — Choose the AWS region closest to your infrastructure for lowest latency.