Using AWS Bedrock With Kilo Code

Kilo Code supports accessing models through Amazon Bedrock, a fully managed service that makes a selection of high-performing foundation models (FMs) from leading AI companies available via a single API. This provider connects directly to AWS Bedrock and authenticates with the provided credentials.

Website: https://aws.amazon.com/bedrock/

Prerequisites

• AWS Account: You need an active AWS account.
• Bedrock Access: You must request and be granted access to Amazon Bedrock. See the AWS Bedrock documentation for details on requesting access.
• Model Access: Within Bedrock, you need to request access to the specific models you want to use (e.g., Anthropic Claude).
• Install AWS CLI: Use AWS CLI to configure your account for authentication

   aws configure
  

Getting Credentials

You have three options for configuring AWS credentials:

1. Bedrock API Key:
   • Create a Bedrock-specific API key in the AWS Console. This is a simple service-specific authentication method.
   • See the AWS documentation on Bedrock credentials for instructions on creating an API key.
2. AWS Access Keys (Recommended for Development):
   • Create an IAM user with the necessary permissions (at least bedrock:InvokeModel).
   • Generate an access key ID and secret access key for that user.
   • (Optional) Create a session token if required by your IAM configuration.
3. AWS Profile:
   • Configure an AWS profile using the AWS CLI or by manually editing your AWS credentials file. See the AWS CLI documentation for details.

Configuration in Kilo Code

1. Open Kilo Code Settings: Click the gear icon () in the Kilo Code panel.
2. Select Provider: Choose "Bedrock" from the "API Provider" dropdown.
3. Select Authentication Method:
   • Bedrock API Key:
     • Enter your Bedrock API key directly. This is the simplest setup option.
   • AWS Credentials:
     • Enter your "AWS Access Key" and "AWS Secret Key."
     • (Optional) Enter your "AWS Session Token" if you're using temporary credentials.
   • AWS Profile:
     • Enter your "AWS Profile" name (e.g., "default").
4. Select Region: Choose the AWS region where your Bedrock service is available (e.g., "us-east-1").
5. (Optional) Cross-Region Inference: Check "Use cross-region inference" if you want to access models in a region different from your configured AWS region.
6. Select Model: Choose your desired model from the "Model" dropdown.

Tips and Notes

• Permissions: Ensure your IAM user or role has the necessary permissions to invoke Bedrock models. The bedrock:InvokeModel permission is required.
• Pricing: Refer to the Amazon Bedrock pricing page for details on model costs.
• Cross-Region Inference: Using cross-region inference may result in higher latency.