13.3 HeatWave GenAI External LLMs

HeatWave GenAI supports external LLMs provided by Amazon Bedrock. When external LLMs are used, data leaves your HeatWave Cluster to be processed by Amazon Bedrock.

The following are the external LLMs provided by Amazon Bedrock that are currently supported by HeatWave on AWS:

• cohere.command-text-v14
• cohere.command-light-text-v14
• meta.llama2-70b-chat-v1
• meta.llama3-70b-instruct-v1:0

To use these models with the HeatWave GenAI routines, you need:

• An IAM policy to access the Amazon Bedrock service
• An IAM Role to access the Amazon Bedrock service

Parent topic: HeatWave GenAI