13.2 HeatWave GenAI In-Database LLMs

HeatWave GenAI supports LLMs hosted and executed within the database. When in-database LLMs are used, data does not leave your HeatWave Cluster, which enhances the security for your data.

The following are the in-database LLMs currently supported by HeatWave on AWS:

• llama2-7b-v1
• mistral-7b-instruct-v1
• llama3-8b-instruct-v1

Use these models with the HeatWave GenAI routines.

Parent topic: HeatWave GenAI