mirror of
https://github.com/home-assistant/home-assistant.io.git
synced 2025-07-18 23:06:58 +00:00
Google Generative AI integration: Add related topics (#33124)
This commit is contained in:
parent
1e63cb3791
commit
62b52ed2a2
@ -14,6 +14,15 @@ ha_quality_scale: platinum
|
||||
ha_platforms:
|
||||
- conversation
|
||||
- diagnostics
|
||||
related:
|
||||
- docs: /voice_control/voice_remote_expose_devices/
|
||||
title: Exposing entities to Assist
|
||||
- docs: /voice_control/assist_create_open_ai_personality/
|
||||
title: Create an AI personality
|
||||
- url: https://aistudio.google.com/app/apikey
|
||||
title: Google Generative AI API key
|
||||
- url: https://ai.google.dev/
|
||||
title: Google Generative AI
|
||||
---
|
||||
|
||||
The Google Generative AI integration adds a conversation agent powered by [Google Generative AI](https://ai.google.dev/) in Home Assistant. It can optionally be allowed to control Home Assistant.
|
||||
@ -42,7 +51,7 @@ Instructions:
|
||||
description: Instructions for the AI on how it should respond to your requests. It is written using [Home Assistant Templating](/docs/configuration/templating/).
|
||||
|
||||
Control Home Assistant:
|
||||
description: If the model is allowed to interact with Home Assistant
|
||||
description: If the model is allowed to interact with Home Assistant. It can only control or provide information about entities that are [exposed](/voice_control/voice_remote_expose_devices/) to it.
|
||||
|
||||
Recommended settings:
|
||||
description: If enabled, the recommended model and settings are chosen.
|
||||
@ -73,6 +82,12 @@ Safety settings:
|
||||
|
||||
{% endconfiguration_basic %}
|
||||
|
||||
## Talking to Super Mario
|
||||
|
||||
You can use an OpenAI Conversation integration to [talk to Super Mario and, if you want, have him control devices in your home](/voice_control/assist_create_open_ai_personality/).
|
||||
|
||||
The tutorial is using OpenAI, but this could also be done with the Google Generative AI integration.
|
||||
|
||||
## Services
|
||||
|
||||
### Service `google_generative_ai_conversation.generate_content`
|
||||
@ -86,9 +101,9 @@ Safety settings:
|
||||
Allows you to ask Gemini Pro or Gemini Pro Vision to generate content from a prompt consisting of text and optionally images.
|
||||
This service populates [response data](/docs/scripts/service-calls#use-templates-to-handle-response-data) with the generated content.
|
||||
|
||||
| Service data attribute | Optional | Description | Example |
|
||||
| ---------------------- | -------- | ---------------------------------------------- | ------------------- |
|
||||
| `prompt` | no | The prompt for generating the content. | Describe this image |
|
||||
| Service data attribute | Optional | Description | Example |
|
||||
| ---------------------- | -------- | ----------------------------------------------- | ------------------- |
|
||||
| `prompt` | no | The prompt for generating the content. | Describe this image |
|
||||
| `image_filename` | yes | File names for images to include in the prompt. | /tmp/image.jpg |
|
||||
|
||||
{% raw %}
|
||||
|
Loading…
x
Reference in New Issue
Block a user