jeans/home-assistant.io
jeans/home-assistant.io
1
0
Fork 0
mirror of https://github.com/home-assistant/home-assistant.io.git synced 2025-07-19 07:17:14 +00:00
Code Issues Packages Projects Releases Wiki Activity

Google Generative AI integration: Add related topics (#33124)

Browse Source
This commit is contained in:
c0ffeeca7 2024-06-07 12:30:29 +02:00 committed by GitHub
parent 1e63cb3791
commit 62b52ed2a2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 19 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

19
source/_integrations/google_generative_ai_conversation.markdown
View File

@ -14,6 +14,15 @@ ha_quality_scale: platinum
ha_platforms: ha_platforms:
- conversation - conversation
- diagnostics - diagnostics
related:
- docs: /voice_control/voice_remote_expose_devices/
title: Exposing entities to Assist
- docs: /voice_control/assist_create_open_ai_personality/
title: Create an AI personality
- url: https://aistudio.google.com/app/apikey
title: Google Generative AI API key
- url: https://ai.google.dev/
title: Google Generative AI
--- ---
The Google Generative AI integration adds a conversation agent powered by [Google Generative AI](https://ai.google.dev/) in Home Assistant. It can optionally be allowed to control Home Assistant. The Google Generative AI integration adds a conversation agent powered by [Google Generative AI](https://ai.google.dev/) in Home Assistant. It can optionally be allowed to control Home Assistant.
@ -42,7 +51,7 @@ Instructions:
description: Instructions for the AI on how it should respond to your requests. It is written using [Home Assistant Templating](/docs/configuration/templating/). description: Instructions for the AI on how it should respond to your requests. It is written using [Home Assistant Templating](/docs/configuration/templating/).
Control Home Assistant: Control Home Assistant:
description: If the model is allowed to interact with Home Assistant description: If the model is allowed to interact with Home Assistant. It can only control or provide information about entities that are [exposed](/voice_control/voice_remote_expose_devices/) to it.
Recommended settings: Recommended settings:
description: If enabled, the recommended model and settings are chosen. description: If enabled, the recommended model and settings are chosen.
@ -73,6 +82,12 @@ Safety settings:
{% endconfiguration_basic %} {% endconfiguration_basic %}
## Talking to Super Mario
You can use an OpenAI Conversation integration to [talk to Super Mario and, if you want, have him control devices in your home](/voice_control/assist_create_open_ai_personality/).
The tutorial is using OpenAI, but this could also be done with the Google Generative AI integration.
## Services ## Services
### Service `google_generative_ai_conversation.generate_content` ### Service `google_generative_ai_conversation.generate_content`
@ -87,7 +102,7 @@ Allows you to ask Gemini Pro or Gemini Pro Vision to generate content from a pro
This service populates [response data](/docs/scripts/service-calls#use-templates-to-handle-response-data) with the generated content. This service populates [response data](/docs/scripts/service-calls#use-templates-to-handle-response-data) with the generated content.
| Service data attribute | Optional | Description | Example | | Service data attribute | Optional | Description | Example |
| ---------------------- | -------- | ---------------------------------------------- | ------------------- | | ---------------------- | -------- | ----------------------------------------------- | ------------------- |
| `prompt` | no | The prompt for generating the content. | Describe this image | | `prompt` | no | The prompt for generating the content. | Describe this image |
| `image_filename` | yes | File names for images to include in the prompt. | /tmp/image.jpg | | `image_filename` | yes | File names for images to include in the prompt. | /tmp/image.jpg |