mirror of
https://github.com/home-assistant/home-assistant.io.git
synced 2025-07-19 15:26:59 +00:00
Google Generative AI integration: Add related topics (#33124)
This commit is contained in:
parent
1e63cb3791
commit
62b52ed2a2
@ -14,6 +14,15 @@ ha_quality_scale: platinum
|
|||||||
ha_platforms:
|
ha_platforms:
|
||||||
- conversation
|
- conversation
|
||||||
- diagnostics
|
- diagnostics
|
||||||
|
related:
|
||||||
|
- docs: /voice_control/voice_remote_expose_devices/
|
||||||
|
title: Exposing entities to Assist
|
||||||
|
- docs: /voice_control/assist_create_open_ai_personality/
|
||||||
|
title: Create an AI personality
|
||||||
|
- url: https://aistudio.google.com/app/apikey
|
||||||
|
title: Google Generative AI API key
|
||||||
|
- url: https://ai.google.dev/
|
||||||
|
title: Google Generative AI
|
||||||
---
|
---
|
||||||
|
|
||||||
The Google Generative AI integration adds a conversation agent powered by [Google Generative AI](https://ai.google.dev/) in Home Assistant. It can optionally be allowed to control Home Assistant.
|
The Google Generative AI integration adds a conversation agent powered by [Google Generative AI](https://ai.google.dev/) in Home Assistant. It can optionally be allowed to control Home Assistant.
|
||||||
@ -42,7 +51,7 @@ Instructions:
|
|||||||
description: Instructions for the AI on how it should respond to your requests. It is written using [Home Assistant Templating](/docs/configuration/templating/).
|
description: Instructions for the AI on how it should respond to your requests. It is written using [Home Assistant Templating](/docs/configuration/templating/).
|
||||||
|
|
||||||
Control Home Assistant:
|
Control Home Assistant:
|
||||||
description: If the model is allowed to interact with Home Assistant
|
description: If the model is allowed to interact with Home Assistant. It can only control or provide information about entities that are [exposed](/voice_control/voice_remote_expose_devices/) to it.
|
||||||
|
|
||||||
Recommended settings:
|
Recommended settings:
|
||||||
description: If enabled, the recommended model and settings are chosen.
|
description: If enabled, the recommended model and settings are chosen.
|
||||||
@ -73,6 +82,12 @@ Safety settings:
|
|||||||
|
|
||||||
{% endconfiguration_basic %}
|
{% endconfiguration_basic %}
|
||||||
|
|
||||||
|
## Talking to Super Mario
|
||||||
|
|
||||||
|
You can use an OpenAI Conversation integration to [talk to Super Mario and, if you want, have him control devices in your home](/voice_control/assist_create_open_ai_personality/).
|
||||||
|
|
||||||
|
The tutorial is using OpenAI, but this could also be done with the Google Generative AI integration.
|
||||||
|
|
||||||
## Services
|
## Services
|
||||||
|
|
||||||
### Service `google_generative_ai_conversation.generate_content`
|
### Service `google_generative_ai_conversation.generate_content`
|
||||||
@ -86,9 +101,9 @@ Safety settings:
|
|||||||
Allows you to ask Gemini Pro or Gemini Pro Vision to generate content from a prompt consisting of text and optionally images.
|
Allows you to ask Gemini Pro or Gemini Pro Vision to generate content from a prompt consisting of text and optionally images.
|
||||||
This service populates [response data](/docs/scripts/service-calls#use-templates-to-handle-response-data) with the generated content.
|
This service populates [response data](/docs/scripts/service-calls#use-templates-to-handle-response-data) with the generated content.
|
||||||
|
|
||||||
| Service data attribute | Optional | Description | Example |
|
| Service data attribute | Optional | Description | Example |
|
||||||
| ---------------------- | -------- | ---------------------------------------------- | ------------------- |
|
| ---------------------- | -------- | ----------------------------------------------- | ------------------- |
|
||||||
| `prompt` | no | The prompt for generating the content. | Describe this image |
|
| `prompt` | no | The prompt for generating the content. | Describe this image |
|
||||||
| `image_filename` | yes | File names for images to include in the prompt. | /tmp/image.jpg |
|
| `image_filename` | yes | File names for images to include in the prompt. | /tmp/image.jpg |
|
||||||
|
|
||||||
{% raw %}
|
{% raw %}
|
||||||
|
Loading…
x
Reference in New Issue
Block a user