mirror of
https://github.com/home-assistant/home-assistant.io.git
synced 2025-07-14 12:56:54 +00:00
Update Assist section for 2024.12 release (#36045)
Co-authored-by: Michael Hansen <hansen.mike@gmail.com> Co-authored-by: c0ffeeca7 <38767475+c0ffeeca7@users.noreply.github.com>
This commit is contained in:
parent
703548f74c
commit
a17777e488
@ -78,8 +78,9 @@ Enjoy the (beta) release!
|
|||||||
- [Improved scene editor experience](#improved-scene-editor-experience)
|
- [Improved scene editor experience](#improved-scene-editor-experience)
|
||||||
- [Voice](#voice)
|
- [Voice](#voice)
|
||||||
- [Let your voice assistant fall back to a LLM-based agent](#let-your-voice-assistant-fall-back-to-a-llm-based-agent)
|
- [Let your voice assistant fall back to a LLM-based agent](#let-your-voice-assistant-fall-back-to-a-llm-based-agent)
|
||||||
|
- [Langage leaders are accelerating the pace](#langage-leaders-are-accelerating-the-pace)
|
||||||
- [A faster voice experience](#a-faster-voice-experience)
|
- [A faster voice experience](#a-faster-voice-experience)
|
||||||
- [Revised Integration Quality Scale](#revised-integration-quality-scale)
|
- [Revised Integration Quality Scale](#revised-integration-quality-scale)
|
||||||
- [Integrations](#integrations)
|
- [Integrations](#integrations)
|
||||||
- [New integrations](#new-integrations)
|
- [New integrations](#new-integrations)
|
||||||
- [Noteworthy improvements to existing integrations](#noteworthy-improvements-to-existing-integrations)
|
- [Noteworthy improvements to existing integrations](#noteworthy-improvements-to-existing-integrations)
|
||||||
@ -124,52 +125,58 @@ their progress._
|
|||||||
### Let your voice assistant fall back to a LLM-based agent
|
### Let your voice assistant fall back to a LLM-based agent
|
||||||
|
|
||||||
[Exactly 6 month ago] we bridged the gap between our intent world and the
|
[Exactly 6 month ago] we bridged the gap between our intent world and the
|
||||||
wonderful (and scary) world of LLMs. We allowed you to let a LLM agent control
|
wonderful (and scary) world of LLMs. We allowed you to let an LLM agent control
|
||||||
your home instead of relying on our built-in intent.
|
your home instead of relying on our built-in intents.
|
||||||
|
|
||||||
This choice was an interesting first step, as LLM are generally much smarter
|
This choice was an interesting first step.
|
||||||
and knowledgeable about the world than our built-in intents.
|
LLMs are generally much smarter and knowledgeable about the world than our built-in intents.
|
||||||
|
However, they are often slow and/or expensive.
|
||||||
However, they are often slow and/or expensive. And let's face it, even if the
|
And let's face it, even if the demos are cool, 90% of the commands we say in our homes are simple
|
||||||
demos are cool, 90% of the commands we say in our homes are simple
|
|
||||||
_"Turn this on"_, _"Turn that off"_.
|
_"Turn this on"_, _"Turn that off"_.
|
||||||
|
|
||||||
Today, we're finally allowing users to **mix** these worlds. Starting from this
|
Today, we're finally allowing users to **mix** these worlds.
|
||||||
release, you can set-up a voice assistant in a way that will target our fast,
|
Starting from this release, you can set-up a voice assistant in a way that will target our fast, community driven, built-in intents first, and only fallback to a LLM-based agent if no matches were found.
|
||||||
community driven, built-in intents first, and only fallback to a LLM-based
|
|
||||||
agent if no matches were found.
|
|
||||||
|
|
||||||

|

|
||||||
|
|
||||||
This allow you to mix the pros of both worlds with almost non of the cons.
|
This allow you to mix the pros of both worlds with almost none of the cons.
|
||||||
|
|
||||||
Specific known command will be processed locally and extremely fast,
|
Specific known commands will be processed locally and extremely fast, and the power of an LLM will only be used for more complex queries that Home Assistant does not natively understand.
|
||||||
and the power of a LLM will only be used for more complex queries
|
|
||||||
that we do not understand.
|
|
||||||
|
|
||||||
_**TODO**: video demonstrating this._
|
_**TODO**: video demonstrating this._
|
||||||
|
|
||||||
[Exactly 6 month ago]: https://www.home-assistant.io/blog/2024/06/05/release-20246/
|
[Exactly 6 month ago]: https://www.home-assistant.io/blog/2024/06/05/release-20246/
|
||||||
|
|
||||||
|
### Langage leaders are accelerating the pace
|
||||||
|
|
||||||
|
This is not a secret, our voice hardware is coming very soon.
|
||||||
|
Language leaders got their hands on the device, and are working extremely hard to polish their language.
|
||||||
|
The amount of contributions on our [intents repository] (where we store the supported sentences) skyrocketed during the last month.
|
||||||
|
It is something we all truly appreciate.
|
||||||
|
More and more languages are becoming usable, or even complete!
|
||||||
|
You can follow the progress [here](https://home-assistant.github.io/intents/).
|
||||||
|
|
||||||
|
We won't list them all here, but just be aware that it is very likely that someone is hard at work making sure your native language gets some love so that you can speak with your home.
|
||||||
|
|
||||||
|
[intents repository]: https://github.com/home-assistant/intents?tab=readme-ov-file
|
||||||
|
|
||||||
### A faster voice experience
|
### A faster voice experience
|
||||||
|
|
||||||
HASSIL, our intent parser, was built from the ground up to match a sentence to
|
[HASSIL], our intent parser, was built from the ground up to match a sentence to its underlying intention extremely fast and on cheap hardware.
|
||||||
its underlying intention extremely fast and on cheap hardware. Releases after
|
Release after release, we added more use-cases and more sentences to Home Assistant, and our sentence-matching logic became slower and slower.
|
||||||
releases, we added more use-cases and more sentences into Home Assistant,
|
|
||||||
and our sentence matching logic became slower and slower.
|
|
||||||
|
|
||||||
In some of the languages, a wrong sentence could take more than 15 seconds to
|
In some of the languages, a non-matching sentence could take more than 15 seconds to be processed!
|
||||||
be processed!
|
|
||||||
|
|
||||||
This release adds a lot of love to HASSIL, we completely reengineered the way
|
This release adds a lot of love to HASSIL, we completely reengineered the way we are matching sentences.
|
||||||
we are matching sentences, and the results speak for themselves.
|
On top of that, language leaders spent some time reducing the complexity of their sentences, some languages saw a reduction of the number of possible combinations of 99%!.
|
||||||
|
|
||||||
|
The results speak for themselves:
|
||||||
|
|
||||||
_**TODO**: video demonstrating this._
|
_**TODO**: video demonstrating this._
|
||||||
|
|
||||||
_Note: Mike was talking about going from 15s to like 0.1 seconds in some cases.
|
[HASSIL]: https://github.com/home-assistant/hassil
|
||||||
We will try to showcase that in this vid in some way._
|
|
||||||
|
|
||||||
### Revised Integration Quality Scale
|
## Revised Integration Quality Scale
|
||||||
|
|
||||||
The Integration Quality Scale is a way we try to classify the "quality" of an
|
The Integration Quality Scale is a way we try to classify the "quality" of an
|
||||||
integration. It is a way to give users an idea of what to expect from an
|
integration. It is a way to give users an idea of what to expect from an
|
||||||
|
Binary file not shown.
Before Width: | Height: | Size: 42 KiB After Width: | Height: | Size: 91 KiB |
Loading…
x
Reference in New Issue
Block a user