-
-
Notifications
You must be signed in to change notification settings - Fork 225
Open
Labels
huggingfaceSee the "Hugging Face" milestone for more infoSee the "Hugging Face" milestone for more info
Milestone
Description
(note: this feature is unrelated to the existing ai assistant or the existing assistant voice control feature)
- add a microphone input to the embedded player (can be push to speak or continuous)
- inject the user recordings (mp3 or wav) as
ClapSegmentCategory.DIALOGUE
segments into the current timeline loop - edit the sample OpenClap file (see Create a demo OpenClap project to showcase █████ #109) to add a
ClapSegmentCategory.PHENOMENON
(can optionally be tied to a "user" entity) which will process user dialogue using by emitting newClapSegmentCategory.DIALOGUE
segments (tied to the avatar entity).
This ClapSegmentCategory.PHENOMENON
must use the █████* workflow.
- update the Simulator service to process
ClapSegmentCategory.PHENOMENON
in a loop
Note: I don't think we need to use ClapSegmentCategory.EVENT
here, since our events already nicely fit the concept of ClapSegmentCategory.DIALOGUE
- redacted
Metadata
Metadata
Assignees
Labels
huggingfaceSee the "Hugging Face" milestone for more infoSee the "Hugging Face" milestone for more info
Projects
Status
No status