AudioPacket
Module: Inworld.AI.
Namespace: Inworld.Packet.
Inherited from InworldPacket
This packet is used for audio chunks and phoneme information for lipsync.
| Variables | Description |
|---|
| dataChunk | The DataChunk of the audio. |
Properties
| Properties | Description |
|---|
| Clip | Generates an AudioClip based on its DataChunk. |
API
| Function | Description | Parameters |
|---|
| DumpWaveFile | Dump received audio packet and phonemeInfo to local files. | fileName: the target file name to store.
the audio file would be saved as .wav file and the phonemeInfo would be saved as .json file. |
DataChunk
Module: Inworld.AI.
Namespace: Inworld.Packet.
| Variables | Description |
|---|
| chunk | The base64 string of the audio wave data. |
| type | In Unity SDK, it's always AUDIO. |
| additionalPhonemeInfo | A list of the PhonemeInfo in the datachunk |
PhonemeInfo
Module: Inworld.AI.
Namespace: Inworld.Packet.
| Variables | Description |
|---|
| phoneme | The actual phoneme |
| startOffset | The start offset in the audio clip. |
| Properties | Description |
|---|
| StartOffset | Trimmed by the returned string into float based on its DataChunk. |
PhonemeList
Module: Inworld.AI.
Namespace: Inworld.Packet.
| Variables | Description |
|---|
| phonemes | The list of the PhonemeInfo that used to dump lipsync files. |
| startOffset | The start offset in the audio clip. |