Nomi Halo - ES8
2017 - 2019Background
Nomi Halo is another version of an in-car assistant launched in a production car, ES8 Basic. The product design is more integrated and seamless on the instrument panel. I was deeply involved in this project with
- Interface interaction/visual concept generation
- Prototyping in 3D environment
- Delivering design parameters for the engineering team
- Nomi voice persona generation, selecting voice actor for Nomi (both Halo and Mate, see other projects).
- Generating voice scripts for Nomi Halo/Mate
Product design with interaction layers
The product designs were iterated for several versions. My role was to define the basic voice interaction model for each version and help decision making before hardware testing.
The fundamental voice interaction model includes
- Activation
- Listening (Input)
- Processing
- Completion / “done”
- Feedback (output)
Concept 1 interface on side
Concept 2 - display on top
Concept 3 - 2 layers involving sharp / ambient light
The demo below presents interaction demos in Unity for the voice interaction model.
Hardware prototyping and software dev tools for translating animation clip pixels to neuropixels(the production device).
Use cases for Nomi Halo and prototyping
Together with the product team, we defined the use cases for the final version of Nomi halo.
- Function-driven cases
- Fun cases: Achievement notification.
Similar to digital interface design process, we also defined the light interface design guidelines
- Arousal level for use cases
- Color code for different use cases
- Brightness level
- Timing and transition
Real-time 3D visualization for demenstration
The demos are rendered in unity. Several GLSL Post Effects and masterials were developed to reach the in-car environment reality.
Wake up
Listening
Incoming call
Celebration
Bridge design and engineering
The deliverables include engineering programmable config files, which helps the implementation. Hardware debugging．
Nomi personas
The persona definition was initialized in order to define the VUI (voice actor and voice script). The process includes user research, test, defining the voice style and scribbling.
