HMI system concept prototyping

Background

During the journey at NIO Germany, I participated in several HMI (Human Machine Interaction) design concept processes and was responsible for prototyping interaction concepts in several HMI models.

Demos for ES8 version 1.0 cluster (mass productionized)

Prototype processes included software UI layers and hardware connection.

• Hardware connections: Arduino, voice translation module (iFlytek hardware)
• Messaging server (Node.js)
• Software interfaces (HTML/CSS/JavaScript, voice processing API to Google/Amazon/IBM cloud services)

Prototype for central screen

We initialized several prototypes for testing the interaction models and evaluating the interaction model based on the mental model and ergonomics. This prototyping process helps designers understand the limitation of technologies and how to involve specific tech into user experience design.

• Touch-based big screen concept
• Remote dual screen concept
• Air gesture concept
• Eye contact interaction

Prototype below is air gesture control demo

Processing

Prototype for 3D smart cluster

Cluster concept for L4 autonomous driving

• Merge center screen with cluster
• Curved screen replacing back mirror

I was responsible for hardware prototype setup (with narrow screen prototyping) and the video production.

Welcome scene - system booting

Manual driving

Fully autonomous scene