Interaction Thinking in the Trend of Cockpit Screening (II): Breaking Through the Layers

驾舱屏幕化趋势下的交互思考(二):突破层级

Apr 15 · 2024

In a previous article, "Interaction Thinking in the Trend of Cockpit Screening (I)", it was emphasized that when designing functionality for cockpit screens, it is important to take into account the various characteristics of their environment in order to provide innovative interaction solutions. Nonetheless, reducing the amount of time the screen is used during driving may be the safest option. Therefore, there is a need to consider interaction options other than touch operation, which need to be more efficient and accurate than touch interaction, with steering wheel control (disk control) and intelligent voice being two of the more desirable options.

在之前《驾舱屏幕化趋势下的交互思考(一)》的文章中,强调了在驾舱屏幕进行功能设计时,要综合考虑其环境的各种特点,以提供创新的交互解决方案。尽管如此,在驾驶过程中,减少屏幕的使用时间可能是最安全的选择。因此,需要考虑除触控操作之外的其他交互方案,这些方案需要比触控交互更加高效和准确,方向盘控制(盘控)和智能语音则是两个比较理想的选择。

The steering wheel of a car often integrates many function buttons. The new Tesla model goes one step further by placing all the functions that were originally distributed in the pocket gear on the steering wheel in the form of touch buttons, so that a part of the car's operations can be performed by the dial controls. And with the driver always holding the steering wheel, there is virtually no impact on his or her seating position, vision, or concentration when performing function operations.

汽车方向盘往往集成了许多功能按钮,特斯拉新款车型更进一步,将原本分布在怀挡的功能全部放置于方向盘上,以触控按钮的方式呈现,因此,车内的一部分操作可以由盘控来完成。且驾驶员始终握持方向盘,在进行功能操作时几乎不会对其坐姿、视线和注意力产生影响。

The wheel control buttons usually each correspond to a specific function or support customization. Tesla's steering wheel (older models with pocket gears), on the other hand, is equipped with only two scroll buttons, which combine to realize multi-functional operation through up and down scrolling, left and right toggle, single press down and long press. Such a design does not result in weakened operating functions due to the reduction in the number of buttons, but rather, the same button functions are flexibly changed in different scenarios through adaptive adjustments. For example, when music is playing, the left button can be dialed to the right to switch to the next song; and when an incoming call comes in, the same operation is to answer the call. It is this active interaction strategy that makes Tesla's steering wheel so versatile while maintaining simplicity. In addition, the screen on the steering wheel of the Ideal Vehicle L Series is an innovation in disk control interaction. It carries driving-related information while expanding many interactive function control scenarios.

盘控按钮通常各自对应特定功能,或支持自定义。而特斯拉的方向盘(老款有怀挡的车型),仅配备了两个滚动按钮,通过上下滚动、左右拨动、单次按下和长按,组合实现了多功能的操作。这样的设计并没有因为按钮数量的减少而导致操作功能减弱,而是通过适配调整,使同一个按钮功能在不同场景下灵活变换。例如,在音乐播放时,左键向右拨可切换到下一首歌曲;而在来电时,同样的操作则是接听电话。正是这种主动式交互策略,使得特斯拉的方向盘在保持简洁的同时实现了对车辆的多功能操作。此外,理想汽车 L 系列的方向盘上的屏幕,是盘控交互的一个创新。承载驾驶相关信息,同时拓展出了许多可交互的功能控制场景。

From touch screens to steering wheel controls, safety has been significantly improved. However, is there an interaction solution that completely allows the driver to focus on driving with both hands? That would be intelligent voice. After years of development of voice technology, from Siri, which was known to users at the beginning, to the smart speakers launched by major companies today, intelligent voice has become very mature in the direction of speech recognition (Automatic Speech Recognition, ASR), natural language processing (Natural Language Processing, NLP), and text to speech (Text to Speech, TTS). Text to Speech (TTS) and other directions have been very mature and widely used. The use of voice interaction in the cockpit is not only in line with the driving environment and needs, but also has a high degree of safety.

从触控屏幕到方向盘控制,已经显著提高了安全性。然而,是否存在一种完全让驾驶员双手专注于驾驶的交互方案?那就是智能语音。语音技术经过多年的发展,从最初被用户熟知的 Siri,到如今各大企业推出的智能音箱,智能语音在语音识别(Automatic Speech Recognition,ASR)、自然语言处理(Natural Language Processing,NLP)、语音合成(Text to Speech,TTS)等方向已经非常成熟并被广泛应用。在驾舱内使用语音交互,不仅符合驾驶环境和需求,而且具有极高的安全性。

The core advantage of voice interaction is that it breaks down the 'layers' in the interface. Usually in the interface need to go through several steps to complete the operation, and voice interaction can realize one-step direct access. In addition to common operation commands, the newly released Xiaomi Auto SU7 can use voice to quickly find a certain setting item and guide it through the interface. This greatly improves the efficiency of the operation, reduces the learning cost, and most importantly, has a very low impact on driving safety. In recent years, car companies have also made further technological upgrades to intelligent voice, with the emergence of features such as multi-sound zone interaction, continuous dialog, contextual understanding, and dialect recognition, making intelligent voice interaction in the cockpit more powerful and easy to use.

语音交互的核心优势在于它打破了界面中的「层级」。通常在界面中需要经历几个步骤完成的操作,而语音交互可以实现一步直达。除了常见了操作指令,新发布的小米汽车 SU7,可以使用语音快速找到某个设置项,并在界面中进行引导。这极大地提升了操作的效率,降低了学习成本,而且最重要的是对驾驶安全的影响极低。近年来,各车企也对智能语音进行了进一步的技术升级,多音区交互、连续对话、上下文理解、方言识别等特性的出现,使驾舱智能语音交互更加强大且易用。

The deep integration of voice and vehicle control is not limited to the manipulation of software functions, but can also involve hardware. For example, Ideal Vehicle combines voice and in-vehicle cameras to enable gestural voice commands. For example, a user can point to the sunroof and say "open this," and the voice system recognizes the command and performs the corresponding operation. In Xiaomi SU7, drivers can also adjust the direction of the rearview mirror and HUD through voice commands, greatly improving convenience and safety. So far, intelligent voice is gradually becoming a key role in providing various kinds of support for users in the cabin.

语音与车辆控制的深度整合不仅限于对软件功能的操作,还可以涉及硬件。例如,理想汽车将语音和车内摄像头结合,实现了手势语音指令。举例来说,用户可以指向天窗并说“打开这个”,语音系统即可识别指令并执行相应操作。在小米汽车 SU7 中,驾驶员还可以通过语音指令调节后视镜和 HUD 的方向,极大地提高了便捷性与安全性。至此,智能语音在驾舱内正在逐渐成为一个为用户提供各类支持的关键角色。

From touch controls to disk controls to voice, interaction in the cockpit is becoming increasingly diverse and evolving in terms of safety. This is a reflection of the trend towards the popularization of autonomous driving technology, where direct user control of the vehicle is gradually decreasing. With the advent of truly autonomous driving, new forms of interaction are expected to emerge to better suit the fully automated cockpit environment and user needs.

从触控、盘控再到语音,驾舱内的交互方式正在日益多元化,且在安全性方面不断发展。这也反应了自动驾驶技术普及的趋势,用户对车辆的直接控制占比在逐渐减少。而随着真正自动驾驶时代的到来,预计又会出现全新的交互形式,以更好地适应全自动的驾舱环境和用户需求。

Interaction Thinking in the Trend of Cockpit Screening (II): Breaking Through the Layers

驾舱屏幕化趋势下的交互思考(二):突破层级

Apr 15 · 2024

In a previous article, "Interaction Thinking in the Trend of Cockpit Screening (I)", it was emphasized that when designing functionality for cockpit screens, it is important to take into account the various characteristics of their environment in order to provide innovative interaction solutions. Nonetheless, reducing the amount of time the screen is used during driving may be the safest option. Therefore, there is a need to consider interaction options other than touch operation, which need to be more efficient and accurate than touch interaction, with steering wheel control (disk control) and intelligent voice being two of the more desirable options.

在之前《驾舱屏幕化趋势下的交互思考(一)》的文章中,强调了在驾舱屏幕进行功能设计时,要综合考虑其环境的各种特点,以提供创新的交互解决方案。尽管如此,在驾驶过程中,减少屏幕的使用时间可能是最安全的选择。因此,需要考虑除触控操作之外的其他交互方案,这些方案需要比触控交互更加高效和准确,方向盘控制(盘控)和智能语音则是两个比较理想的选择。

The steering wheel of a car often integrates many function buttons. The new Tesla model goes one step further by placing all the functions that were originally distributed in the pocket gear on the steering wheel in the form of touch buttons, so that a part of the car's operations can be performed by the dial controls. And with the driver always holding the steering wheel, there is virtually no impact on his or her seating position, vision, or concentration when performing function operations.

汽车方向盘往往集成了许多功能按钮,特斯拉新款车型更进一步,将原本分布在怀挡的功能全部放置于方向盘上,以触控按钮的方式呈现,因此,车内的一部分操作可以由盘控来完成。且驾驶员始终握持方向盘,在进行功能操作时几乎不会对其坐姿、视线和注意力产生影响。

The wheel control buttons usually each correspond to a specific function or support customization. Tesla's steering wheel (older models with pocket gears), on the other hand, is equipped with only two scroll buttons, which combine to realize multi-functional operation through up and down scrolling, left and right toggle, single press down and long press. Such a design does not result in weakened operating functions due to the reduction in the number of buttons, but rather, the same button functions are flexibly changed in different scenarios through adaptive adjustments. For example, when music is playing, the left button can be dialed to the right to switch to the next song; and when an incoming call comes in, the same operation is to answer the call. It is this active interaction strategy that makes Tesla's steering wheel so versatile while maintaining simplicity. In addition, the screen on the steering wheel of the Ideal Vehicle L Series is an innovation in disk control interaction. It carries driving-related information while expanding many interactive function control scenarios.

盘控按钮通常各自对应特定功能,或支持自定义。而特斯拉的方向盘(老款有怀挡的车型),仅配备了两个滚动按钮,通过上下滚动、左右拨动、单次按下和长按,组合实现了多功能的操作。这样的设计并没有因为按钮数量的减少而导致操作功能减弱,而是通过适配调整,使同一个按钮功能在不同场景下灵活变换。例如,在音乐播放时,左键向右拨可切换到下一首歌曲;而在来电时,同样的操作则是接听电话。正是这种主动式交互策略,使得特斯拉的方向盘在保持简洁的同时实现了对车辆的多功能操作。此外,理想汽车 L 系列的方向盘上的屏幕,是盘控交互的一个创新。承载驾驶相关信息,同时拓展出了许多可交互的功能控制场景。

From touch screens to steering wheel controls, safety has been significantly improved. However, is there an interaction solution that completely allows the driver to focus on driving with both hands? That would be intelligent voice. After years of development of voice technology, from Siri, which was known to users at the beginning, to the smart speakers launched by major companies today, intelligent voice has become very mature in the direction of speech recognition (Automatic Speech Recognition, ASR), natural language processing (Natural Language Processing, NLP), and text to speech (Text to Speech, TTS). Text to Speech (TTS) and other directions have been very mature and widely used. The use of voice interaction in the cockpit is not only in line with the driving environment and needs, but also has a high degree of safety.

从触控屏幕到方向盘控制,已经显著提高了安全性。然而,是否存在一种完全让驾驶员双手专注于驾驶的交互方案?那就是智能语音。语音技术经过多年的发展,从最初被用户熟知的 Siri,到如今各大企业推出的智能音箱,智能语音在语音识别(Automatic Speech Recognition,ASR)、自然语言处理(Natural Language Processing,NLP)、语音合成(Text to Speech,TTS)等方向已经非常成熟并被广泛应用。在驾舱内使用语音交互,不仅符合驾驶环境和需求,而且具有极高的安全性。

The core advantage of voice interaction is that it breaks down the 'layers' in the interface. Usually in the interface need to go through several steps to complete the operation, and voice interaction can realize one-step direct access. In addition to common operation commands, the newly released Xiaomi Auto SU7 can use voice to quickly find a certain setting item and guide it through the interface. This greatly improves the efficiency of the operation, reduces the learning cost, and most importantly, has a very low impact on driving safety. In recent years, car companies have also made further technological upgrades to intelligent voice, with the emergence of features such as multi-sound zone interaction, continuous dialog, contextual understanding, and dialect recognition, making intelligent voice interaction in the cockpit more powerful and easy to use.

语音交互的核心优势在于它打破了界面中的「层级」。通常在界面中需要经历几个步骤完成的操作,而语音交互可以实现一步直达。除了常见了操作指令,新发布的小米汽车 SU7,可以使用语音快速找到某个设置项,并在界面中进行引导。这极大地提升了操作的效率,降低了学习成本,而且最重要的是对驾驶安全的影响极低。近年来,各车企也对智能语音进行了进一步的技术升级,多音区交互、连续对话、上下文理解、方言识别等特性的出现,使驾舱智能语音交互更加强大且易用。

The deep integration of voice and vehicle control is not limited to the manipulation of software functions, but can also involve hardware. For example, Ideal Vehicle combines voice and in-vehicle cameras to enable gestural voice commands. For example, a user can point to the sunroof and say "open this," and the voice system recognizes the command and performs the corresponding operation. In Xiaomi SU7, drivers can also adjust the direction of the rearview mirror and HUD through voice commands, greatly improving convenience and safety. So far, intelligent voice is gradually becoming a key role in providing various kinds of support for users in the cabin.

语音与车辆控制的深度整合不仅限于对软件功能的操作,还可以涉及硬件。例如,理想汽车将语音和车内摄像头结合,实现了手势语音指令。举例来说,用户可以指向天窗并说“打开这个”,语音系统即可识别指令并执行相应操作。在小米汽车 SU7 中,驾驶员还可以通过语音指令调节后视镜和 HUD 的方向,极大地提高了便捷性与安全性。至此,智能语音在驾舱内正在逐渐成为一个为用户提供各类支持的关键角色。

From touch controls to disk controls to voice, interaction in the cockpit is becoming increasingly diverse and evolving in terms of safety. This is a reflection of the trend towards the popularization of autonomous driving technology, where direct user control of the vehicle is gradually decreasing. With the advent of truly autonomous driving, new forms of interaction are expected to emerge to better suit the fully automated cockpit environment and user needs.

从触控、盘控再到语音,驾舱内的交互方式正在日益多元化,且在安全性方面不断发展。这也反应了自动驾驶技术普及的趋势,用户对车辆的直接控制占比在逐渐减少。而随着真正自动驾驶时代的到来,预计又会出现全新的交互形式,以更好地适应全自动的驾舱环境和用户需求。

Interaction Thinking in the Trend of Cockpit Screening (II): Breaking Through the Layers

驾舱屏幕化趋势下的交互思考(二):突破层级

Apr 15 · 2024

在之前《驾舱屏幕化趋势下的交互思考(一)》的文章中,强调了在驾舱屏幕进行功能设计时,要综合考虑其环境的各种特点,以提供创新的交互解决方案。尽管如此,在驾驶过程中,减少屏幕的使用时间可能是最安全的选择。因此,需要考虑除触控操作之外的其他交互方案,这些方案需要比触控交互更加高效和准确,方向盘控制(盘控)和智能语音则是两个比较理想的选择。

汽车方向盘往往集成了许多功能按钮,特斯拉新款车型更进一步,将原本分布在怀挡的功能全部放置于方向盘上,以触控按钮的方式呈现,因此,车内的一部分操作可以由盘控来完成。且驾驶员始终握持方向盘,在进行功能操作时几乎不会对其坐姿、视线和注意力产生影响。

盘控按钮通常各自对应特定功能,或支持自定义。而特斯拉的方向盘(老款有怀挡的车型),仅配备了两个滚动按钮,通过上下滚动、左右拨动、单次按下和长按,组合实现了多功能的操作。这样的设计并没有因为按钮数量的减少而导致操作功能减弱,而是通过适配调整,使同一个按钮功能在不同场景下灵活变换。例如,在音乐播放时,左键向右拨可切换到下一首歌曲;而在来电时,同样的操作则是接听电话。正是这种主动式交互策略,使得特斯拉的方向盘在保持简洁的同时实现了对车辆的多功能操作。此外,理想汽车 L 系列的方向盘上的屏幕,是盘控交互的一个创新。承载驾驶相关信息,同时拓展出了许多可交互的功能控制场景。

从触控屏幕到方向盘控制,已经显著提高了安全性。然而,是否存在一种完全让驾驶员双手专注于驾驶的交互方案?那就是智能语音。语音技术经过多年的发展,从最初被用户熟知的 Siri,到如今各大企业推出的智能音箱,智能语音在语音识别(Automatic Speech Recognition,ASR)、自然语言处理(Natural Language Processing,NLP)、语音合成(Text to Speech,TTS)等方向已经非常成熟并被广泛应用。在驾舱内使用语音交互,不仅符合驾驶环境和需求,而且具有极高的安全性。

语音交互的核心优势在于它打破了界面中的「层级」。通常在界面中需要经历几个步骤完成的操作,而语音交互可以实现一步直达。除了常见了操作指令,新发布的小米汽车 SU7,可以使用语音快速找到某个设置项,并在界面中进行引导。这极大地提升了操作的效率,降低了学习成本,而且最重要的是对驾驶安全的影响极低。近年来,各车企也对智能语音进行了进一步的技术升级,多音区交互、连续对话、上下文理解、方言识别等特性的出现,使驾舱智能语音交互更加强大且易用。

语音与车辆控制的深度整合不仅限于对软件功能的操作,还可以涉及硬件。例如,理想汽车将语音和车内摄像头结合,实现了手势语音指令。举例来说,用户可以指向天窗并说“打开这个”,语音系统即可识别指令并执行相应操作。在小米汽车 SU7 中,驾驶员还可以通过语音指令调节后视镜和 HUD 的方向,极大地提高了便捷性与安全性。至此,智能语音在驾舱内正在逐渐成为一个为用户提供各类支持的关键角色。

从触控、盘控再到语音,驾舱内的交互方式正在日益多元化,且在安全性方面不断发展。这也反应了自动驾驶技术普及的趋势,用户对车辆的直接控制占比在逐渐减少。而随着真正自动驾驶时代的到来,预计又会出现全新的交互形式,以更好地适应全自动的驾舱环境和用户需求。