WO2024139733A1

WO2024139733A1 - Input event distribution method for intelligent cockpit, system, and vehicle

Info

Publication number: WO2024139733A1
Application number: PCT/CN2023/129910
Authority: WO
Inventors: Jinliang Lei; Chenggui Wu
Original assignee: Nio Technology (Anhui) Co., Ltd
Priority date: 2022-12-27
Filing date: 2023-11-06
Publication date: 2024-07-04

Abstract

The disclosure relates to the field of intelligent cockpit technologies, and specifically, to an input event distribution method for an intelligent cockpit, an intelligent cockpit system, a vehicle, and a computer storage medium. The intelligent cockpit is deployed with a host machine and one or more guest machines, and the host machine and the one or more guest machines share a touch display apparatus and the method includes the following steps: receiving an input event inputted via the touch display apparatus; identifying an input area and an event type of the input event; and distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine.

Description

Input event distribution method for intelligent cockpit, system, and vehicle

Technical Field

The disclosure relates to the field of intelligent cockpit technologies, and specifically, to an input event distribution method for an intelligent cockpit, an intelligent cockpit system, a vehicle, and a computer storage medium.

Background Art

Currently, a conventional vehicle instrument system and in-vehicle entertainment system have separate display apparatuses, which display different information based on different trigger signals. With the rapid development of intelligent cockpits, some existing solutions propose integrating information that needs to be displayed on the vehicle instrument system into an entertainment host screen of the in-vehicle entertainment system, so as to save a display screen while meeting regulatory requirements. However, the existing technology divides the touch functions of a shared screen based only on different areas. For example, a part of the shared screen is used for touch and display of the vehicle instrument system, and the remaining part of the shared screen is used for touch and display of the in-vehicle entertainment system. Such a multi-screen integration method reflects only integration in the hardware sense, rather than integration in the functional sense, thus reducing the functional flexibility of the shared screen.

Summary

In order to solve or at least alleviate one or more of the above problems, the disclosure proposes an input event distribution method for an intelligent cockpit, an intelligent cockpit system, a vehicle, and a computer storage medium, which can implement distribution of an input event in the case of a plurality of guest machines sharing a screen, thereby improving the human-machine interaction experience of users.

According to a first aspect of the disclosure, there is provided an input event distribution method for an intelligent cockpit, where the intelligent cockpit is deployed with a host machine and one or more guest machines, and the host machine and the one or more guest machines share a touch display apparatus and the method includes the following steps: receiving an input event inputted via the touch display apparatus; identifying an input area and an event type of the input event; and distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine.

As an alternative or addition to the above solution, in the method according to an embodiment of the disclosure, the one or more guest machines include a first guest machine, and the method further includes: receiving a first registration request from the first guest machine, the first registration request including a first input area of interest to the first guest machine and a first event type that acts on the first input area; and storing a correspondence between a distribution address of the first guest machine, the first input area, and the first event type in the correspondence table; and the distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine includes: if the input area of the input event is identified as the first input area and the event type of the input event is identified as the first event type, sending the input event to the first guest machine.

As an alternative or addition to the above solution, in the method according to an embodiment of the disclosure, the one or more guest machines further include a second guest machine, and the method further includes: receiving a second registration request from the second guest machine, the second registration request including the first input area of interest to the second guest machine and a second event type that acts on the first input area, where the second event type is different from the first event type; and storing a correspondence between a distribution address of the second guest machine, the first input area, and the second event type in the correspondence table; and the distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine includes: if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, sending the input event to the second guest machine.

As an alternative or addition to the above solution, the method according to an embodiment of the disclosure further includes: receiving a third registration request issued by a host application installed on the host machine, the third registration request including the first input area of interest to the host application and a third event type that acts on the first input area, where the third event type is different from the first event type; storing a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, sending the input event to the host application.

As an alternative or addition to the above solution, in the method according to an embodiment of the disclosure, the input event includes a touch event, and the event type includes one or more of the following: a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event.

As an alternative or addition to the above solution, in the method according to an embodiment of the disclosure, the one or more guest machines run on the host machine based on the virtualization technology.

According to a second aspect of the disclosure, there is provided an intelligent cockpit system, where the intelligent cockpit is deployed with a host machine and one or more guest machines, and the host machine and the one or more guest machines share a touch display apparatus and the host machine is configured to: receive an input event inputted via the touch display apparatus; identify an input area and an event type of the input event; and distribute the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine.

As an alternative or addition to the above solution, in the system according to an embodiment of the disclosure, the one or more guest machines include a first guest machine, and the host machine is further configured to: receive a first registration request from the first guest machine, the first registration request including a first input area of interest to the first guest machine and a first event type that acts on the first input area; store a correspondence between a distribution address of the first guest machine, the first input area, and the first event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the first event type, send the input event to the first guest machine.

As an alternative or addition to the above solution, in the system according to an embodiment of the disclosure, the one or more guest machines further include a second guest machine, and the host machine is further configured to: receive a second registration request from the second guest machine, the second registration request including the first input area of interest to the second guest machine and a second event type that acts on the first input area, where the second event type is different from the first event type; store a correspondence between a distribution address of the second guest machine, the first input area, and the second event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, send the input event to the second guest machine.

As an alternative or addition to the above solution, in the system according to an embodiment of the disclosure, the host machine is further configured to: receive a third registration request issued by a host application installed on the host machine, the third registration request including the first input area of interest to the host application and a third event type that acts on the first input area, where the third event type is different from the first event type; store a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, send the input event to the host application.

As an alternative or addition to the above solution, in the system according to an embodiment of the disclosure, the input event includes a touch event, and the event type includes one or more of the following: a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event.

As an alternative or addition to the above solution, in the system according to an embodiment of the disclosure, the one or more guest machines run on the host machine based on the virtualization technology.

According to a third aspect of the disclosure, there is provided a vehicle, including the system according to any embodiment of the second aspect of the disclosure.

According to a fourth aspect of the disclosure, there is provided a computer storage medium, including instructions, where when the instructions are run, the method according to any one of the embodiments of the first aspect of the disclosure is performed.

According to the input event distribution solution for an intelligent cockpit in one or more embodiments of the disclosure, the input event is processed by the host machine in the case of the host machine and the one or more guest machines sharing the same touch display apparatus, and the input event is distributed based on the input area and the event type of the event, thereby solving the event distribution problem when the plurality of guest machines share the screen, and improving the human-machine interaction experience of users.

Brief Description of the Drawings

The above-mentioned and/or other aspects and advantages of the disclosure will become more apparent and more readily appreciated from the following description of various aspects in conjunction with the accompanying drawings, in which the same or similar units are denoted by the same reference numerals. In the drawings:

FIG. 1 is a schematic block diagram of an intelligent cockpit system 10 according to an embodiment of the disclosure; and

FIG. 2 is a schematic flowchart of an input event distribution method 20 for an intelligent cockpit according to an embodiment of the disclosure.

Detailed Description of Embodiments

The following descriptions of the specific embodiments are merely exemplary in nature, and are not intended to limit the disclosed technologies or the application and use of the disclosed technologies. In addition, there is no intention to be bound by any expressed or implied theory presented in the foregoing Technical Field and Background Art, or the following Detailed Description.

In the following detailed descriptions of the embodiments, many specific details are set forth to provide a more thorough understanding of the disclosed technologies. However, it is obvious for those of ordinary skill in the art that the disclosed technologies can be practiced without these specific details. In other instances, well-known features are not detailed, to avoid complicating the descriptions unnecessarily.

The terms such as "include" and "comprise" are used to indicate that in addition to the units and steps that are directly and clearly described in this specification, other units and steps that are not directly or clearly described are not excluded in the technical solutions of the disclosure. The terms such as “first” and “second” are not used to indicate sequences of units in terms of time, space, size, etc., and are merely used to distinguish between the units. In this specification, the term "vehicle" or another similar term herein include a general motor vehicle, such as a passenger vehicle (including a sport utility vehicle, a bus, a truck, etc. ) , and various commercial vehicles, and include a hybrid vehicle, an electric vehicle, a plug-in hybrid electric vehicle, and the like. A hybrid vehicle is a vehicle with two or more power sources, such as a vehicle powered by a gasoline engine and an electric motor.

Various exemplary embodiments according to the disclosure will be described below in detail with reference to the accompanying drawings.

Referring to FIG. 1 now, FIG. 1 is a schematic block diagram of an intelligent cockpit system 10 according to an embodiment of the disclosure. As shown in FIG. 1, the intelligent cockpit system 10 includes a host machine 110 and one or more guest machines 120, and the host machine 110 and the one or more guest machines 120 share a touch display apparatus. Exemplarily, the touch display apparatus may be part of the host machine 110, or may be an external display screen of the intelligent cockpit system 10. It should be noted that the disclosure does not limit a specific number of guest machines, and it should be understood that the intelligent cockpit system 10 shown in FIG. 1 may include any number of guest machines.

In order to implement multi-screen integration in an intelligent cockpit system (for example, the intelligent cockpit system 10) based on a service-oriented architecture (SOA) , a vehicle speed, warning signs, navigation, audio and video control, air-conditioning control, and other information need to be displayed on a shared screen (for example, a central control screen) , where different information are controlled by different guest machines or host machines. For example, vehicle safety-related information such as warning signs and vehicle speeds are generated and logically controlled by a vehicle instrument system, while navigation, audio and video control, air-conditioning control, and other functions are processed and controlled by an in-vehicle entertainment system.

In an embodiment, the host machine 110 is configured to implement an instrument display function of the vehicle instrument system, and one or more of the guest machines 120 are configured to implement an entertainment display function of the in-vehicle entertainment system. The host machine 110 and the one or more guest machines 120 may use different operating systems, such as QNX, Android, Linux, and Windows operating systems. In this embodiment, since the vehicle instrument system has relatively high real-time requirements, the host machine 110 generally uses a real-time operating system (for example, the QNX operating system) to control the operation of the vehicle instrument system, so as to implement real-time control tasks of the vehicle; and since the in-vehicle entertainment system is mainly configured to implement entertainment functions of a user and its real-time requirements are relatively low, the guest machine generally uses a non-real-time operating system (for example, Android, Linux, or Windows operating system) .

Optionally, the one or more guest machines 120 run on the host machine 110 based on the virmalization technology. Exemplarily, the host machine 110 uses the hypervisor virtualization technology, which provides a virtual operating platform to create and execute the software, firmware, or hardware of a virtual machine. Specifically, the host machine 110 (for example, a host machine using the QNX operating system) is used by a hypervisor to execute one or more virtual machines, that is, one or more guest machines 120, where the hypervisor provides a virmalized operating environment for the one or more guest machines 120 (for example, guest machines using the Android operating system) .

Exemplarily, the host machine 110 and the one or more guest machines 120 of the intelligent cockpit system 10 may communicate in any one of the following methods: a controller area network (CAN) bus, an in-vehicle local area network bus, a serial peripheral interface (SPI) , a serial communication bus, shared memory, and socket.

As mentioned above, the host machine 110 and the one or more guest machines 120 share a touch display apparatus. Specifically, the host machine 110 and/or the one or more guest machines 120 may have a dedicated display area in the touch display apparatus, and the host machine 110 and the one or more guest machines 120 may also have a common display area in the touch display apparatus. In an example, a part of the display area of the touch display apparatus (that is, the dedicated display area) is dedicated to touch and display of the one or more guest machines 120, and the remaining part of the display area (that is, the common display area) can be used for touch and display of the one or more guest machines 120, and can also be used for touch and display of the host machine 110. In another example, a part of the display area of the touch display apparatus is dedicated to touch and display of the host machine 110, and the remaining part of the display area is used for touch and display of the one or more guest machines 120, and is also used for touch and display of the host machine 110.

When a user inputs an instruction in the common display area of the touch display apparatus, the host machine 110 is configured to mark the instruction as a corresponding input event (for example, a touch event or a key pressing event) , process the input event, and distribute, based on different input areas and event types, the input event to a corresponding guest machine 120 or consumed by the host machine 110 itself. Exemplarily, the guest machine 110 stores registration information including an input area, an event type, and a distribution address of a guest machine in a correspondence table, and distributes the input event based on the correspondence table. On the basis of that the correspondence table is already obtained, when receiving an input event inputted via the touch display apparatus, the host machine 110 may identify an input area and an event type of the input event, and distribute the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine. Optionally, the input event includes a touch event, and the event type may be any one of a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event. It should be noted that the identification of the input area and the event type may be based on identification methods known in the art, and are not specifically limited in the disclosure.

Specifically, the host machine 110 receives a registration request from the guest machine 120 or a host application installed on the host machine 110, where the registration request includes a specific input area of interest to the guest machine 120 or the host application and a specific event type that acts on the input area. The host machine 110 then stores a correspondence between a distribution address of the guest machine 120 or the host application, the specific input area of interest, and the specific event type in the correspondence table, so as to distribute the input event to the guest machine 120 or the host application when identifying the specific input area and the specific event type.

Optionally, different event types for a same input area may be of interest to different guest machines 120. Exemplarily, the one or more guest machines 120 include a first guest machine 121 and the host machine 110 is further configured to: receive a first registration request from the first guest machine 121, the first registration request including a first input area of interest to the first guest machine and a first event type (for example, a short press click event) that acts on the first input area; store a correspondence between a distribution address of the first guest machine 121, the first input area, and the first event type in the correspondence table; and if an input area of the input event is identified as the first input area and an event type of the input event is identified as the first event type, send the input event to the first guest machine 121. In addition, the one or more guest machines 120 further include a second guest machine 122 and the host machine 110 is further configured to: receive a second registration request from the second guest machine 122, the second registration request including the first input area of interest to the second guest machine 122 and a second event type (for example, a long press click event) that acts on the first input area, where the second event type is different from the first event type; store a correspondence between a distribution address of the second guest machine 122, the first input area, and the second event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, send the input event to the second guest machine 122.

Optionally, different event types for a same input area may be of interest to the host application installed on the host machine 110 and the guest machine 120. Exemplarily, the host machine 110 is further configured to: receive a third registration request issued by a host application installed on the host machine 110, the third registration request including the first input area of interest to the host application and a third event type (for example, a rightward sliding event) that acts on the first input area, where the third event type is different from the first event type; store a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table; and if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, send the input event to the host application.

According to the intelligent cockpit system 10 in one or more embodiments of the disclosure, the input event is processed by the host machine in the case of the host machine and the one or more guest machines sharing the same touch display apparatus, and the input event is distributed based on the input area and the event type of the event, thereby solving the event distribution problem when the plurality of guest machines share the screen, and improving the human-machine interaction experience of users.

With continued reference to FIG. 2, FIG. 2 is a schematic flowchart of an input event distribution method 20 for an intelligent cockpit according to an embodiment of the disclosure. An implementation body of the method 20 shown in FIG. 2 may be the system 10 in FIG. 1.

Optionally, the method 20 includes a registration step S 110. Step S 110 includes: receiving a first registration request from the first guest machine, the first registration request including a first input area of interest to the first guest machine and a first event type that acts on the first input area; and storing a correspondence between a distribution address of the first guest machine, the first input area, and the first event type in the correspondence table. Optionally, Si10 further includes: receiving a second registration request from the second guest machine, the second registration request including the first input area of interest to the second guest machine and a second event type that acts on the first input area, where the second event type is different from the first event type; and storing a correspondence between a distribution address of the second guest machine, the first input area, and the second event type in the correspondence table. Optionally, S110 further includes: receiving a third registration request issued by a host application installed on the host machine, the third registration request including the first input area of interest to the host application and a third event type that acts on the first input area, where the third event type is different from the first event type; and storing a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table.

Step S120 includes: receiving an input event inputted via the touch display apparatus. Exemplarily, the input event includes a touch event and a key pressing event. Step S130 includes: identifying an input area and an event type of the input event. Exemplarily, the event type includes one or more of the following: a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event.

Step S140 includes: distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine. Optionally, step S140 includes: if an input area of the input event is identified as the first input area and an event type of the input event is identified as the first event type, send the input event to the first guest machine; or if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, send the input event to the second guest machine. Optionally, step S140 further includes: if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, send the input event to the host application.

According to a third aspect of the disclosure, there is further provided a vehicle, including the system 10 shown in FIG. 1.

According to a fourth aspect of the disclosure, there is further provided a computer-readable storage medium having a computer program stored thereon, where when the program is executed by a processor, the method 20 shown in FIG. 2 is implemented. The computer-readable storage medium may include a random access memory (RAM) such as a synchronous dynamic random access memory (SDRAM) , a read-only memory (ROM) , a non-volatile random access memory (NVRAM) , an electrically erasable programmable read-only memory (EEPROM) , a flash memory, or another known storage medium.

Various embodiments provided in the disclosure may be implemented by hardware, software, or a combination of hardware and software where applicable. In addition, without departing from the scope of the disclosure, various hardware components and/or software components described in this specification may be combined into a combined component including software, hardware, and/or both where applicable. Without departing from the scope of the disclosure, various hardware components and/or software components described in this specification may be separated into sub-components including software, hardware, or both where applicable. In addition, where applicable, it is contemplated that software components can be implemented as hardware components, and vice versa.

Software (such as program code and/or data) in the disclosure may be stored on one or more computer storage media. It is also contemplated that the software identified herein can be implemented using one or more general-purpose or special-purpose computers and/or computer systems, networked and/or otherwise. The steps described herein can be changed in order, combined into compound steps, and/or divided into sub-steps where applicable, to provide the features described herein.

The embodiments and examples proposed herein are provided to describe as adequately as possible embodiments according to the disclosure and specific applications thereof and thus enable those skilled in the art to implement and use the disclosure. However, those skilled in the art will know that the above descriptions and examples are provided only for description and illustration. The proposed description is not intended to cover all aspects of the disclosure or limit the disclosure to the disclosed precise forms.

Claims

An input event distribution method for an intelligent cockpit, wherein the intelligent cockpit is deployed with a host machine and one or more guest machines, and the host machine and the one or more guest machines share a touch display apparatus and the method comprises the following steps:

receiving an input event inputted via the touch display apparatus;

identifying an input area and an event type of the input event; and

distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine.
The method according to claim 1, wherein the one or more guest machines comprise a first guest machine; and

the method further comprises:

receiving a first registration request from the first guest machine, the first registration request comprising a first input area of interest to the first guest machine and a first event type that acts on the first input area; and

storing a correspondence between a distribution address of the first guest machine, the first input area, and the first event type in the correspondence table; and

the distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine comprises:

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the first event type, sending the input event to the first guest machine.
The method according to claim 2, wherein the one or more guest machines further comprise a second guest machine; and

the method further comprises:

receiving a second registration request from the second guest machine, the second registration request comprising the first input area of interest to the second guest machine and a second event type that acts on the first input area, wherein the second event type is different from the first event type; and

storing a correspondence between a distribution address of the second guest machine, the first input area, and the second event type in the correspondence table; and

the distributing the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine comprises:

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, sending the input event to the second guest machine.
The method according to claim 2, wherein the method further comprises:

receiving a third registration request issued by a host application installed on the host machine, the third registration request comprising the first input area of interest to the host application and a third event type that acts on the first input area, wherein the third event type is different from the first event type;

storing a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table; and

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, sending the input event to the host application.
The method according to claim 1, wherein the input event comprises a touch event, and the event type comprises one or more of the following: a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event.
The method according to claim 1, wherein the one or more guest machines run on the host machine based on the virtualization technology.
An intelligent cockpit system, wherein the intelligent cockpit is deployed with a host machine and one or more guest machines, and the host machine and the one or more guest machines share a touch display apparatus and the host machine is configured to:

receive an input event inputted via the touch display apparatus;

identify an input area and an event type of the input event; and

distribute the input event to a corresponding guest machine based on a pre-stored correspondence table between an input area, an event type, and a distribution address of a guest machine.
The system according to claim 7, wherein the one or more guest machines comprise a first guest machine and the host machine is further configured to:

receive a first registration request from the first guest machine, the first registration request comprising a first input area of interest to the first guest machine and a first event type that acts on the first input area;

store a correspondence between a distribution address of the first guest machine, the first input area, and the first event type in the correspondence table; and

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the first event type, send the input event to the first guest machine.
The system according to claim 8, wherein the one or more guest machines further comprise a second guest machine and the host machine is further configured to:

receive a second registration request from the second guest machine, the second registration request comprising the first input area of interest to the second guest machine and a second event type that acts on the first input area, wherein the second event type is different from the first event type;

store a correspondence between a distribution address of the second guest machine, the first input area, and the second event type in the correspondence table; and

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the second event type, send the input event to the second guest machine.
The system according to claim 8, wherein the host machine is further configured to:

receive a third registration request issued by a host application installed on the host machine, the third registration request comprising the first input area of interest to the host application and a third event type that acts on the first input area, wherein the third event type is different from the first event type;

store a correspondence between an address of the host application, the first input area, and the third event type in the correspondence table; and

if the input area of the input event is identified as the first input area and the event type of the input event is identified as the third event type, send the input event to the host application.
The system according to claim 7, wherein the input event comprises a touch event, and the event type comprises one or more of the following: a short press click event, a long press click event, a rightward sliding event, a leftward sliding event, an upward sliding event, and a downward sliding event.
The system according to claim 7, wherein the one or more guest machines run on the host machine based on the virtualization technology.
A vehicle, comprising a system according to any one of claims 8 to 12.
A computer storage medium, comprising instructions, wherein when the instructions are run, a method according to any one of claims 1 to 7 is performed.