WO2024022366A1

WO2024022366A1 - In-car entertainment information display method and apparatus, device, and medium

Info

Publication number: WO2024022366A1
Application number: PCT/CN2023/109228
Authority: WO
Inventors: 罗雪; 回姝; 王淑琴
Original assignee: 中国第一汽车股份有限公司
Priority date: 2022-07-26
Filing date: 2023-07-26
Publication date: 2024-02-01
Also published as: CN115185408A

Abstract

Disclosed in the embodiments of the present application are an in-car entertainment information display method, apparatus and system, a device, and a medium. The method comprises: in response to an information confirmation operation by a user in a preset in-car entertainment system interaction interface, acquiring information content to be displayed; and rendering said information content and sending a rendering result to a preset augmented reality head-up display for information display, the preset augmented reality head-up display and an in-car entertainment information domain controller being physically connected by means of a low-voltage differential signal cable.

Description

A vehicle entertainment information display method, device, equipment and medium

This application claims priority to the Chinese patent application with application number 202210884641.2, which was submitted to the China Patent Office on July 26, 2022. The entire content of this application is incorporated into this application by reference.

Technical field

Embodiments of the present application relate to the field of vehicle display technology, for example, to a vehicle entertainment information display method, device, equipment and medium.

Background technique

The input source of AR-HUD (Augmented Reality head up display) is usually CAN signal or Ethernet signal. Since most of the displayed content of AR-HUD is driving information, the SDK (Software Development) integrated in the domain controller Kit (software development tool kit) is usually deployed on the QNX or Linux operating system side. However, AR-HUD cannot directly obtain and display images or related data of navigation applications, video applications, game applications and other applications on the Android system-side vehicle infotainment system, and cannot meet the real-time nature of entertainment information display.

Contents of the invention

Embodiments of the present application provide a vehicle entertainment information display method, device, equipment and medium, which can improve the real-time performance of vehicle entertainment information display based on an augmented reality head-up display.

In a first aspect, embodiments of the present application provide a method for displaying in-vehicle entertainment information. The method includes:

In response to the user's information confirmation operation on the preset in-vehicle entertainment system interactive interface, obtain the information content to be displayed;

Render the information content to be displayed, and send the rendering results to the preset augmented reality head-up display for information display;

Among them, the preset augmented reality head-up display and the vehicle entertainment information domain controller are connected through a low voltage difference. Separate signal lines to achieve physical connection.

In a second aspect, embodiments of the present application provide a vehicle-mounted entertainment information display device, which includes:

The information to be displayed acquisition module is configured to obtain the content of the information to be displayed in response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface;

An information display module, configured to render the information content to be displayed, and send the rendering results to a preset augmented reality heads-up display for information display;

Wherein, the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line.

In a third aspect, embodiments of the present application provide a vehicle entertainment system, which includes:

Vehicle entertainment information application subsystem, vehicle entertainment information domain controller and augmented reality head-up display; wherein, the augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line;

The vehicle entertainment information domain controller is configured to send the rendered information to be displayed in the vehicle entertainment information application subsystem to the augmented reality head-up display through the physical connection for information display.

In a fourth aspect, embodiments of the present application provide a computer device, where the computer device includes:

at least one processor;

a memory configured to store at least one program;

When the at least one program is executed by the at least one processor, the at least one processor implements the vehicle entertainment information display method described in any embodiment.

In a fifth aspect, embodiments of the present application provide a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the vehicle entertainment information display method described in any embodiment is implemented.

Description of drawings

Figure 1 is a flow chart of a vehicle entertainment information display method provided in Embodiment 1 of the present application;

Figure 2 is a flow chart of a vehicle entertainment information display method provided in Embodiment 2 of the present application;

Figure 3 is a schematic structural diagram of a vehicle-mounted entertainment information display device provided in Embodiment 3 of the present application;

Figure 4 is a work flow chart of an in-vehicle entertainment system provided in Embodiment 4 of the present application;

Figure 5 is a schematic structural diagram of a computer device provided in Embodiment 5 of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application.

Embodiment 1

Figure 1 is a flow chart of a vehicle entertainment information display method provided in Embodiment 1 of the present application. The embodiment of the present application can be applied to a scenario where an augmented reality head-up display displays vehicle entertainment information. This method can be executed by a vehicle entertainment information display device. The device may be implemented by software and/or hardware.

As shown in Figure 1, the vehicle entertainment information display method includes the following steps:

S110. In response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface, obtain the information content to be displayed.

Among them, the preset vehicle entertainment system interactive interface is used for users to interact with the vehicle entertainment system, which can be provided by the vehicle driving computer. The user can confirm the information content to be displayed through the preset vehicle entertainment system interactive interface, thereby obtaining the information content to be displayed. The information content to be displayed represents the entertainment information content selected by the user that needs to be displayed, which may be video image content or game interface content.

S120. Render the information content to be displayed, and send the rendering result to the preset augmented reality head-up display for information display.

Among them, rendering refers to the process of using software to generate images from models, used to describe the effects in computational video editing software, and to generate the final video output. The preset augmented reality head-up display, or AR-HUD display, can project the rendering results to the driver's front field of view.

The in-vehicle entertainment information display device renders the content of the information to be displayed, and then, through the in-vehicle entertainment The information domain controller sends the rendering results to the preset augmented reality head-up display for information display. In this embodiment, the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line, and can directly receive and display the data content to be displayed from the vehicle entertainment system.

The low-voltage differential signal line has the advantages of high-speed transmission capability, low power consumption and strong anti-interference ability, and also ensures the smoothness of the entertainment information display process.

The technical solution provided by the embodiment of the present application obtains the information content to be displayed by responding to the user's information confirmation operation on the preset in-vehicle entertainment system interactive interface; renders the information content to be displayed, and sends the rendering result to the preset augmented reality Head-up display for information display. The technical solution of the embodiment of the present application solves the problem in related technologies of insufficient real-time performance of in-vehicle entertainment information display based on augmented reality head-up display, and can improve the real-time performance of in-vehicle entertainment information display based on augmented reality head-up display, bringing good benefits to users. Entertainment experience.

Embodiment 2

Figure 2 is a flow chart of a method for displaying in-vehicle entertainment information provided in Embodiment 2 of the present application. This embodiment of the present application can be applied to a scenario where an augmented reality head-up display displays in-vehicle entertainment information. Based on the above embodiment, this embodiment Describes how to send rendering results to a preset augmented reality head-up reality device and when to end displaying in-vehicle entertainment information. This method can be executed by an in-vehicle entertainment information display device. The device can be implemented by software and/or hardware and integrated in In computer equipment with application development capabilities.

As shown in Figure 2, the vehicle entertainment information display method includes the following steps:

S210. In response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface, obtain the information content to be displayed.

Among them, the preset vehicle entertainment system interactive interface is used for users to interact with the vehicle entertainment system, which can be provided by the vehicle driving computer. The user can confirm the information content to be displayed through the preset vehicle entertainment system interactive interface, thereby obtaining the information content to be displayed. The information content to be displayed represents the entertainment information selected by the user that needs to be displayed, including video image content and game interface content.

S220: Render the information content to be displayed, and send the rendering result to a preset augmented reality head-up display based on physical connection and through the I2C bus communication protocol for information display.

Among them, the physical connection refers to the connection between the preset augmented reality head-up display and the vehicle entertainment information domain controller through a low-voltage differential signal line. Based on the physical connection and through the I2C bus communication protocol, the rendering results are sent to the preset augmented reality head-up display for information display. Among them, the I2C bus hardware structure is simple, which can simplify wiring, reduce system costs, and improve system reliability.

S230. When the vehicle enters the driving mode or the system setting mode, stop rendering the content of the information to be displayed, and stop sending the rendered information to be displayed to the preset augmented reality head-up display.

Among them, the driving mode refers to the mode when the vehicle is in a driving state. In order to ensure the safety of the vehicle, the vehicle stops displaying the in-car entertainment information when the vehicle is in the driving mode. The user can select the vehicle to enter the driving mode through the in-car entertainment system interactive interface. In addition, in order to ensure driving safety, the vehicle speed can be sensed through the vehicle speed sensor. When the vehicle is in a non-stationary state, that is, when the vehicle speed is not equal to zero, the vehicle will continue to drive. model.

The system setting mode refers to the mode in which the vehicle is in the system setting state. In the system setting mode, the setting item information from the central control display can be forwarded and sent to the preset augmented reality head-up display, such as turning on and off the preset augmented reality head-up display. Status, height adjustment, brightness adjustment and tilt adjustment, etc. The user can select the vehicle to enter the system setting mode through the in-vehicle entertainment system interactive interface. In this state, the system settings of the augmented reality head-up display need to be performed, so the in-vehicle entertainment information stops displaying.

When the vehicle enters the driving mode or system setting mode, it will stop rendering the content of the information to be displayed and stop sending the rendered information to be displayed to the preset augmented reality head-up display, that is, it will stop displaying the in-car entertainment information.

The technical solution provided by the embodiment of the present application obtains the information content to be displayed by responding to the user's information confirmation operation on the preset in-vehicle entertainment system interactive interface; the content of the information to be displayed is rendered based on the physical connection and through the I2C bus communication protocol. Send the rendering results to the preset augmented reality head-up display for information display; when the vehicle enters driving mode or system setting mode, it stops waiting for display. Render the displayed information content and stop sending the rendered information to be displayed to the preset augmented reality head-up display. The technical solutions of the embodiments of the present application solve the problem in related technologies of insufficient real-time display of in-vehicle entertainment information based on augmented reality heads-up displays, and can improve the real-time display of in-vehicle entertainment information based on augmented reality heads-up displays while ensuring user safety. Under the premise, it can bring users a good entertainment experience.

Embodiment 3

Figure 3 is a schematic structural diagram of a vehicle-mounted entertainment information display device provided in Embodiment 3 of the present application. This embodiment of the present application can be applied to a scenario where an augmented reality head-up display displays vehicle-mounted entertainment information. The device can be composed of software and/or hardware. It is implemented in a way that is integrated into computer equipment with application development capabilities.

As shown in FIG. 5 , the vehicle entertainment information display device includes: an information acquisition module 310 to be displayed and an information display module 320 .

Among them, the information to be displayed acquisition module 310 is configured to obtain the content of the information to be displayed in response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface; the information display module 320 is configured to render the content of the information to be displayed, and render the information The results are sent to the preset augmented reality head-up display for information display; the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through low-voltage differential signal lines.

The technical solution provided by the embodiment of the present application obtains the information content to be displayed by responding to the user's information confirmation operation on the preset in-vehicle entertainment system interactive interface; renders the information content to be displayed, and sends the rendering result to the preset augmented reality Head-up display displays information; among them, the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through low-voltage differential signal lines. The technical solutions of the embodiments of the present application solve the problem in related technologies of insufficient real-time display of vehicle entertainment information based on augmented reality heads-up displays, and can improve the real-time display of vehicle entertainment information based on augmented reality heads-up displays, bringing good benefits to users. Entertainment experience.

In an optional implementation, the vehicle entertainment information display device further includes: a signal switching module configured to stop rendering the information content to be displayed when the vehicle enters the driving mode or the system setting mode. dye, and stop sending already rendered information to be displayed to the default augmented reality head-up display.

The vehicle-mounted entertainment information display device provided by the embodiments of this application can execute the vehicle-mounted entertainment information display method provided by any embodiment of this application, and has corresponding functional modules for executing the method.

Embodiment 4

An embodiment of the present application provides a vehicle entertainment system, which includes:

Vehicle entertainment information application subsystem, vehicle entertainment information domain controller and augmented reality head-up display; among them, the augmented reality head-up display and vehicle entertainment information domain controller are physically connected through low-voltage differential signal lines; the vehicle entertainment information application subsystem is set to render Information to be displayed.

The in-vehicle entertainment information domain controller is configured to send the rendered information to be displayed in the in-vehicle entertainment information application subsystem to the augmented reality head-up display through a physical connection for information display.

In an optional implementation, the vehicle entertainment information domain controller is connected to the preset vehicle operation control subsystem, and an information interaction channel is provided between the preset vehicle operation control subsystem and the vehicle entertainment information application subsystem. Among them, the user can select the information to be displayed through the preset vehicle operation control subsystem, and then send it to the vehicle entertainment information domain controller through the information interaction channel.

Figure 4 is a work flow chart of an in-vehicle entertainment system provided in Embodiment 4 of the present application. Among them, the vehicle entertainment information application subsystem includes: "video playback APP", "game APP" and "navigation or other APP"; the "vehicle entertainment information domain controller" is set to send entertainment information in the Android system to the augmented reality head-up The monitor displays information; "AR-HUD screen" means augmented reality head-up display; "HUD system setting APP" can be used to select HUD screen setting information and send it to QNX (Quick Unix, embedded real-time operating system) through inter-domain communication or Linux system, and then forwarded to the AR-HUD screen; "LVDS" means low-voltage differential signal line.

As shown in Figure 4, in the entertainment state, the video playback APP or game APP can render pictures, such as video frames or game frames. The in-vehicle entertainment information domain controller and the AR-HUD screen are connected through the LVDS wiring harness. When the data rendered by the video playback APP or game APP is successful, the rendering results are sent to the AR-HUD screen for display through the I2C bus communication protocol based on the LVDS wiring harness.

When the vehicle enters driving mode or system setting mode, it stops rendering the information to be displayed. And stop sending already rendered information to be displayed to the default augmented reality head-up display. Among them, when the vehicle enters the driving mode, the HUD APP is set to process the input driving data and render the display screen. When the data rendered by the HUD APP is successful, the rendering results are sent to the AR-HUD screen through the I2C bus communication protocol based on the LVDS wiring harness. show. Among them, driving information includes driving information, Advanced Driver Assistance Systems (ADAS) information, instrument information, etc. When the vehicle enters the system setting mode, the QNX or Linux system forwards the setting item information from the HUD system setting APP to the AR-HUD screen, such as the opening and closing status of the AR-HUD screen, height adjustment, brightness adjustment, and tilt adjustment, etc.

Embodiment 5

FIG. 5 is a schematic structural diagram of a computer device provided in Embodiment 5 of the present application. Figure 5 illustrates a block diagram of an exemplary computer device 12 suitable for implementing embodiments of the present application. The computer device 12 shown in FIG. 5 is only an example and should not bring any limitations to the functions and scope of use of the embodiments of the present application. The computer device 12 can be any terminal device with computing capabilities, and can be configured in a vehicle-mounted entertainment information display device.

As shown in Figure 5, computer device 12 is embodied in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: at least one processor or processing unit 16, system memory 28, and a bus 18 connecting various system components, including system memory 28 and processing unit 16.

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics accelerated port, a processor, or a local bus using any of a variety of bus structures. For example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA bus, Video Electronics Standards Association (Video Electronics Standards) Association, VESA) local bus and Peripheral Component Interconnect (PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. These media may be any available media that can be accessed by computer device 12, including volatile and nonvolatile media, removable and non-removable media.

System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write to non-removable, non-volatile magnetic media (not shown in Figure 5, commonly referred to as a "hard drive"). Although not shown in FIG. 5, a disk drive may be provided for reading and writing to a removable non-volatile disk (such as a "floppy disk"), and for reading and writing to a removable non-volatile optical disk (such as a Compact Disc- Read Only Memory, CD-ROM), digital video disk (Digital Video Disc-Read Only Memory, DVD-ROM) or other optical media) read and write optical disc drive. In these cases, each drive may be connected to bus 18 via at least one data media interface. System memory 28 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present application.

A program/utility 40 having a set of (at least one) program modules 42, including but not limited to an operating system, at least one application program, other program modules, and program data, may be stored, for example, in system memory 28. Each of these examples, or some combination, may include the implementation of a network environment. Program modules 42 generally perform functions and/or methods in the embodiments described herein.

Computer device 12 may also communicate with at least one external device 14 (e.g., keyboard, pointing device, display 24, etc.), and with at least one device that enables a user to interact with computer device 12, and/or with computer device 12 that enables the computer device 12 to interact with the computer device 12. 12. Any device (eg, network card, modem, etc.) capable of communicating with at least one other computing device. This communication may occur through an input/output (I/O) interface 22 . Furthermore, the computer device 12 can also communicate with at least one network (eg, a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the Internet) through the network adapter 20 . As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18 . It should be understood that, although not shown in Figure 5, it may Use other hardware and/or software modules in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk arrays (Redundant Arrays of Independent Disks, RAID) systems, tape drives, and Data backup storage system, etc.

The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the vehicle entertainment information display method provided by the embodiment of the present invention. The method includes:

In response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface, the information content to be displayed is obtained.

Render the information content to be displayed, and send the rendering result to a preset augmented reality head-up display for information display.

Embodiment 6

Embodiment 6 provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the method for displaying vehicle entertainment information as provided in any embodiment of the present application is implemented, including:

The computer storage medium in the embodiment of the present application can use any combination of at least one computer-readable medium. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to: an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. computer readable storage media More specific examples (non-exhaustive list) include: electrical connection with at least one conductor, portable computer disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory ((Erasable Programmable Read-Only Memory, EPROM) or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. As used herein, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .

Program code embodied on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, radio frequency (Radio Frequency, RF), etc., or any suitable combination of the above.

Computer program code for performing the operations of the present application may be written in one or more programming languages, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages, or a combination thereof. A programming language, such as "C" or a similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through the Internet). connect).

Those of ordinary skill in the art should understand that each module or step of the above-mentioned application can be They can be implemented using a computing device. They can be centralized on a single computing device or distributed on a network composed of multiple computing devices. Alternatively, they can be implemented using program codes executable by a computer device, so that they can be The storage in the storage device is performed by the computing device, or they are separately made into individual integrated circuit modules, or multiple modules or steps among them are made into a single integrated circuit module. As such, the application is not limited to any specific combination of hardware and software.

Claims

A vehicle entertainment information display method, including:

In response to the user's information confirmation operation on the preset in-vehicle entertainment system interactive interface, obtain the information content to be displayed;

Render the information content to be displayed, and send the rendering results to the preset augmented reality head-up display for information display;

Wherein, the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line.
The method according to claim 1, wherein sending the rendering result to a preset augmented reality head-up reality device includes:

Based on the physical connection, the rendering result is sent to the preset augmented reality head-up display through the I2C bus communication protocol.
The method according to claim 1, wherein the information content to be displayed includes:

At least one of video image content and game interface content.
The method of claim 1, further comprising:

In response to the vehicle entering the driving mode or the system setting mode, the rendering of the information content to be displayed is stopped, and the rendering of the information to be displayed is stopped to the preset augmented reality head-up display.
A vehicle-mounted entertainment information display device, including:

The information to be displayed acquisition module is configured to obtain the content of the information to be displayed in response to the user's information confirmation operation on the preset vehicle entertainment system interactive interface;

An information display module, configured to render the information content to be displayed, and send the rendering results to a preset augmented reality heads-up display for information display;

Wherein, the preset augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line.
The device of claim 5, further comprising:

A signal switching module configured to stop rendering the information content to be displayed in response to the vehicle entering the driving mode or the system setting mode, and stop sending the displayed information to the preset augmented reality head-up display. Rendered information to be displayed.
An in-vehicle entertainment system, including:

Vehicle entertainment information application subsystem, vehicle entertainment information domain controller and augmented reality head-up display; wherein, the augmented reality head-up display and the vehicle entertainment information domain controller are physically connected through a low-voltage differential signal line;

The vehicle entertainment information domain controller is configured to send the rendered information to be displayed in the vehicle entertainment information application subsystem to the augmented reality head-up display through the physical connection for information display.
The system according to claim 7, wherein the vehicle entertainment information domain controller is connected to a preset vehicle operation control subsystem, and one of the preset vehicle operation control subsystem and the vehicle entertainment information application subsystem There are information exchange channels between them.
A computer device consisting of:

at least one processor;

a memory configured to store at least one program;

When the at least one program is executed by the at least one processor, the at least one processor implements the vehicle entertainment information display method as described in any one of claims 1-4.
A computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the vehicle entertainment information display method as described in any one of claims 1-4 is implemented.