CN116834550A - Dual-system display method and device, electronic equipment and storage medium - Google Patents

Dual-system display method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN116834550A
CN116834550A CN202310657741.6A CN202310657741A CN116834550A CN 116834550 A CN116834550 A CN 116834550A CN 202310657741 A CN202310657741 A CN 202310657741A CN 116834550 A CN116834550 A CN 116834550A
Authority
CN
China
Prior art keywords
avm
qnx
app
android
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310657741.6A
Other languages
Chinese (zh)
Inventor
周韬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Faw Beijing Software Technology Co ltd
FAW Group Corp
Original Assignee
Faw Beijing Software Technology Co ltd
FAW Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Faw Beijing Software Technology Co ltd, FAW Group Corp filed Critical Faw Beijing Software Technology Co ltd
Priority to CN202310657741.6A priority Critical patent/CN116834550A/en
Publication of CN116834550A publication Critical patent/CN116834550A/en
Pending legal-status Critical Current

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Digital Computer Display Output (AREA)

Abstract

A dual system display method, comprising: when the Android system is not started, the QNX system starts an AVM app, an AVM first image is displayed on a display screen, and a QNX layer is covered on the Android layer; when the Android system is started, the Android system starts the AVM/parking app and displays an interface of the AVM/parking app; and closing the QNX layer when the start of the AVM/parking app in the Android system is completed. According to the dual-system AVM display method provided by the application, under the scene of rapidly starting the AVM, the simplified AVM picture is displayed from the QNX system with high starting speed, and after the Android system is started, the normal AVM picture is displayed from the Android system in a seamless manner, so that a user can use the AVM without waiting, and the use experience of the user is improved.

Description

Dual-system display method and device, electronic equipment and storage medium
Technical Field
The present application relates to the field of intelligent automobiles, and more particularly, to a dual-system display method, apparatus, electronic device, and storage medium.
Background
In recent years, the AVM (360-degree panoramic image) in most cabin schemes is independently controlled by an AVM controller to output a display interface of the AVM controller, and is mutually independent from a vehicle system, along with gradual upgrade of ADAS functions, a fusion parking scheme based on round view and ultrasonic wave and landing of a vehicle body side azimuth high-speed driving sensing scheme are required to be deeply fused with the vehicle system to improve user operation experience, an operating system of many intelligent cabins is composed of a QNX and Android dual system, the QNX system is started quickly and has good instantaneity and high reliability, but the system is not started, 3D engine support is lacked, the development of the AVM/parking application is difficult, and Android is developed based on a Linux system kernel.
Disclosure of Invention
In order to solve the technical problems, the present application provides a dual-system display method, including:
when the Android system is not started, the QNX system starts an AVM app, an AVM first image is displayed on a display screen, and a QNX layer is covered on the Android layer;
when the Android system is started, the Android system starts an AVM/parking app and displays an interface of the AVM/parking app;
when the start of the AVM/parking app in the Android system is completed, a first completion message is sent to the VDC/HAD module;
the VDC/HAD module outputs an AVM second image;
the AVM/parking app sends a second completion message to the AVM app;
the AVM app closes the QNX layer according to the second completion message.
Optionally, the dual system display method further includes:
the AVM app obtains the synthesized image of the VDC/HAD module from the AIS server by calling a qcarpam API;
the AVM/parking app calls a camera2 API native to the Android system to acquire image data;
the Camera HAL3 calls AIS FE through the qcarpam API, the AIS FE communicates with AIS BE deployed in the QNX system, and image data is acquired through an AIS server in the QNX system.
Optionally, the dual system display method further includes:
the DRM driver in the Android system calls OpenWFD FE;
the OpenWFD FE communicates with the OpenWFD BE and completes display operation through an OpenWFD server in the QNX system;
when the demand of the Display/Graphic operation exists in the Android system, forwarding the demand of the Display/Graphic operation to the QNX system, and completing the Display/Graphic operation by the QNX system.
Optionally, the dual system display method further includes:
distributing a plurality of pipeline for the QNX system and the Android system by configuring the OpenWFD;
by setting the z-order attribute of the pipeline, when the QNX system and the Android system are displayed on a central control screen at the same time, the QNX layer covers the Android layer;
the Screen service in the QNX system distributes a first pipeline and a second pipeline, the first pipeline is displayed on the instrument Screen, the second pipeline is displayed on the central control Screen, the Android system distributes a third pipeline, and the third pipeline is displayed on the central control Screen.
Optionally, the dual system display method further includes:
when an HMI interface is displayed on an application in the QNX system, calling the Screen service and the OpenWFD server to complete corresponding synthesis and display operation;
displaying an interface on the meter screen through the first pipeline;
and when the AVM app needs to be displayed, displaying an image on the central control screen through the second pipeline.
Optionally, the dual system display method further includes:
when the AVM/parking app has display requirements, synthesizing and displaying the content to be displayed through a SurfaceFlinger;
after the SurfaceFlinger synthesizes the display content, invoking the OpenWFD FE through HWC and DRM/KMS;
the OpenWFD FE communicates with the OpenWFD BE through a HAB;
and the OpenWFD BE displays the synthesized content to the central control screen through the OpenWFD server.
Optionally, the AVM/parking app may receive touch events of the touch screen and send coordinate information and gesture information to the VDC/HAD module;
and entering an automatic parking interface when a user clicks an automatic parking button, wherein the automatic parking interface increases a 3D view area to be covered on a panoramic image area, the panoramic image area is smaller, and the 3D view area is drawn by the Andoird system.
According to another aspect of the present application, there is also provided a dual system display device, comprising:
the AVM app starting module is configured to start the AVM app by the QNX system when the Android system is not started, display an AVM first image on a display screen, and cover the QNX layer on the Android layer;
the Android system is configured to start the AVM/parking app when the Android system is started, and display an interface of the AVM/parking app;
the first completion message sending module is configured to send a first completion message to the VDC/HAD module when the start of the AVM/parking app in the Android system is completed;
the AVM second image output module is configured to output an AVM second image;
a second completion message sending module configured to send a second completion message to the AVM app;
and the QNX layer closing module is configured to close the QNX layer according to the second completion message.
According to still another aspect of the present application, there is provided an electronic apparatus including: a processor; and a memory having stored therein computer program instructions that, when executed by the processor, cause the processor to perform the dual system display method as described above.
According to yet another aspect of the present application, there is provided a computer readable medium having stored thereon computer program instructions which, when executed by a processor, cause the processor to perform the dual system display method as described above.
Compared with the prior art, the AVM display method based on the QNX+android dual system provided by the application has the advantages that under the scene of rapidly starting the AVM, a simplified AVM picture is displayed from the QNX system with rapid starting speed, and after the Android system is started, the normal AVM picture is displayed from the Android system in a seamless manner, so that a user can use the AVM without waiting, and the use experience of the user is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application, are incorporated in and constitute a part of this specification. The drawings and their description are illustrative of the application and are not to be construed as unduly limiting the application. In the drawings:
FIG. 1 is a schematic diagram of a dual system display method according to an embodiment of the application;
FIG. 2 is a schematic diagram of a dual system display method according to an embodiment of the application;
FIG. 3 is a schematic diagram of a dual system display method according to an embodiment of the application;
FIG. 4 is a flow chart of a dual system display method according to an embodiment of the application;
fig. 5 is a block diagram of an electronic device according to an embodiment of the application.
Detailed Description
In order that those skilled in the art will better understand the present application, a technical solution in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, shall fall within the scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present application and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate in order to describe the embodiments of the application herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.
Some technical terms of the present application are explained as follows:
AVM (Around View Monitor) panoramic image system
ADAS (Advanced Driver Assistant Systems) advanced driving assistance system
VDC (Vehicle Dynamic Control) vehicle dynamic control system
HAD (Highly Automous Driving) advanced driving controller
LVDS (Low Voltage Differential Signaling) low voltage differential signal
AIS (Automotive Imaging System) automobile image system (high-pass platform)
HAB (Hypervisor Abstract Communication Driver) virtual machine monitor abstract communication driver (high-pass platform)
BE (Back End) rear End
Front End of FE (Front End)
OpenWFD (OpenWF Display) OpenWF display system
DPU (Display Processing unit) display processing unit
GPU (Graphics Processing Unit) graphic processing unit
OpenGL/EGL(Open Graphics Library/Embedded-System Graphics Library)
Open graphic library/embedded system graphic library
DRM/KMS (Direct Rendering Manager/Kernel Mode-Setting) direct rendering manager/Kernel Mode settings
HWC (Hardware composer) hardware synthesizer
The AVM system of the application comprises the following components:
the method comprises the steps that 4 cameras arranged on the front, rear, left and right of a vehicle body are connected to a VDC/HAD controller, the VDC/HAD receives images of 4 paths of cameras, then the images are spliced to generate a panoramic image, the data are transmitted to a vehicle machine through an LVDS cable by using a string adder, the vehicle machine receives the data and then is subjected to deserialization and reduction to form the panoramic image, the panoramic image is displayed on a central control screen after being processed through AVM/parking application, and in addition, the VDC/HAD is connected with the vehicle machine through an Ethernet, and is used for sending instructions and receiving state information.
Referring to fig. 1-3, in an embodiment of the application, a dual system display method includes:
when the Android system is not started, the QNX system starts an AVM app, an AVM first image is displayed on a display screen, and a QNX layer is covered on the Android layer;
specifically, when Android startup is not completed and the screen is started, the QNX side starts the AVM app, and a simplified AVM image is displayed on the central control screen and is covered on the Android layer.
When the Android system is started, the Android system starts an AVM/parking app and displays an interface of the AVM/parking app;
specifically, after Android is started, an AVM/parking app is started, an interface of the AVM/parking app is displayed, and at the moment, a panoramic image layer of QNX is continuously covered on the Android layer.
When the start of the AVM/parking app in the Android system is completed, a first completion message is sent to the VDC/HAD module;
the VDC/HAD module outputs an AVM second image;
the AVM/parking app sends a second completion message to the AVM app;
the AVM app closes the QNX layer according to the second completion message.
Specifically, after the Android side AVM/parking app is started, sending a message to the HAD/VDC to inform the Android side of the completion of the startup, and the VDC/HAD outputs a normal AVM image, meanwhile, the AVM/parking app sends a message to the QNX side AVM app, after receiving the message, the AVM app closes the QNX side panoramic image layer, exposes the Android panoramic image layer, and completes the switching from QNX to Android.
In the embodiment, one AVM app is deployed on the QNX side, an AVM/parking app is deployed on the Android side, and when a user opens a panoramic image, if Android startup is not completed yet, the AVM app on the QNX side is executed, and after Android startup is completed, the AVM/parking app on the Android side is switched to; and if the Android starting is finished, executing the AVM/parking app on the Android side.
In some embodiments of the present application, when the Android system is in a scene of rapidly starting an AVM, the VDC/HAD outputs a simplified AVM interface during the starting process, only the exit button is available at this time, other buttons are set to be in an unavailable state, the AVM app on the QNX side operates, the AVM image is received and displayed on the central control screen, the AVM app can receive a touch event and send coordinate information to the VDC/HAD, and the user clicks the exit button to exit the panoramic image. After the Android system is started, a message is sent to the VDC/HAD to inform the Android system that the starting is completed, the current state of the VDC/HAD is detected, if the current state of the VDC/HAD is in the AVM state, the AVM/parking app is started, the AVM picture output by the VDC/HAD is received, the same picture is received by the Android side and the QNX side, after the AVM/parking app is operated, a command is sent to the VDC/HAD to output a normal AVM interface, other buttons are enabled to be in a usable state, meanwhile, the message is sent to the AVM app on the QNX side, the AVM app on the QNX side is closed after receiving the message, the AVM/parking app on the lower Android side is exposed, and the AVM/parking app on the Android side takes over the AVM function.
Referring to fig. 4, in some embodiments of the present application, the dual system display method further includes:
the AVM app obtains the synthesized image of the VDC/HAD module from the AIS server by calling a qcarpam API;
the AVM/parking app calls a camera2 API native to the Android system to acquire image data;
the Camera HAL3 calls AIS FE through the qcarpam API, the AIS FE communicates with AIS BE deployed in the QNX system, and image data is acquired through an AIS server in the QNX system.
Specifically, the driving of Camera is realized on AIS server of QNX side, AVM app of QNX side gets the synthesized image of VDC/HAD from AIS server by calling qcarpam API; the method comprises the steps that an AVM/parking app on the Android side calls an Android native Camera2 API to obtain image data, a Camera HAL3 changes from an original call to a V4L2 interface to a call to an AIS FE through a qcar API, the AIS FE communicates with an AIS BE deployed on the QNX side, and the AIS server on the QNX side obtains the image data.
In some embodiments of the present application, the dual system display method further includes:
the DRM driver in the Android system calls OpenWFD FE;
the OpenWFD FE communicates with the OpenWFD BE and completes display operation through an OpenWFD server in the QNX system;
when the demand of the Display/Graphic operation exists in the Android system, forwarding the demand of the Display/Graphic operation to the QNX system, and completing the Display/Graphic operation by the QNX system.
Because the high-pass platform has only one DPU and one GPU, all displays are output from the QNX side, and the bottom-layer implementation of the Display, the Graphic drive and the like is finished on the QNX side because the QNX side has strong requirements on functional safety, starting speed and the like. Screen is a middle layer service of the QNX system, image synthesis work is completed by calling the GPU through OpenGL/EGL and GSL, synthesized content is truly displayed through OpenWFD, and when a touch Screen exists, input information of the touch Screen is uploaded to an upper layer application through the Screen. OpenWFD is a display service native to the QNX system, and directly makes a lane with the DPU, and displays corresponding display content on a screen through the DPU by using a corresponding pipeline of the DPU.
All the DRM drivers on the Android side are Android native implementations, the DRM drivers originally directly call the DPU and other drivers to become calls to the OpenWFD FE, the OpenWFD FE communicates with the OpenWFD BE deployed on the QNX side, and display operation is completed through the OpenWFD server on the QNX side. When the Android side has Display/Graphic operation requirements, forwarding to the QNX side is needed, and the QNX side really completes corresponding operation.
In some embodiments of the present application, the dual system display method further includes:
distributing a plurality of pipeline for the QNX system and the Android system by configuring the OpenWFD;
by setting the z-order attribute of the pipeline, when the QNX system and the Android system are displayed on a central control screen at the same time, the QNX layer covers the Android layer;
the Screen service in the QNX system distributes a first pipeline and a second pipeline, the first pipeline is displayed on the instrument Screen, the second pipeline is displayed on the central control Screen, the Android system distributes a third pipeline, and the third pipeline is displayed on the central control Screen.
Specifically, multiple pins are allocated to the system by configuring OpenWFD, wherein two pins (corresponding to Display ID0 and Display ID 1) are allocated to the Screen service on the QNX side, one is displayed on the instrument Screen, the other is displayed on the central control Screen, the pins are also allocated to the Android side to be displayed on the central control Screen and other Display screens, and when QNX and Android are simultaneously displayed on the central control Screen, the layers displayed on the QNX side cover the layers displayed on the Android side by setting the z-order attribute of the pins.
In some embodiments of the present application, the dual system display method further includes:
when an HMI interface is displayed on an application in the QNX system, calling the Screen service and the OpenWFD server to complete corresponding synthesis and display operation;
displaying an interface on the meter screen through the first pipeline;
and when the AVM app needs to be displayed, displaying an image on the central control screen through the second pipeline.
Specifically, when an HMI interface is displayed by an application on the QNX side (such as a Cluster app), the Screen and the OpenWFD service are called to complete corresponding compositing and displaying operations, and the interface is displayed on the instrument Screen through a pipeline of the Display ID 0. When the AVM app needs to be displayed, an image is displayed on the central control screen through the pipeline of Display ID 1.
In some embodiments of the present application, the dual system display method further includes:
when the AVM/parking app has display requirements, synthesizing and displaying the content to be displayed through a SurfaceFlinger;
after the SurfaceFlinger synthesizes the display content, invoking the OpenWFD FE through HWC and DRM/KMS;
the OpenWFD FE communicates with the OpenWFD BE through a HAB;
and the OpenWFD BE displays the synthesized content to the central control screen through the OpenWFD server.
Specifically, when the AVM/parking app on the Android side has a display requirement, the content to BE displayed is synthesized and displayed through the surfeflinger, after the surfeflinger synthesizes the display content, the synthesized content is called to the OpenWFD FE through the HWC and the DRM/KMS, the OpenWFD FE interacts with the OpenWFD BE on the QNX side through the HAB, and the OpenWFD BE on the QNX side finally displays the synthesized content on the central control screen through the OpenWFD server.
In some embodiments of the present application, the AVM/parking app may receive touch events of the touch screen and send coordinate information and gesture information to the VDC/HAD module;
and entering an automatic parking interface when a user clicks an automatic parking button, wherein the automatic parking interface increases a 3D view area to be covered on a panoramic image area, the panoramic image area is smaller, and the 3D view area is drawn by the Andoird system.
Specifically, the AVM/parking app on the Android side may receive a touch event of the touch screen and send coordinate information and gesture information to the VDC/HAD, enter an automatic parking interface when a user clicks an automatic parking button, the parking interface adds a 3D view area to cover over the panoramic image, the panoramic image area becomes smaller (the VDC/HAD outputs an image with original resolution or the covered area is set black), and the 3D view is depicted by the Andoird side.
According to another aspect of the present application, there is also provided a dual system display device including:
the AVM app starting module is configured to start the AVM app by the QNX system when the Android system is not started, display an AVM first image on a display screen, and cover the QNX layer on the Android layer;
the Android system is configured to start the AVM/parking app when the Android system is started, and display an interface of the AVM/parking app;
the first completion message sending module is configured to send a first completion message to the VDC/HAD module when the start of the AVM/parking app in the Android system is completed;
the AVM second image output module is configured to output an AVM second image;
a second completion message sending module configured to send a second completion message to the AVM app;
and the QNX layer closing module is configured to close the QNX layer according to the second completion message.
Next, an electronic device according to an embodiment of the present application is described with reference to fig. 5.
Compared with the prior art, the AVM display method based on the QNX+android dual system provided by the application has the advantages that under the scene of rapidly starting the AVM, a simplified AVM picture is displayed from the QNX system with rapid starting speed, and after the Android system is started, the normal AVM picture is displayed from the Android system in a seamless manner, so that a user can use the AVM without waiting, and the use experience of the user is improved.
Fig. 5 illustrates a block diagram of an electronic device according to an embodiment of the application.
As shown in fig. 5, the electronic device 10 includes one or more processors 11 and a memory 12.
The processor 11 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 10 to perform desired functions.
Memory 12 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random Access Memory (RAM) and/or cache memory (cache), and the like. The non-volatile memory may include, for example, read Only Memory (ROM), hard disk, flash memory, and the like. One or more computer program instructions may be stored on the computer readable storage medium that can be executed by the processor 11 to implement the functions in the dual system display method of the various embodiments of the present application described above and/or other desired functions. Various contents such as a target position feature vector may also be stored in the computer-readable storage medium.
In one example, the electronic device 10 may further include: an input device 13 and an output device 14, which are interconnected by a bus system and/or other forms of connection mechanisms (not shown).
The input means 13 may comprise, for example, a keyboard, a mouse, etc.
The output device 14 can output various information including a decoded value and the like to the outside. The output means 14 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, etc.
Of course, only some of the components of the electronic device 10 that are relevant to the present application are shown in fig. 5 for simplicity, components such as buses, input/output interfaces, etc. are omitted. In addition, the electronic device 10 may include any other suitable components depending on the particular application.
Exemplary computer program product and computer readable storage Medium
In addition to the methods and apparatus described above, embodiments of the application may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform steps in the functions of the dual system display method according to the various embodiments of the application described in the "exemplary methods" section of this specification.
The computer program product may write program code for performing operations of embodiments of the present application in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present application may also be a computer-readable storage medium, on which computer program instructions are stored, which, when being executed by a processor, cause the processor to perform the steps in the functions of the dual system display method according to the various embodiments of the present application described in the "exemplary method" section of the present specification.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The basic principles of the present application have been described above in connection with specific embodiments, however, it should be noted that the advantages, benefits, effects, etc. mentioned in the present application are merely examples and not intended to be limiting, and these advantages, benefits, effects, etc. are not to be considered as essential to the various embodiments of the present application. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, as the application is not necessarily limited to practice with the above described specific details.
The block diagrams of the devices, apparatuses, devices, systems referred to in the present application are only illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatuses, devices, systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.
It is also noted that in the apparatus, devices and methods of the present application, the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present application.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the application. Thus, the present application is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the application to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, a person of ordinary skill in the art will recognize certain variations, modifications, alterations, additions, and subcombinations thereof.

Claims (10)

1. A dual system display method, comprising:
when the Android system is not started, the QNX system starts an AVM app, an AVM first image is displayed on a display screen, and a QNX layer is covered on the Android layer;
when the Android system is started, the Android system starts an AVM/parking app and displays an interface of the AVM/parking app;
when the start of the AVM/parking app in the Android system is completed, a first completion message is sent to the VDC/HAD module;
the VDC/HAD module outputs an AVM second image;
the AVM/parking app sends a second completion message to the AVM app;
the AVM app closes the QNX layer according to the second completion message.
2. The dual system display method of claim 1, wherein the dual system display method further comprises:
the AVM app obtains the synthesized image of the VDC/HAD module from the AIS server by calling a qcarpam API;
the AVM/parking app calls a camera2 API native to the Android system to acquire image data;
the Camera HAL3 calls AIS FE through the qcarpam API, the AIS FE communicates with AIS BE deployed in the QNX system, and image data is acquired through an AIS server in the QNX system.
3. The dual system display method of claim 2, wherein the dual system display method further comprises:
the DRM driver in the Android system calls OpenWFD FE;
the OpenWFD FE communicates with the OpenWFD BE and completes display operation through an OpenWFD server in the QNX system;
when the demand of the Display/Graphic operation exists in the Android system, forwarding the demand of the Display/Graphic operation to the QNX system, and completing the Display/Graphic operation by the QNX system.
4. The dual system display method of claim 3, further comprising:
distributing a plurality of pipeline for the QNX system and the Android system by configuring the OpenWFD;
by setting the z-order attribute of the pipeline, when the QNX system and the Android system are displayed on a central control screen at the same time, the QNX layer covers the Android layer;
the Screen service in the QNX system distributes a first pipeline and a second pipeline, the first pipeline is displayed on the instrument Screen, the second pipeline is displayed on the central control Screen, the Android system distributes a third pipeline, and the third pipeline is displayed on the central control Screen.
5. The dual system display method of claim 4, further comprising:
when an HMI interface is displayed on an application in the QNX system, calling the Screen service and the OpenWFD server to complete corresponding synthesis and display operation;
displaying an interface on the meter screen through the first pipeline;
and when the AVM app needs to be displayed, displaying an image on the central control screen through the second pipeline.
6. The dual system display method of claim 5, further comprising:
when the AVM/parking app has display requirements, synthesizing and displaying the content to be displayed through a SurfaceFlinger;
after the SurfaceFlinger synthesizes the display content, invoking the OpenWFD FE through HWC and DRM/KMS;
the OpenWFD FE communicates with the OpenWFD BE through a HAB;
and the OpenWFD BE displays the synthesized content to the central control screen through the OpenWFD server.
7. The dual system display method of claim 6, further comprising:
the AVM/parking app can receive touch events of the touch screen and send coordinate information and gesture information to the VDC/HAD module;
and entering an automatic parking interface when a user clicks an automatic parking button, wherein the automatic parking interface increases a 3D view area to be covered on a panoramic image area, the panoramic image area is smaller, and the 3D view area is drawn by the Andoird system.
8. A dual system display device, comprising:
the AVM app starting module is configured to start the AVM app by the QNX system when the Android system is not started, display an AVM first image on a display screen, and cover the QNX layer on the Android layer;
the Android system is configured to start the AVM/parking app when the Android system is started, and display an interface of the AVM/parking app;
the first completion message sending module is configured to send a first completion message to the VDC/HAD module when the start of the AVM/parking app in the Android system is completed;
the AVM second image output module is configured to output an AVM second image;
a second completion message sending module configured to send a second completion message to the AVM app;
and the QNX layer closing module is configured to close the QNX layer according to the second completion message.
9. A dual system display electronic device comprising an external memory card, characterized in that the electronic device comprises an apparatus as claimed in claim 8.
10. A storage medium having stored therein a computer program which, when executed by a processor, implements the method of any of claims 1-7.
CN202310657741.6A 2023-06-06 2023-06-06 Dual-system display method and device, electronic equipment and storage medium Pending CN116834550A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310657741.6A CN116834550A (en) 2023-06-06 2023-06-06 Dual-system display method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310657741.6A CN116834550A (en) 2023-06-06 2023-06-06 Dual-system display method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116834550A true CN116834550A (en) 2023-10-03

Family

ID=88166129

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310657741.6A Pending CN116834550A (en) 2023-06-06 2023-06-06 Dual-system display method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116834550A (en)

Similar Documents

Publication Publication Date Title
CN109388467B (en) Map information display method, map information display device, computer equipment and storage medium
CN111976482B (en) Double-screen interaction system and method for vehicle-mounted instrument screen and central control entertainment screen
CN110908625A (en) Multi-screen display method, device, equipment, system, cabin and storage medium
US20230256826A1 (en) Three-Dimensional Cluster Simulation on GPU-Less Systems
US11934733B2 (en) Vehicle control device, vehicle display system, and vehicle display control method
AU2021339341B2 (en) Augmented reality-based display method, device, and storage medium
CN110316069A (en) The quick method and apparatus for showing image of parking based on multicore
CN113645369B (en) Method and device for displaying multiple screens, computer readable storage medium and terminal
CN115185408A (en) Vehicle-mounted entertainment information display method, device, equipment and medium
CN115546410A (en) Window display method and device, electronic equipment and storage medium
CN108897487B (en) Rapid display method of vehicle-mounted system
CN107888876B (en) Vehicle-mounted information entertainment system and early image display method thereof
EP1583072A1 (en) Drawing device and display controller
WO2020246201A1 (en) Control device for vehicles, display system for vehicles, and display control method for vehicles
CN116834550A (en) Dual-system display method and device, electronic equipment and storage medium
CN111813355B (en) Distributed system for displaying content
CN112988357B (en) Panoramic image display method, computer storage medium and electronic device
CN111785229B (en) Display method, device and system
CN112100409A (en) Multimedia information display method and device, storage medium and terminal
CN115113782B (en) Vehicle-mounted driving image menu display method, electronic equipment and readable storage medium
CN113971070B (en) Method and system suitable for multi-virtual machine on-screen display
US20220327986A1 (en) Signal processing device and vehicle display apparatus including the same
CN115098264A (en) Camera calling method, device, vehicle and medium under virtualization management
CN116501426A (en) Execution method of AVM application program, intelligent cabin system and related equipment
CN114633690A (en) Method, system, device and medium for rapidly displaying reversing image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination