CN116501426A - Execution method of AVM application program, intelligent cabin system and related equipment - Google Patents

Execution method of AVM application program, intelligent cabin system and related equipment Download PDF

Info

Publication number
CN116501426A
CN116501426A CN202310266607.3A CN202310266607A CN116501426A CN 116501426 A CN116501426 A CN 116501426A CN 202310266607 A CN202310266607 A CN 202310266607A CN 116501426 A CN116501426 A CN 116501426A
Authority
CN
China
Prior art keywords
avm
program
kernel
core
event notification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310266607.3A
Other languages
Chinese (zh)
Inventor
谭梓维
徐艺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hefei Jiefa Technology Co ltd
Original Assignee
Hefei Jiefa Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hefei Jiefa Technology Co ltd filed Critical Hefei Jiefa Technology Co ltd
Priority to CN202310266607.3A priority Critical patent/CN116501426A/en
Publication of CN116501426A publication Critical patent/CN116501426A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/445—Program loading or initiating
    • G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/542—Event management; Broadcasting; Multicasting; Notifications
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/546—Message passing systems or structures, e.g. queues
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The application discloses an execution method of an AVM application program. The method comprises the following steps: running a Linux system to execute a first AVM program, wherein the Linux system is installed on a first kernel in a multi-core CPU of the intelligent cabin system, the first kernel is a single kernel, and the first AVM program is at least used for an AVM preview display function; and running the Android system to execute a second AVM program, wherein the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, and the second kernel is physically isolated from the first kernel, so that the first AVM program and the second AVM program are mutually and physically isolated, and interaction is realized through inter-kernel communication. The application also discloses an intelligent cabin system and related equipment. The AVM application function is realized more stably and rapidly, and the problem of complex interaction among different application programs of the system is solved.

Description

Execution method of AVM application program, intelligent cabin system and related equipment
Technical Field
The disclosed embodiments of the present application relate to the field of vehicle technology, and more particularly, to an execution method of an AVM application, an intelligent cabin system, and related devices.
Background
The panoramic monitoring image system (Around View Monitor, AVM) intelligently splices images provided by 4 fish-eye cameras arranged at the front, rear, left and right of the automobile, forms a panoramic annular view of the automobile and displays the view on an App interface, and helps drivers to check whether pedestrians, automobiles, obstacles and the like exist around the automobile and know the relative positions and distances of the pedestrians, the automobiles, the obstacles and the like, so that the problems of backing into place, meeting in narrow roads, avoiding obstacles and the like are solved. At present, the problem of how to implement AVM application functions more stably and rapidly remains to be solved.
Disclosure of Invention
According to the embodiment of the application, the application provides an execution method of an AVM application program, an intelligent cabin system and related equipment, so as to realize the AVM application function more stably and rapidly and solve the problem of complex interaction among system application programs.
The first aspect of the application discloses an execution method of an AVM application program of a panoramic monitoring image system, which is applied to an intelligent cabin system, wherein the AVM application program comprises a first AVM program and a second AVM program, and the method comprises the following steps: running a Linux system to execute the first AVM program, wherein the Linux system is installed on a first kernel in a multi-core CPU of the intelligent cabin system, the first kernel is a single kernel, and the first AVM program is at least used for an AVM preview display function; and running an Android system to execute the second AVM program, wherein the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, and the second kernel is physically isolated from the first kernel, so that the first AVM program and the second AVM program are mutually and physically isolated, and interaction is realized through inter-kernel communication.
In some embodiments, after the Android system is started, executing the second AVM program sends a command message to the first AVM program through inter-core communication, so that the second AVM program performs view control on the AVM preview display function in the first AVM program.
In some embodiments, the intelligent cockpit system includes a read-write partition; the second AVM program performs view control on the AVM preview display function in the first AVM program, including: executing the second AVM program to generate a picture file; and writing the picture file into the readable and writable partition, and sending a corresponding instruction to the first AVM program through the inter-core communication, so that the first AVM program reads the data of the picture file from the readable and writable partition, and draws a corresponding picture according to the data of the picture file.
In some embodiments, there is a mechanical event notification for both the Linux system and the Android system; the method further comprises the steps of: responding to the starting of the Linux system and the non-starting of the Android system, receiving the mechanical event notification by the first AVM program, and completing view display operation corresponding to the mechanical event notification; and responding to the starting of the Android system, executing the second AVM program to send a preset message to the first AVM program so that the first AVM program stops view display operation corresponding to the mechanical event notification, and enabling the second AVM program to receive the mechanical event notification so as to complete user interface control operation corresponding to the mechanical event notification.
In some embodiments, the mechanical event notification comprises a reverse event notification; the second AVM program receives the mechanical event notification to complete a user interface control operation corresponding to the mechanical event notification, including: the second AVM program receives the reverse event notification; and in response to receiving the reversing event notification, executing the second AVM program to display a floating window, and sending a rendering instruction and a drawing instruction to the first AVM program, so that the first AVM program performs view rendering in response to the rendering instruction, and draws a corresponding track line according to the vehicle running direction in the drawing instruction in response to the drawing instruction, so as to obtain a corresponding view, wherein the corresponding view is embedded and displayed in the floating window.
In some embodiments, the smart cockpit system includes a display screen, wherein the display screen is configured to display in layers on the Linux system and the Android system.
In some embodiments, the method further comprises: responding to the starting of the Android system, executing the second AVM program to send a rendering start instruction to the first AVM program, wherein the rendering start instruction comprises information of a current window; and responding to the rendering starting instruction, executing the first AVM program to initialize a corresponding interface control for rendering to obtain a corresponding preview picture, thereby embedding the preview picture into a current window of the second AVM program, wherein a user interface of the second AVM program is superposed on the preview picture.
In some embodiments, the method further comprises: boot bootloader programs are started in response to the power-on of the intelligent cabin system, so that the kernel programs of the first kernel and the kernel programs of the second kernel are guided by the bootloader programs, the Linux system is started, and the Android system is started; wherein the first AVM program is started in response to the Linux system start; the second AVM program is started in response to the Android system start.
In some embodiments, the method further comprises: and responding to the starting of the Android system, executing a first AVM program to transfer display control parameters of the AVM preview display function into a shared drawing buffer area for the user interface display function of the second AVM program or interacting with other application programs of the Android system.
The second aspect of the application discloses an intelligent cabin system, comprising a multi-core CPU; the multi-core CPU comprises a first core and a second core which are physically isolated, wherein the first core is a single core, the second core is a multi-core, the first core is used for running a Linux system, and the second core is used for running an Android system; the multi-core CPU is configured to implement the execution method of the panoramic surveillance imaging system AVM application described in the first aspect.
A third aspect of the application discloses a vehicle infotainment device comprising an intelligent cabin system as described in the second aspect.
The beneficial effects of this application are: executing a first AVM program by running a Linux system, wherein the Linux system is installed on a first kernel in a multi-core CPU of the intelligent cabin system, the first kernel is a single kernel, and the first AVM program is at least used for an AVM preview display function; the Android system is operated to execute a second AVM program, the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, the second kernel is physically isolated from the first kernel, the first AVM program and the second AVM program are mutually physically isolated, interaction is realized through inter-kernel communication, and therefore AVM application functions are realized more stably and rapidly, and the problem of complex interaction among different application programs of the system is solved.
Drawings
The application will be further described with reference to the accompanying drawings and embodiments, in which:
FIG. 1 is a schematic diagram of the structure of an intelligent cockpit system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a framework of an AVM application of an embodiment of the present application;
FIG. 3 is a flow chart of a method of executing an AVM application of an embodiment of the present application;
FIG. 4 is a further structural schematic diagram of the intelligent cockpit system of the embodiments of the present application;
FIG. 5 is another structural schematic diagram of the intelligent cockpit system of the embodiments of the present application;
FIG. 6 is a schematic flow chart of the start-up of the intelligent cockpit system according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of the in-vehicle infotainment device of the embodiment of the present application.
Detailed Description
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.
The term "and/or" in this application is merely an association relation describing an associated object, and indicates that three relations may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship. Further, "a plurality" herein means two or more than two. In addition, the term "at least one" herein means any one of a plurality or any combination of at least two of a plurality, for example, including at least one of A, B, C, and may mean including any one or more elements selected from the group consisting of A, B and C. Furthermore, the terms "first," "second," and "third" in this application are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
In order to enable those skilled in the art to better understand the technical solutions of the present application, the technical solutions of the present application are described in further detail below with reference to the accompanying drawings and the detailed description.
In order to facilitate an understanding of the present application, the cabin capable system of the following embodiments of the present application will be described in detail.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an intelligent cabin system according to an embodiment of the present application. The intelligent cockpit system 100 comprises a multi-core CPU110, wherein the multi-core CPU110 comprises a first core 111 and a second core 112 which are physically isolated, the first core 111 is a single core, and the second core 112 is a multi-core.
The intelligent cabin system 100 may be used for realizing interconnection between a vehicle and a person, between a vehicle and cloud data, and the like, the intelligent cabin system 100 includes a multi-core CPU110, the multi-core CPU110 includes a first core 111 and a second core 112 that are physically isolated, that is, the multi-core CPU110 is isolated into two parts by way of physical isolation, the first part may include the first core 111, and the first core 111 is a single core, that is, a single core is allocated for running a preset system a, the second part may be the second core 112, and the second core 112 is a multi-core, that is, the other multi-cores in the multi-core CPU110 are allocated for running another preset system B. The multi-core CPU110 is configured to implement an AVM application program, that is, execute a corresponding AVM application operation through the AVM application program based on the multi-core CPU 110.
The first core 111 is used for running a Linux system, the second core 112 is used for running an Android system, the multi-core CPU110 is isolated into two parts by a physical isolation mode, the first part may include the first core 111, the second part may include the second core 112, where the first core 111 is used for running the Linux system, i.e. one single core is allocated for running the Linux system, and the first part may further include another single core for running the Linux system to implement a Cluster. The second portion may include a second kernel 112, where the second kernel 112 is configured to run the Android system, i.e. allocate the remaining multiple cores to run the Android system.
The AVM application can intelligently splice the panoramic view of the vehicle through the images provided by the cameras installed at the front, rear, left and right of the vehicle and display the panoramic view on the user operation interface, as shown in fig. 2, and fig. 2 is a schematic frame diagram of the AVM application according to the embodiment of the present application. The AVM application program includes a first AVM program and a second AVM program, wherein the first AVM program is used for an AVM preview display function, for example, the AVM preview display function may include an AVM image and a preview image display function, and specifically may include functions of view switching, view setting, manual calibration, automatic calibration, and the like, wherein the view switching is applied to a vehicle event state for performing various kinds of operations, the vehicle event state includes different gear positions, a vehicle speed, a steering wheel angle, a door opening and closing state, a radar state, and the like, and the view switching may be an adjustment of a view position, a size, and the like. The second AVM program is used for an AVM recording photographing function and an AVM user interface display function, for example, the AVM recording photographing function may be a buffer memory for obtaining image data through a camera, and the AVM user interface display function may be a display interaction of user operation interfaces between different application programs.
Referring to fig. 3, fig. 3 is a flowchart illustrating an execution method of an AVM application according to an embodiment of the present application. The subject of execution of the method may be an electronic device with computing functionality, such as the intelligent cockpit system described above. It should be noted that, if there are substantially the same results, the method of the present application is not limited to the flow sequence shown in fig. 3.
In some possible implementations, the method may be implemented by a processor invoking computer readable instructions stored in a memory, as shown in fig. 3, and may include the steps of:
s31: and running the Linux system to execute a first AVM program, wherein the Linux system is installed on a first kernel in a multi-core CPU of the intelligent cabin system, the first kernel is a single kernel, and the first AVM program is at least used for an AVM preview display function.
Taking the above-mentioned intelligent cockpit system 100 as an example, the Linux system is installed in the first kernel 111 in the multi-core CPU110 of the intelligent cockpit system 100, where the first kernel 111 is a single kernel, and the first AVM program is at least used for an AVM preview display function, that is, the Linux system executes the first AVM program, for example, the first AVM program may be a Linux AVM Server, and specifically, the Linux system may be used to implement the AVM preview display function, for example, the Linux system generates a panoramic annular view of a splicing of a 3D car model and a four-way panoramic camera and superimposes a watermark.
S32: and running the Android system to execute a second AVM program, wherein the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, and the second kernel is physically isolated from the first kernel, so that the first AVM program and the second AVM program are mutually and physically isolated, and interaction is realized through inter-kernel communication.
Continuing with the above-mentioned intelligent cockpit system 100 as an example, the Android system is installed in the second kernel 112 in the multi-core CPU110 of the intelligent cockpit system 100, where the second kernel 112 is multi-core, and the second AVM program is at least used for the AVM recording photographing function and the AVM user interface display function, that is, the Android system executes the second AVM program, for example, the second AVM program may be an Android AVM App, specifically, the Android system may be used to implement the AVM recording photographing function and the AVM user interface display function, for example, when the Android system implements AVM recording, unified access is performed to Storage (object storing temporary information), and a Record interface of Android native may be directly called, and the Android system is responsible for user interface display interaction between AVM applications.
The first AVM program and the second AVM program are mutually and physically isolated, interaction is realized through inter-core communication, namely information instruction transmission between the Linux AVM Server and the Android AVM App is completed through inter-core communication.
In this embodiment, a Linux system is operated to execute a first AVM program, where the Linux system is installed in a first kernel in a multi-core CPU of an intelligent cabin system, the first kernel is a single core, and the first AVM program is at least used for an AVM preview display function; the Android system is operated to execute a second AVM program, the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, the second kernel is physically isolated from the first kernel, the first AVM program and the second AVM program are mutually physically isolated, interaction is realized through inter-kernel communication, and therefore AVM application functions are realized more stably and rapidly, and the problem of complex interaction among different application programs of the system is solved.
In some embodiments, after the Android system is started, executing the second AVM program sends a command message to the first AVM program through inter-core communication, so that the second AVM program performs view control on an AVM preview display function in the first AVM program.
The Android system is started, namely the Android system and the Linux system are started, the Linux system executes a first AVM program, the Android system executes a second AVM program, at this time, the second AVM program sends a command message to the first AVM program through inter-core communication, for example, libIPC (Library Inter Processor Communication, dynamic inter-core communication) inter-core communication is performed, so that the second AVM program performs view control on an AVM preview display function in the first AVM program, the LibIPC is realized through inter-core data copying and interrupt mechanisms, for example, an Android AVM App sends a command message to a Linux AVM Server through inter-core communication LibIPC, and view control is performed on the AVM preview display function in the Linux AVM Server. For example, when the vehicle is in a running state, the Android AVM App can send an instruction to switch the front camera, the rear camera, the left camera and the right camera, and then the Linux AVM Server can complete graph display.
In some embodiments, as shown in fig. 4, fig. 4 is a further schematic structural diagram of an intelligent cockpit system according to an embodiment of the present application, where the intelligent cockpit system 100 includes a multi-core CPU110, where the multi-core CPU110 includes a first core 111 and a second core 112 that are physically isolated, and further includes a readable and writable partition 113, where the readable and writable partition 113 may be a Datazone (data storage area), and both a Linux system and an Android system may perform read and write operations on the readable and writable partition 113.
At this time, the second AVM program performs view control on the AVM preview display function in the first AVM program, including: executing a second AVM program to generate a picture file; the picture file is written into the readable-writable partition 113, and a corresponding instruction is sent to the first AVM program through inter-core communication, so that the first AVM program reads the data of the picture file from the readable-writable partition 113, and draws a corresponding picture according to the data of the picture file.
Executing the second AVM program to generate a picture file, for example, the Android AVM App has a function of setting a license plate number, and the Android AVM App generates a license plate picture, that is, the picture file is written into the readable and writable partition 113, for example, the Android AVM App may notify AVM Hal Service (Hal, hardware Abstraction Layer, hardware abstraction layer) to write the license plate picture file into a position of a designated key value in the Datazone. The corresponding instruction is sent to the first AVM program through inter-core communication LibIPC, for example, an instruction for setting a license plate is sent to the Linux AVM Server, so that the first AVM program reads the data of the picture file from the readable-writable partition 113, that is, the Linux AVM Server can read the data of the license plate picture from the Datazone, writes the data into a local path, and draws a corresponding picture according to the data of the picture file, that is, notifies an AVM algorithm module under the Linux AVM Server to draw the license plate in a preview picture according to the data of the license plate picture.
In some embodiments, there is a mechanical event notification for both the Linux system and the Android system; responding to the starting of the Linux system and the non-starting of the Android system, executing a first AVM program to receive the mechanical event notification, and completing the view display operation corresponding to the mechanical event notification; and responding to the starting of the Android system, executing the second AVM program to send a preset message to the first AVM program so that the first AVM program stops the view display operation corresponding to the mechanical event notification, and enabling the second AVM program to receive the mechanical event notification so as to complete the user interface control operation corresponding to the mechanical event notification.
Both the Linux system and the Android system have mechanical event notification, and the mechanical event notification may refer to interaction information generated when a Vehicle event is performed, for example, the Vehicle event includes reversing, turn lights, door opening and closing, radar, and the like. And responding to the starting of the Linux system and the non-starting of the Android system, namely the Linux system is started before the Android system, executing by the Linux system, receiving the mechanical event notification by the first AVM program, and completing view display operation corresponding to the mechanical event notification, for example, when the Linux AVM Server receives a door switch message, the Linux AVM Server sends the door switch message to a corresponding algorithm module, so that the opening and closing of a door are simulated on the 3D automobile model rendering. Further, in response to the Android system being started, that is, when both the Linux system and the Android system are started, the Android system executes the first AVM program, that is, the Android AVM App sends preset information to the Linux AVM Server, for example, the information content is an "App ready message", so that the first AVM program stops the view display operation corresponding to the mechanical event notification, for example, the Linux AVM Server performs the corresponding view operation when receiving the "door switch message", and sends the App ready message after the Android system is started, and at this time, the Linux AVM Server stops the related view operation. And receiving the mechanical event notification by the second AVM program to complete the corresponding user interface control operation of the mechanical event notification, namely receiving the mechanical event notification by the Android AVM App, and performing the corresponding user interface control operation, such as popping up a request notification of the Linux AVM Server on the Android system main interface.
In some embodiments, the mechanical event notification includes a reverse event notification; the second AVM program receives the mechanical event notification to complete a user interface control operation corresponding to the mechanical event notification, comprising: the second AVM program receives a reversing event notification; and in response to receiving the reversing event notification, executing the second AVM program to display the floating window, and sending a rendering instruction and a drawing instruction to the first AVM program, so that the first AVM program performs view rendering in response to the rendering instruction, and draws a corresponding track line according to the vehicle running direction in the drawing instruction in response to the drawing instruction, so as to obtain a corresponding view, wherein the corresponding view is embedded and displayed in the floating window.
The mechanical event notification can be a reversing event notification, when the Linux system is started and the Android system is not started, the Linux AVM Server receives a reversing message, and then the camera is opened and a preview picture is displayed. After the Android system is started, the Android AVM App sends an App ready message to the Linux AVM Server, at the moment, the Linux AVM Server does not process the reversing event any more, and the second AVM program receives the reversing event notification, namely the Android AVM App receives the reversing message. Executing the second AVM program to display a floating window, sending a rendering instruction and a drawing instruction to the first AVM program, namely, the Android AVM App pops up the floating window, wherein the floating window can be used for displaying a reversing picture, and simultaneously sending the rendering instruction and the drawing instruction to the Linux AVM Server, namely, enabling the first AVM program to respond to the rendering instruction to perform view rendering, for example, enabling the Linux AVM Server to receive the rendering instruction to perform view rendering. And responding to the drawing instruction, drawing a corresponding track line according to the vehicle running direction in the drawing instruction, namely sending the vehicle running direction to the Linux AVM Server by the Android AVM App, and drawing the corresponding track line by the Linux AVM Server according to the vehicle running direction in the drawing instruction to obtain a corresponding view, wherein the corresponding view is embedded and displayed in a floating window, for example, a reversing picture and a reversing track prediction track are displayed in the floating window.
In some embodiments, as shown In fig. 5, fig. 5 is another schematic structural diagram of a smart cockpit system according to an embodiment of the present application, where the smart cockpit system 100 includes a multi-core CPU110, where the multi-core CPU110 includes a first kernel 111 and a second kernel 112 that are physically isolated and a readable and writable partition 113, and the smart cockpit system 100 further includes a Display screen 120, where the Display screen 120 is used for performing layered Display on a Linux system and an Android system, for example, it may be implemented to finally Display a picture together on a terminal central control screen through layered superposition of a system Display module, for example, where the terminal device may be an In-vehicle infotainment device (IVI, in-Vehicle Infotainment).
In some embodiments, in response to Android system startup, the second AVM program sends a render-start instruction to the first AVM program, wherein the render-start instruction includes information of the current window; and in response to the rendering start instruction, the first AVM program initializes the corresponding interface control to render to obtain a corresponding preview picture, so that the preview picture is embedded into the current window of the second AVM program, wherein the user interface of the second AVM program is superposed on the preview picture.
When the Linux system is started and the Android system is not started, the Linux AVM Server is used for drawing and displaying the highest level of the Display overlay. In response to the Android system start, the Android system starts, the second AVM program sends a rendering start instruction to the first AVM program, wherein the rendering start instruction comprises information of a current window, namely after the Android system starts, the Android AVM App sends a rendering start instruction and a width and height value of the current window to the Linux AVM Server. Responding to a rendering start instruction, executing by a Linux system, namely, receiving the rendering start instruction by a Linux AVM service, initializing a corresponding interface control by a first AVM program to render, obtaining a corresponding preview picture, namely, initializing a drawing buffer area by the Linux AVM service, such as an AtcSurface control, and rendering an image, thereby embedding the preview picture into a current window of a second AVM program, wherein a user interface of the second AVM program is superposed on the preview picture, such as a window of an Android AVM App is searched by a Display module of an Android system according to an AVM package name, and the preview picture is further embedded into the window of the Android AVM App, so that a user operation interface of the Android AVM App is superposed on the preview picture.
In some embodiments, bootloader programs are booted in response to the smart cockpit system 100 being powered on, so that the kernel programs of the first kernel 111 and the kernel programs of the second kernel 112 are booted through the bootloader programs, so that a Linux system is started, and an Android system is started; wherein the first AVM program is started in response to a Linux system start; the second AVM program is started in response to the Android system startup.
The bootloader program is booted up by powering up the intelligent cockpit system 100, that is, the intelligent cockpit system 100 is stable to work from the time of power-on to the time of system stabilization before entering the operating system. The Kernel program of the first Kernel 111 and the Kernel program of the second Kernel 112 are guided by the bootloader program, for example, the Kernel program of the first Kernel 111 may be a Linux Kernel, and the Kernel program of the second Kernel 112 may be an Android Kernel, so that a Linux system is started, and an Android system is started, that is, linux Service is started and Android Service is started, where the Linux system is started before the Android system. Further, the first AVM program is started in response to the Linux system start, that is, the Linux AVM service is started in response to the Linux system start, and the second AVM program is started in response to the Android system start, that is, the Android AVM App is started in response to the Android system start, as shown in fig. 6, fig. 6 is a schematic flow chart of the intelligent cabin system start in an embodiment of the present application.
In some embodiments, in response to Android system startup, executing a first AVM program transfers display control parameters of an AVM preview display function into a shared drawing cache area for a user interface display function of a second AVM program or for interacting with other applications of the Android system.
After the Linux system and the Android system are started, the Android system executes the first AVM program, the display control parameters of the AVM preview display function are transmitted into the shared drawing buffer area, namely the display control parameters of the AVM preview display function can be transmitted into the Surface View area by the Linux AVM service, wherein the display control parameters can refer to rendering parameters of a preview picture and the like. The display control parameters of the AVM preview display function are transmitted into a Surface View area by a Linux AVM service, an Android AVM App can acquire images through the Linux AVM service, or the Android AVM App can acquire data information through the Linux AVM service to interact with other application programs of the Android system.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a vehicle-mounted infotainment device according to an embodiment of the present application, where the vehicle-mounted infotainment device 700 includes an intelligent cockpit system 100 as described above, the intelligent cockpit system 100 includes a multi-core CPU110, the multi-core CPU110 includes a first core 111 and a second core 112 that are physically isolated, where the first core 111 is a single core, the second core 112 is a multi-core, and the multi-core CPU110 is configured to implement an AVM application, the first core 111 is configured to operate a Linux system, and the second core 112 is configured to operate an Android system.
The AVM application program comprises a first AVM program and a second AVM program, wherein the first AVM program is at least used for an AVM preview display function, and the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function.
Furthermore, the Linux system and the Android system are used for realizing the execution method of the panoramic monitoring image system AVM application program. Specifically, the Linux system executes a first AVM program, and the Android system executes a second AVM program, wherein interaction between the first AVM program and the second AVM program is realized through inter-core communication.
It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.
The foregoing description of various embodiments is intended to highlight differences between the various embodiments, which may be the same or similar to each other by reference, and is not repeated herein for the sake of brevity.
In the several embodiments provided in this application, it should be understood that the disclosed methods and related devices may be implemented in other ways. For example, the above-described embodiments of related devices are merely illustrative, e.g., the division of modules or elements is merely a logical functional division, and there may be additional divisions of actual implementation, e.g., elements or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication disconnection between the illustrated or discussed elements may be through some interface, indirect coupling or communication disconnection of a device or element, electrical, mechanical, or other form.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
Those skilled in the art will readily appreciate that many modifications and variations are possible in the device and method while maintaining the teachings of the present application. Accordingly, the above disclosure should be viewed as limited only by the scope of the appended claims.

Claims (10)

1. The method for executing the AVM application program of the panoramic monitoring image system is characterized by being applied to an intelligent cabin system, wherein the AVM application program comprises a first AVM program and a second AVM program, and the method comprises the following steps:
running a Linux system to execute the first AVM program, wherein the Linux system is installed on a first kernel in a multi-core CPU of the intelligent cabin system, the first kernel is a single kernel, and the first AVM program is at least used for an AVM preview display function;
and running an Android system to execute the second AVM program, wherein the Android system is installed in a second kernel in a multi-kernel CPU of the intelligent cabin system, the second kernel is multi-kernel, the second AVM program is at least used for an AVM recording photographing function and an AVM user interface display function, and the second kernel is physically isolated from the first kernel, so that the first AVM program and the second AVM program are mutually and physically isolated, and interaction is realized through inter-kernel communication.
2. The method as recited in claim 1, further comprising:
after the Android system is started, executing the second AVM program to send a command message to the first AVM program through inter-core communication, so that the second AVM program performs view control on the AVM preview display function in the first AVM program.
3. The method of claim 2, wherein the intelligent cockpit system includes a read-write partition;
the second AVM program performs view control on the AVM preview display function in the first AVM program, including:
executing the second AVM program to generate a picture file;
and writing the picture file into the readable and writable partition, and sending a corresponding instruction to the first AVM program through the inter-core communication, so that the first AVM program reads the data of the picture file from the readable and writable partition, and draws a corresponding picture according to the data of the picture file.
4. The method of claim 1, wherein there is a mechanical event notification for both the Linux system and the Android system;
the method further comprises the steps of:
responding to the starting of the Linux system and the non-starting of the Android system, executing the first AVM program to receive the mechanical event notification, and completing view display operation corresponding to the mechanical event notification;
and responding to the starting of the Android system, executing the second AVM program to send a preset message to the first AVM program so that the first AVM program stops view display operation corresponding to the mechanical event notification, and enabling the second AVM program to receive the mechanical event notification so as to complete user interface control operation corresponding to the mechanical event notification.
5. The method of claim 4, wherein the mechanical event notification comprises a reverse event notification;
the second AVM program receives the mechanical event notification to complete a user interface control operation corresponding to the mechanical event notification, including:
the second AVM program receives the reverse event notification;
and in response to receiving the reversing event notification, executing the second AVM program to display a floating window, and sending a rendering instruction and a drawing instruction to the first AVM program, so that the first AVM program performs view rendering in response to the rendering instruction, and draws a corresponding track line according to the vehicle running direction in the drawing instruction in response to the drawing instruction, so as to obtain a corresponding view, wherein the corresponding view is embedded and displayed in the floating window.
6. The method of any of claims 1-5, wherein the smart cockpit system includes a display screen, wherein the display screen is configured for layered display on the Linux system and the Android system, the method further comprising:
responding to the starting of the Android system, executing the second AVM program to send a rendering start instruction to the first AVM program, wherein the rendering start instruction comprises information of a current window;
and responding to the rendering starting instruction, executing the first AVM program to initialize a corresponding interface control for rendering to obtain a corresponding preview picture, thereby embedding the preview picture into a current window of the second AVM program, wherein a user interface of the second AVM program is superposed on the preview picture.
7. The method according to any one of claims 1-5, further comprising:
boot bootloader programs are started in response to the power-on of the intelligent cabin system, so that the kernel programs of the first kernel and the kernel programs of the second kernel are guided by the bootloader programs, the Linux system is started, and the Android system is started;
wherein the first AVM program is started in response to the Linux system start;
the second AVM program is started in response to the Android system start.
8. The method as recited in claim 7, further comprising:
and responding to the starting of the Android system, executing a first AVM program to transfer display control parameters of the AVM preview display function into a shared drawing buffer area for the user interface display function of the second AVM program or interacting with other application programs of the Android system.
9. An intelligent cabin system is characterized by comprising a multi-core CPU;
the multi-core CPU comprises a first core and a second core which are physically isolated, wherein the first core is a single core, the second core is a multi-core, the first core is used for running a Linux system, and the second core is used for running an Android system;
the multi-core CPU is configured to implement the method for executing the panoramic surveillance imaging system AVM application according to any one of claims 1 to 8.
10. An in-vehicle infotainment device comprising the intelligent cockpit system according to claim 9.
CN202310266607.3A 2023-03-15 2023-03-15 Execution method of AVM application program, intelligent cabin system and related equipment Pending CN116501426A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310266607.3A CN116501426A (en) 2023-03-15 2023-03-15 Execution method of AVM application program, intelligent cabin system and related equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310266607.3A CN116501426A (en) 2023-03-15 2023-03-15 Execution method of AVM application program, intelligent cabin system and related equipment

Publications (1)

Publication Number Publication Date
CN116501426A true CN116501426A (en) 2023-07-28

Family

ID=87315670

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310266607.3A Pending CN116501426A (en) 2023-03-15 2023-03-15 Execution method of AVM application program, intelligent cabin system and related equipment

Country Status (1)

Country Link
CN (1) CN116501426A (en)

Similar Documents

Publication Publication Date Title
CN109388467B (en) Map information display method, map information display device, computer equipment and storage medium
CN107077377B (en) Equipment virtualization method, device and system, electronic equipment and computer program product
US10358146B2 (en) Display control system, display system, movable-body apparatus, display controlling method, and storage medium
CN111976482B (en) Double-screen interaction system and method for vehicle-mounted instrument screen and central control entertainment screen
TWI354240B (en) Method and system for synchronizing parallel engin
CN106462517B (en) Display is identified early stage in multiple processor structure
US11934733B2 (en) Vehicle control device, vehicle display system, and vehicle display control method
CN112199222B (en) Video display method and device, electronic equipment and storage medium
CN112078487A (en) Method and device for displaying backing image in vehicle-mounted system, storage medium and terminal
JP2010026297A (en) Image composition system, display control method, drawing processing apparatus, and control program
CN114461287A (en) Operating system starting method and device, electronic equipment and storage medium
CN107888876B (en) Vehicle-mounted information entertainment system and early image display method thereof
JP7350655B2 (en) Surround view and method with seamless transition to 3D viewing system
CN116501426A (en) Execution method of AVM application program, intelligent cabin system and related equipment
CN113127213A (en) Method, device, equipment and storage medium for supporting multi-application data sharing
CN110641478A (en) Automobile domain controller display method and device, automobile and readable storage medium
Karthik et al. Hypervisor based approach for integrated cockpit solutions
CN111260746A (en) Backing image processing method, electronic device and storage medium
KR20230087336A (en) Virtualized system and method of operating the same
CN110347633B (en) Method, device and medium for superimposing vehicle signal state icons based on multiple cores
CN114579222A (en) Screen control method, automobile data recorder and storage medium
CN113610135B (en) Image processing method, device, computer equipment and storage medium
CN115904295B (en) Multi-screen display control method, device, medium, system, chip and panel
JP7375643B2 (en) In-vehicle information processing device, control method and computer program
US20220032775A1 (en) Vehicle device and vehicle device control method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination