CN111240626A - Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor - Google Patents
Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor Download PDFInfo
- Publication number
- CN111240626A CN111240626A CN202010023848.1A CN202010023848A CN111240626A CN 111240626 A CN111240626 A CN 111240626A CN 202010023848 A CN202010023848 A CN 202010023848A CN 111240626 A CN111240626 A CN 111240626A
- Authority
- CN
- China
- Prior art keywords
- central control
- screen
- screen end
- hypervisor
- frame buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a double-screen interaction method based on a Hypervisor intelligent cabin operating system, which comprises the following steps: constructing a central control display virtual extended screen end at a central control display touch screen end, creating a frame buffer physical address corresponding to the central control display virtual extended screen, synthesizing a central control display virtual extended screen end display interface needing interaction and an instrument display screen end display interface, and writing the synthesized interface into the frame buffer physical address for transmission; a Hypervisor system is utilized to create a communication mechanism for transmitting the frame buffer physical address, an asynchronous notification mechanism for image information control, an image information signal synchronization mechanism for real time and an image keep-alive information heartbeat notification mechanism for synchronous waiting. The invention adopts one processor, realizes two screens of the dual system on the Hypervisor virtualization technology, does not need an additional hardware physical connection mode, simultaneously starts the function of independently applying and displaying image information, realizes a dual-screen interaction mode, and reduces the hardware cost of the intelligent cockpit operating system.
Description
Technical Field
The invention belongs to the technical field of virtual machines, and particularly relates to a method and a system for double-screen interaction of an operating system of an intelligent cockpit based on Hypervisor.
Background
Hypervisor is an intermediate software layer that runs between the underlying physical server and the operating system and allows multiple operating systems and applications to share hardware, and may also be referred to as a Virtual Machine Monitor (VMM). Hypervisors is a "meta" operating system in a virtual environment that can access all physical devices on a server, including disks and memory. The Hypervisors not only coordinate access to these hardware resources, but also simultaneously enforce protections between the various virtual machines. When the server starts and executes the Hypervisor, the server loads the operating systems of all the virtual machine clients and allocates a proper amount of memory, CPU, network and disk to each virtual machine. With the development of virtualization technology, the virtual machine partitioning mechanism provided by Hypervisor is utilized to provide security, isolation and reusability, the application is widely applied to the fields of high-performance computing and commercial servers, and a plurality of embedded real-time operating systems such as XtratuM, Integrity and PikeOS which adopt a virtualization method to realize the ARINC653 standard are derived.
In the prior art, two display screens of the intelligent cabin part need to be added with extra hardware for physical connection, and double-screen interaction cannot be realized by adopting one processor, so that the hardware cost of the intelligent cabin operating system can be increased.
Disclosure of Invention
The invention aims to provide a method and a system for double-screen interaction of an operating system of an intelligent cockpit based on Hypervisor, which are used for solving the problems that in the prior art, two display screens of the intelligent cockpit part need to be added with extra hardware for physical connection, and double-screen interaction cannot be realized by adopting one processor, so that the hardware cost of the operating system of the intelligent cockpit is increased.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
a double-screen interaction method based on a Hypervisor intelligent cabin operating system comprises the following steps:
s1, constructing a central control display virtual expansion screen end at the central control display touch screen end, creating a frame buffer physical address corresponding to the central control display virtual expansion screen, synthesizing a central control display virtual expansion screen end display interface to be interacted with an instrument display screen end display interface, and writing the synthesized interface into the frame buffer physical address for transmission; wherein, well accuse display screen end: the system is used for generating central control display content of the vehicle-mounted entertainment application, generating display content of vehicle-mounted instrument display screen end interaction and displaying a vehicle-mounted entertainment application interface; the central control displays the virtual expansion screen end: the device is used for displaying content interacted to a display screen end of the instrument end;
s2, a Hypervisor system is utilized to create a communication mechanism for transmitting the frame buffer physical address, an asynchronous notification mechanism for image information control, a real-time image information signal synchronization mechanism and an image keep-alive information heartbeat notification mechanism for synchronization and waiting, and therefore double-screen interaction between the central control display touch screen end and the instrument display screen end is completed.
Through the scheme, the two screens of the dual system are realized on the Hypervisor virtualization technology by adopting one processor, an additional hardware physical connection mode is not needed, the function of independently applying and displaying the image information is started simultaneously, a dual-screen interaction mode is realized, and the hardware cost of the intelligent cabin operating system is reduced.
Preferably, the communication mechanism in step S2 includes the following steps: the method includes the steps that a frame buffer physical address of a central control display virtual expansion screen end is transmitted in the Hypervisor system, the central control display touch screen end and an instrument display screen which are started in the Hypervisor system can be applied for access, so that the instrument display screen end can further acquire data of the frame buffer physical address while displaying a picture of vehicle-mounted parameters, and a layer of the central control display virtual expansion screen end is added for displaying.
Through the scheme, a display screen drive/process is abstracted from a layer of the instrument operating system to be a virtual display interface, and the central control virtual expansion screen is directly connected to the display interface in an abutting mode, so that stable and efficient synchronous display between the two systems can be guaranteed; in a scene of synchronous display of double screens, a Hypervisor provides a shared memory mode of real-time transmission, synchronous control is carried out on display of image information between two systems, when image data of a central control extended virtual screen is sent to a meter for display, a screen projection management program simultaneously sends an image synchronization signal (nonce) field, after the meter finishes image presentation, a corresponding nonce field value is returned, then the central control extended virtual screen transmits the next frame of image data, and the condition that the meter can completely display one frame of image data without generating a scene of a screen splash is ensured; when the cross-system double-screen display is carried out, the stable and efficient transmission of image information can be guaranteed, the image is not distorted and 0 delay is guaranteed, the CPU is not additionally occupied by image data transmission, the image information received by the instrument display operating system does not need to be copied by a memory, the image information is directly sent and displayed, and the cross-system double-screen interaction is efficiently completed.
Preferably, the step of transmitting the frame buffer physical address in step S1 is as follows:
s11, triggered by an input event, judging whether the current screen is occupied after the screen projection application receives the event trigger, and setting the Status field to be 1 when the screen projection is unoccupied or the input event is high in priority;
s12, a communication mechanism of the Hypervisor system receives an instruction for starting transmission of the frame buffer physical address, the transmission is carried out according to the current image frame rate of the central control display virtual expansion screen end, a name field is set as the current terminal name, index is set as an index value, hys _ addr is set as the frame buffer physical address, a bpp field is set as a pixel point, a mode field is set as a mode for allocating memory for the frame buffer physical address, a size field is set as the size of the frame buffer physical address, a width field is set as the length of the frame buffer physical address, and a height field is set as the height of the frame buffer physical address;
and S13, after receiving the frame buffer physical address image information, the instrument display screen end draws the frame buffer physical address image information in an application state and displays the frame buffer physical address image information on the instrument display screen end.
Preferably, the asynchronous notification mechanism in step S2 includes the following specific steps:
when the Status field is set to 1, it is step S11 that the image information of the framebuffer physical address is allowed to be transmitted;
and when the Status field is set to be 0, asynchronously notifying an expansion screen control program of the instrument display screen end through a communication mechanism of the Hypetivir system, and closing the display of the central control expansion virtual screen end.
Preferably, the image information signal synchronization mechanism in step S2 includes the following steps:
(1) transmitting a synchronous signal of an image in a mode of providing a shared memory through a Hypervisor system;
(2) after the interactive image information synthesis between a central control display virtual expansion screen end display interface and an instrument display screen end display interface is completed, while the frame buffer physical address is transmitted, a synchronizing signal nonce field is written into an idle shared memory block, a client name is written into a name field, an index field is written into a client, a size field is written into the size of a client shared memory, a share _ len field is written into the length of the shared memory, a share _ array is constructed, and a next member and a data member are used for pointing to one memory share;
(3) after the virtual expansion screen image is displayed, the instrument display screen end inquires a corresponding management list according to the index, reads synchronous data corresponding to the queue pointer, adds 1 to a synchronous signal fence after the reading is finished, and writes the modified data into the shared memory block;
(4) and after the central control display virtual expansion screen end receives the returned synchronous data, ending the current image synchronization process, if the return value of the synchronous signal is not received within the threshold time, judging that the synchronization is overtime, sending an overtime mark, and ending the current synchronization process.
Preferably, the image keep-alive information heartbeat notification mechanism in step S2 includes the following specific steps:
(1) the screen-throwing management program sends the heartbeat value of the image keep-alive information at regular time, the written field name is the name of the current terminal, the written time _ out field is the timeout time, the written field heartbeat _ flag is the heartbeat mark, and the written field heartbeat _ count field is the heartbeat count;
(2) the instrument display screen end displays the survival signal array of the virtual expansion screen end through the central control notified by the Hypervisor at regular time and is used for judging whether the image information transmission of the client terminal is normal or not;
(3) when the screen projection management program does not send the image keep-alive information heartbeat value array any more, the instrument display screen end actively inquires the running state of the client through the Hypervisor system to determine whether the client is abnormal or not;
(4) when the client is determined to be abnormal, the instrument display screen end closes the interactive interface of the image information, clears the image keep-alive information heartbeat value array, and resets the interactive function of the image information after the client is normal again.
A double-screen interaction system based on a Hypervisor intelligent cabin operating system comprises a core processor, a central control display screen end, an instrument display screen end and a central control display virtual expansion screen end;
a core processor: starting a central control display virtual expansion screen end and an instrument display screen end through a Hypervisor system, constructing a communication management mechanism in the Hypervisor system, and transmitting a frame buffer physical address of the central control display virtual expansion screen to the instrument display screen end;
the central control display screen end: the system is used for generating central control display content of the vehicle-mounted entertainment application, generating display content of vehicle-mounted instrument display screen interaction and displaying a vehicle-mounted entertainment application interface;
the central control displays the virtual expansion screen end: the device is used for displaying content interacted to the instrument display screen end;
instrument display screen end: and displaying vehicle instrument parameters and the content of the central control display virtual expansion screen of the vehicle-mounted entertainment system.
Preferably, the communication management mechanism specifically includes: the method is used for the transmission of frampbuffer physical addresses, the communication of image control information, the synchronous interaction of image information and the heartbeat notification of image keep-alive information between a central control display screen end and an instrument display end.
The beneficial technical effects of the invention are as follows: 1. the processor is adopted, the two screens of the dual system are realized on the Hypervisor virtualization technology, an additional hardware physical connection mode is not needed, the function of independently applying and displaying image information is started simultaneously, the dual-screen interaction mode is realized, and the hardware cost of the intelligent cabin operating system is reduced.
2. Abstracting a display screen drive/process to be a virtual display interface from a layer of an instrument operating system, and directly butting a central control virtual expansion screen to the display interface so as to ensure that the two systems can stably and efficiently realize synchronous display; in a scene of synchronous display of double screens, a Hypervisor provides a shared memory mode of real-time transmission, synchronous control is carried out on display of image information between two systems, when image data of a central control extended virtual screen is sent to a meter for display, a screen projection management program simultaneously sends an image synchronization signal (nonce) field, after the meter finishes image presentation, a corresponding nonce field value is returned, then the central control extended virtual screen transmits the next frame of image data, and the condition that the meter can completely display one frame of image data without generating a scene of a screen splash is ensured; when the cross-system double-screen display is carried out, the stable and efficient transmission of image information can be guaranteed, the image is not distorted and 0 delay is guaranteed, the CPU is not additionally occupied by image data transmission, the image information received by the instrument display operating system does not need to be copied by a memory, the image information is directly sent and displayed, and the cross-system double-screen interaction is efficiently completed.
Drawings
Fig. 1 is a schematic processing flow diagram of a dual-screen interaction method according to embodiment 1 of the present invention.
Fig. 2 is a block diagram of a dual-screen interactive system according to embodiment 2 of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention are clearly and completely described below with reference to fig. 1-2 of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1:
as shown in fig. 1, a central control display virtual expansion screen is constructed in a vehicle-mounted entertainment operating system, a corresponding frame buffer is created, and then an interface to be interacted is synthesized and written into the frame buffer for transmission.
The Hypervisor provides an interactive channel between a vehicle-mounted entertainment operating system and an instrument display system, creates a communication mechanism for transmitting a frame buffer physical address, an asynchronous notification mechanism for image information control, a real-time image information synchronous signal and a synchronous waiting image keep-alive information heartbeat notification mechanism; in this embodiment, based on the Hypervisor system, the above mechanisms solve the problem of dual-screen display interaction, and the frame buffer physical address of the central control display virtual extended screen, hereinafter collectively referred to as "extra frame buffer", is transmitted, and the Hypervisor-started system can all apply for access, so that the instrument display operating system displays the picture of the vehicle-mounted parameter, and at the middle position of the instrument screen, after acquiring the data of the extra frame buffer, adds a layer for presentation, and abstracts a display screen drive/process to be a virtual display interface, and directly connects the central control virtual extended screen to the display interface, thereby ensuring that the two systems can stably and efficiently realize synchronous display.
In the specific implementation, in a scene of synchronous display of double screens, the Hypervisor provides a shared memory mode of real-time transmission, synchronous control is carried out on display of image information between two systems, when image data of a central control extended virtual screen is sent to a meter for display, a screen projection management program simultaneously sends an image synchronization signal nonce field, after the meter finishes image presentation, the corresponding nonce field value is returned, then the central control extended virtual screen transmits next frame of image data, and the condition that the meter can completely display one frame of image data is ensured, and a scene of screen splash is not generated.
This embodiment can guarantee the stable high-efficient transmission of image information when crossing the double screen display of system, guarantees that the image is undistorted, 0 postpones, and image data transmission does not additionally occupy CPU moreover, and the image information that instrument display operating system received also need not carry out the memory copy, directly sends and shows, and the high-efficient double screen interaction of crossing the system is accomplished.
Recording and transmitting image information related fields through a name field, an index field, an hys _ addr field, a vir _ addr field, a bpp field, a mode field, a size field, a width field and a height field, wherein the name field represents the name of an originating communication party, the index field records the index of a communication section, the hys _ addr field stores the physical address of a frame buffer, the vir _ addr field stores the virtual address of the frame buffer, the bpp field records the pixel value of the frame buffer, the mode field stores the allocation mode of a frame buffer memory, the size field represents the size of the frame buffer image information, the width field represents the length of the image information, and the height field represents the height of the image information.
The extra frame buffer transmission steps are as follows:
1) triggered by an input event (a Bluetooth telephone, functional key control trigger on a steering wheel, navigation application starting, music playing and the like), judging whether a current screen is occupied or not after the screen casting application receives the event trigger, and setting a Status field to be 1 in an idle or high-priority scene;
2) the Hypervisor communication management mechanism receives an instruction of starting to transmit the extra frame buffer, transmits the instruction according to the current entertainment operating system image frame rate (modifiable), sets a name field as the current terminal name, sets an index value, sets hys _ addr as the physical address of the extra frame buffer, sets a bpp field as a pixel point, sets a mode field as the memory allocation mode of the extra frame buffer, sets a size field as the size of the extra frame buffer, sets a width field as the length of the extra frame buffer, and sets a height field as the height of the extra frame buffer.
3) After the instrument display operating system receives the extraframebuffer image information, the extraframebuffer image information is drawn in an application state and displayed in the middle of the instrument panel.
The extra frame buffer control transmission mechanism comprises the following steps:
1) the Status field is set to be 1, and the extra frame buffer image information is transmitted in the 7 th step;
2) and the Status field is set to be 0, and the extended screen control program of the instrument operating system is asynchronously notified through a Hypetivir communication management mechanism, so that the display of the central control extended virtual screen is closed.
The method comprises the following steps of:
1) transmitting a synchronous signal of an image in a mode of providing a shared memory through a Hypervisor;
2) after the interactive image information is synthesized, while transmitting the extra frame buffer physical address, writing the synchronizing signal nonce into the idle shared memory block, writing the client name into the name field, and writing the index field into the index of the client; the size field is written into the size of the shared memory of the client; the length of the shared _ len field written into the shared memory; and constructing a shmen _ array, wherein the next member and the data member are used for pointing to one block of memory sharing.
3) After the instrument display operation system displays the virtual expansion screen image, inquiring a corresponding management list according to the index, reading synchronous data corresponding to the queue pointer, adding 1 to a synchronous signal fence after the reading is finished, and writing the modified data into the shared memory block;
4) and after receiving the returned synchronous data, the vehicle-mounted entertainment operating system finishes the current image synchronization process, judges that the synchronization is overtime if the return value of the synchronous signal is not received within 32ms, sends an overtime mark and finishes the current synchronization process.
An extra frame buffer image information survival heartbeat mechanism comprises the following steps:
1) the screen-casting management program sends a heartbeat value at regular time, the written field name is the name of the current terminal, the written time _ out field is overtime (default is 1S), the written field heartbeat _ flag is a heartbeat mark, and the written field heartbeat _ count field is a heartbeat count;
2) the instrument display operating system is used for regularly judging whether image information transmission of the client terminal is normal through the virtual expansion screen survival signal array notified by the Hypervisor;
3) when the screen projection management program does not send the keep-alive information array any more, the instrument display operating system actively inquires the running state of the client through the Hypervisor to determine whether the client is abnormal or not;
and when the interaction is determined to be abnormal, the instrument display operation system closes the interaction interface of the image information, clears the heartbeat array, and restarts and starts the interaction function of the image information after the vehicle-mounted entertainment operation system is normal again.
Example 2:
as shown in fig. 2, a method and a system for two-screen interaction based on a hyperbosor intelligent cabin operating system are characterized by comprising:
the core processor starts two operating systems, namely a vehicle-mounted entertainment operating system and an instrument display operating system, through a Hypervisor virtualization technology;
the vehicle-mounted entertainment operating system is used for generating central control display content of vehicle-mounted entertainment application and generating display content of vehicle-mounted instrument interaction;
the central control display screen is connected with the vehicle-mounted entertainment operating system and used for displaying a vehicle-mounted entertainment application interface;
the central control display virtual expansion screen is generated by the vehicle-mounted entertainment operating system and is used for displaying the content interacted with the instrument display screen;
the instrument display screen is connected with the instrument display operation system and is used for displaying vehicle instrument parameters and the content of the central control display virtual expansion screen of the vehicle-mounted entertainment system;
and the communication management mechanism is constructed by a Hypervisor system and transmits the frame buffer physical address of the central control display virtual expansion screen of the vehicle-mounted entertainment operating system to the instrument display operating system.
The system is characterized in that a core processor is required to be connected with a memory unit and used for storing the Hypervisor, the vehicle-mounted entertainment operating system and the instrument display operating system, and connected with a 2-path LVDS serial chip and a LVDS deserializer chip and used for displaying 2-path LCD image information, wherein a central control display screen is a touch screen, and the instrument display screen does not have a touch function.
The vehicle-mounted entertainment operating system provides central control display content of vehicle-mounted entertainment application, creates a central control display virtual expansion screen when the system is started, completes application of a virtual expansion screen frame buffer, and sends a physical address of the virtual expansion screen frame buffer to a communication management mechanism when screen projection application projects graphic information such as navigation, telephone, music and the like to the expansion screen, so that multi-screen display is realized.
And the instrument display operation system is used for providing vehicle instrument information display and providing control display virtual expansion screen image information in the independent layer display. The opening and closing function of the virtual expansion screen and the graphic information switching function are controlled by function keys arranged on a steering wheel.
The central control display screen is used for displaying the vehicle-mounted entertainment application interface, receiving the double-screen interaction instruction and sending the instruction to the vehicle-mounted entertainment operating system;
and the central control displays the virtual expansion screen, and image information is generated by screen projection application, is sent to the vehicle-mounted entertainment operating system for synthesis and is stored in a framebuffer address applied by the vehicle-mounted entertainment operating system.
The communication management mechanism is constructed by a Hypervisor system and is used for frampbuffer address transmission, image control information communication, image information synchronous interaction and image keep-alive information heartbeat notification function between the vehicle-mounted entertainment operating system and the instrument display operating system.
The communication management mechanism manages the interactive image information of the vehicle-mounted entertainment operating system and the instrument display operating system, and specifically comprises the following steps: recording and transmitting image information related fields through a name field, an index field, an hys _ addr field, a vir _ addr field, a bpp field, a mode field, a size field, a width field and a height field, wherein the name field represents the name of an originating communication party, the index field records the index of a communication section, the hys _ addr field stores the physical address of a frame buffer, the vir _ addr field stores the virtual address of the frame buffer, the bpp field records the pixel value of the frame buffer, the mode field stores the allocation mode of a frame buffer memory, the size field represents the size of the frame buffer image information, the width field represents the length of the image information, and the height field represents the height of the image information.
The communication management mechanism manages the control of image information before the vehicle-mounted entertainment operating system and the instrument display operating system, and specifically comprises the following steps: and transmitting status field control information in an asynchronous communication mode, wherein a 1 value of the status field indicates that the virtual expansion screen image information needs to be displayed, and a 0 value indicates that the virtual expansion screen image information is closed.
The communication management mechanism manages the interaction of image information synchronization, and specifically comprises the following steps: the method is characterized in that a mode of sharing the memory is provided by the Hypervisor to transmit a synchronous signal of an image. Wherein the name field is used for representing the name of the client; the index field is used for recording the index of the client; the size field is used for recording the size of the shared memory of the client, and the unit is byte; the share _ len field represents the length of the shared memory operated by the client; the share _ b field represents the available bit table of the array; the queue _ tab field is used for marking the head and the tail of the queue; the shmen _ array comprises a next member and a data member, wherein the next member is used for constructing a queue pointer, and the data member is used for pointing to a block of memory sharing. After the synthesis of the interactive image information is completed, the vehicle-mounted entertainment operating system transmits the frame buffer and simultaneously writes the synchronizing signal into the idle shared memory block, judges whether the data is completely sent or not, and if the data is not completely sent, adds the data into the tail of the queue and marks the data. After the instrument display operating system displays the virtual expansion screen image, the corresponding management list is inquired according to the index, the synchronous data corresponding to the queue pointer is read, the operation of adding 1 is carried out after the reading is finished, the modified synchronous data is written into the shared memory block, the vehicle-mounted entertainment operating system finishes the current image synchronization process after receiving the returned synchronous data, if the return value of the synchronous signal is not received within 32ms, the synchronization is judged to be overtime, the overtime mark is sent, and the current synchronization process is finished.
The image keep-alive information heartbeat notification function of the communication management mechanism comprises the following steps: the instrument display operating system receives the live signal of the virtual expansion screen notified by the vehicle-mounted entertainment operating system at regular time, when the live information is not sent any more, the instrument display operating system considers that the interaction is abnormal, the interactive interface of the image information is closed, and when the vehicle-mounted entertainment operating system is normal again, the interactive function of the image information is restarted and started.
In the description of the present invention, it is to be understood that the terms "counterclockwise", "clockwise", "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate orientations or positional relationships based on those shown in the drawings, and are used for convenience of description only, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be considered as limiting.
Claims (8)
1. A double-screen interaction method based on a Hypervisor intelligent cabin operating system is characterized by comprising the following steps:
s1, constructing a central control display virtual expansion screen end at the central control display touch screen end, creating a frame buffer physical address corresponding to the central control display virtual expansion screen, synthesizing a central control display virtual expansion screen end display interface to be interacted with an instrument display screen end display interface, and writing the synthesized interface into the frame buffer physical address for transmission;
s2, a Hypervisor system is utilized to create a communication mechanism for transmitting the frame buffer physical address, an asynchronous notification mechanism for image information control, a real-time image information signal synchronization mechanism and an image keep-alive information heartbeat notification mechanism for synchronization and waiting, and therefore double-screen interaction between the central control display touch screen end and the instrument display screen end is completed.
2. The dual-screen interaction method based on the Hypervisor intelligent cabin operating system as claimed in claim 1, wherein the communication mechanism in step S2 comprises the following specific steps: the method includes the steps that a frame buffer physical address of a central control display virtual expansion screen end is transmitted in the Hypervisor system, the central control display touch screen end and an instrument display screen which are started in the Hypervisor system can be applied for access, so that the instrument display screen end can further acquire data of the frame buffer physical address while displaying a picture of vehicle-mounted parameters, and a layer of the central control display virtual expansion screen end is added for displaying.
3. The dual-screen interaction method based on the Hypervisor intelligent cabin operating system as claimed in claim 1, wherein the step of transmitting the frame buffer physical address in step S1 is as follows:
s11, triggered by an input event, judging whether the current screen is occupied after the screen projection application receives the event trigger, and setting the Status field to be 1 when the screen projection is unoccupied or the input event is high in priority;
s12, a communication mechanism of the Hypervisor system receives an instruction for starting transmission of the frame buffer physical address, the transmission is carried out according to the current image frame rate of the central control display virtual expansion screen end, a name field is set as the current terminal name, index is set as an index value, hys _ addr is set as the frame buffer physical address, a bpp field is set as a pixel point, a mode field is set as a mode for allocating memory for the frame buffer physical address, a size field is set as the size of the frame buffer physical address, a width field is set as the length of the frame buffer physical address, and a height field is set as the height of the frame buffer physical address;
and S13, after receiving the frame buffer physical address image information, the instrument display screen end draws the frame buffer physical address image information in an application state and displays the frame buffer physical address image information on the instrument display screen end.
4. The double-screen interaction method based on Hypervisor intelligent cabin operating system according to claim 3, wherein the asynchronous notification mechanism in step S2 comprises the following specific steps:
when the Status field is set to 1, it is step S11 that the image information of the framebuffer physical address is allowed to be transmitted;
and when the Status field is set to be 0, asynchronously notifying an expansion screen control program of the instrument display screen end through a communication mechanism of the Hypetivir system, and closing the display of the central control expansion virtual screen end.
5. The dual-screen interaction method based on the Hypervisor intelligent cabin operating system as claimed in claim 1, wherein the image information signal synchronization mechanism in step S2 comprises the following specific steps:
(1) transmitting a synchronous signal of an image in a mode of providing a shared memory through a Hypervisor system;
(2) after the interactive image information synthesis between a central control display virtual expansion screen end display interface and an instrument display screen end display interface is completed, while the frame buffer physical address is transmitted, a synchronizing signal nonce field is written into an idle shared memory block, a client name is written into a name field, an index field is written into a client, a size field is written into the size of a client shared memory, a share _ len field is written into the length of the shared memory, a share _ array is constructed, and a next member and a data member are used for pointing to one memory share;
(3) after the virtual expansion screen image is displayed, the instrument display screen end inquires a corresponding management list according to the index, reads synchronous data corresponding to the queue pointer, adds 1 to a synchronous signal fence after the reading is finished, and writes the modified data into the shared memory block;
(4) and after the central control display virtual expansion screen end receives the returned synchronous data, ending the current image synchronization process, if the return value of the synchronous signal is not received within the threshold time, judging that the synchronization is overtime, sending an overtime mark, and ending the current synchronization process.
6. The dual-screen interaction method based on the Hypervisor intelligent cabin operating system as claimed in claim 1, wherein the image keep-alive information heartbeat notification mechanism in step S2 comprises the following specific steps:
(1) the screen-throwing management program sends the heartbeat value of the image keep-alive information at regular time, the written field name is the name of the current terminal, the written time _ out field is the timeout time, the written field heartbeat _ flag is the heartbeat mark, and the written field heartbeat _ count field is the heartbeat count;
(2) the instrument display screen end displays the survival signal array of the virtual expansion screen end through the central control notified by the Hypervisor at regular time and is used for judging whether the image information transmission of the client terminal is normal or not;
(3) when the screen projection management program does not send the image keep-alive information heartbeat value array any more, the instrument display screen end actively inquires the running state of the client through the Hypervisor system to determine whether the client is abnormal or not;
(4) when the client is determined to be abnormal, the instrument display screen end closes the interactive interface of the image information, clears the image keep-alive information heartbeat value array, and resets the interactive function of the image information after the client is normal again.
7. A double-screen interaction system based on a Hypervisor intelligent cabin operating system is characterized by comprising a core processor, a central control display screen end, an instrument display screen end and a central control display virtual expansion screen end;
a core processor: starting a central control display virtual expansion screen end and an instrument display screen end through a Hypervisor system, constructing a communication management mechanism in the Hypervisor system, and transmitting a frame buffer physical address of the central control display virtual expansion screen to the instrument display screen end;
the central control display screen end: the system is used for generating central control display content of the vehicle-mounted entertainment application, generating display content of vehicle-mounted instrument display screen interaction and displaying a vehicle-mounted entertainment application interface;
the central control displays the virtual expansion screen end: the device is used for displaying content interacted to the instrument display screen end;
instrument display screen end: and displaying vehicle instrument parameters and the content of the central control display virtual expansion screen of the vehicle-mounted entertainment system.
8. The dual-screen interactive system based on the Hypervisor intelligent cabin operating system as claimed in claim 7, wherein the communication management mechanism specifically comprises: the method is used for the transmission of frampbuffer physical addresses, the communication of image control information, the synchronous interaction of image information and the heartbeat notification of image keep-alive information between a central control display screen end and an instrument display end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010023848.1A CN111240626A (en) | 2020-01-09 | 2020-01-09 | Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010023848.1A CN111240626A (en) | 2020-01-09 | 2020-01-09 | Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111240626A true CN111240626A (en) | 2020-06-05 |
Family
ID=70864132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010023848.1A Pending CN111240626A (en) | 2020-01-09 | 2020-01-09 | Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111240626A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111976482A (en) * | 2020-07-08 | 2020-11-24 | 南斗六星系统集成有限公司 | Double-screen interaction system and method for vehicle-mounted instrument screen and central control entertainment screen |
| CN112153444A (en) * | 2020-09-17 | 2020-12-29 | 中国第一汽车股份有限公司 | Vehicle-mounted multi-screen video synchronization method and device, electronic system and storage medium |
| CN112202967A (en) * | 2020-09-01 | 2021-01-08 | 武汉卡比特信息有限公司 | Split screen display method based on mobile phone interconnection |
| CN112477780A (en) * | 2021-01-14 | 2021-03-12 | 广州飞歌汽车音响有限公司 | Vehicle-mounted entertainment system |
| CN112579014A (en) * | 2019-09-27 | 2021-03-30 | 宝能汽车集团有限公司 | Multi-screen display method and system based on Hypervisor, vehicle and storage medium |
| CN112929343A (en) * | 2021-01-22 | 2021-06-08 | 中汽创智科技有限公司 | Cross-domain communication method, system, equipment and storage medium for intelligent cockpit |
| CN113504870A (en) * | 2021-04-06 | 2021-10-15 | 惠州市德赛西威智能交通技术研究院有限公司 | Hypervisor intelligent cockpit input method sharing system and method |
| CN113535104A (en) * | 2021-05-31 | 2021-10-22 | 惠州华阳通用电子有限公司 | Multi-screen display switching method and device based on virtual machine |
| CN113810848A (en) * | 2021-08-31 | 2021-12-17 | 延锋伟世通电子科技（南京）有限公司 | Vehicle-mounted Ethernet touchbar device |
| CN114461158A (en) * | 2021-12-29 | 2022-05-10 | 沈阳中科创达软件有限公司 | Application screen projection method and device, vehicle-mounted terminal and readable storage medium |
| CN114489543A (en) * | 2022-01-25 | 2022-05-13 | 广州小鹏汽车科技有限公司 | Multi-screen processing method, device, chip, vehicle and medium for intelligent cabin |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN115871560A (en) * | 2023-01-29 | 2023-03-31 | 蔚来汽车科技(安徽)有限公司 | Reverse image display method, control device, vehicle and computer storage medium |
| CN115934603A (en) * | 2023-01-30 | 2023-04-07 | 中瓴智行(成都)科技有限公司 | Intelligent cabin domain controller based on modularization |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105830053A (en) * | 2014-01-16 | 2016-08-03 | 英特尔公司 | An apparatus, method, and system for a fast configuration mechanism |
| WO2017084174A1 (en) * | 2015-11-19 | 2017-05-26 | 深圳市鹰硕技术有限公司 | Image synchronous display method and device |
| US20180046556A1 (en) * | 2016-08-15 | 2018-02-15 | Oracle International Corporation | Persistent memory transactions with undo logging |
| CN108984137A (en) * | 2017-06-01 | 2018-12-11 | 福建星网视易信息系统有限公司 | Double-screen display method and its system, computer readable storage medium |
| CN109343929A (en) * | 2018-09-05 | 2019-02-15 | 武汉光庭信息技术股份有限公司 | A kind of multi-screen interaction method and system based on the shared video memory of virtualization |
| CA3088971A1 (en) * | 2018-01-26 | 2019-08-01 | Citrix Systems, Inc. | Virtual computing system providing local screen sharing from hosted collaboration applications and related methods |
| CN217360657U (en) * | 2022-02-08 | 2022-09-02 | 长沙秉哲科技有限公司 | Immersive VR large-screen interactive display device |
-
2020
- 2020-01-09 CN CN202010023848.1A patent/CN111240626A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105830053A (en) * | 2014-01-16 | 2016-08-03 | 英特尔公司 | An apparatus, method, and system for a fast configuration mechanism |
| WO2017084174A1 (en) * | 2015-11-19 | 2017-05-26 | 深圳市鹰硕技术有限公司 | Image synchronous display method and device |
| US20180046556A1 (en) * | 2016-08-15 | 2018-02-15 | Oracle International Corporation | Persistent memory transactions with undo logging |
| US20180046374A1 (en) * | 2016-08-15 | 2018-02-15 | Oracle International Corporation | Efficient memory management for persistent memory |
| CN108984137A (en) * | 2017-06-01 | 2018-12-11 | 福建星网视易信息系统有限公司 | Double-screen display method and its system, computer readable storage medium |
| CA3088971A1 (en) * | 2018-01-26 | 2019-08-01 | Citrix Systems, Inc. | Virtual computing system providing local screen sharing from hosted collaboration applications and related methods |
| CN109343929A (en) * | 2018-09-05 | 2019-02-15 | 武汉光庭信息技术股份有限公司 | A kind of multi-screen interaction method and system based on the shared video memory of virtualization |
| CN217360657U (en) * | 2022-02-08 | 2022-09-02 | 长沙秉哲科技有限公司 | Immersive VR large-screen interactive display device |
Non-Patent Citations (2)
| Title |
|---|
| 刘秀玲等: "分布式多交互虚拟场景渲染的协同控制", 《计算机工程与应用》, no. 29, 11 October 2009 (2009-10-11), pages 82 - 85 * |
| 杨磊等: "《网络视频监控技术》", 中国传媒大学出版社, pages: 208 * |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112579014A (en) * | 2019-09-27 | 2021-03-30 | 宝能汽车集团有限公司 | Multi-screen display method and system based on Hypervisor, vehicle and storage medium |
| CN111976482B (en) * | 2020-07-08 | 2021-12-24 | 南斗六星系统集成有限公司 | Double-screen interaction system and method for vehicle-mounted instrument screen and central control entertainment screen |
| CN111976482A (en) * | 2020-07-08 | 2020-11-24 | 南斗六星系统集成有限公司 | Double-screen interaction system and method for vehicle-mounted instrument screen and central control entertainment screen |
| CN112202967A (en) * | 2020-09-01 | 2021-01-08 | 武汉卡比特信息有限公司 | Split screen display method based on mobile phone interconnection |
| CN112153444A (en) * | 2020-09-17 | 2020-12-29 | 中国第一汽车股份有限公司 | Vehicle-mounted multi-screen video synchronization method and device, electronic system and storage medium |
| CN112477780A (en) * | 2021-01-14 | 2021-03-12 | 广州飞歌汽车音响有限公司 | Vehicle-mounted entertainment system |
| CN112929343B (en) * | 2021-01-22 | 2022-10-18 | 中汽创智科技有限公司 | Cross-domain communication method, system, equipment and storage medium for intelligent cockpit |
| CN112929343A (en) * | 2021-01-22 | 2021-06-08 | 中汽创智科技有限公司 | Cross-domain communication method, system, equipment and storage medium for intelligent cockpit |
| CN113504870A (en) * | 2021-04-06 | 2021-10-15 | 惠州市德赛西威智能交通技术研究院有限公司 | Hypervisor intelligent cockpit input method sharing system and method |
| CN113535104A (en) * | 2021-05-31 | 2021-10-22 | 惠州华阳通用电子有限公司 | Multi-screen display switching method and device based on virtual machine |
| CN113535104B (en) * | 2021-05-31 | 2023-09-26 | 惠州华阳通用电子有限公司 | Multi-screen display switching method and device based on virtual machine |
| CN113810848A (en) * | 2021-08-31 | 2021-12-17 | 延锋伟世通电子科技（南京）有限公司 | Vehicle-mounted Ethernet touchbar device |
| CN114461158A (en) * | 2021-12-29 | 2022-05-10 | 沈阳中科创达软件有限公司 | Application screen projection method and device, vehicle-mounted terminal and readable storage medium |
| CN114461158B (en) * | 2021-12-29 | 2024-02-09 | 沈阳中科创达软件有限公司 | Application screen projection method and device, vehicle-mounted terminal and readable storage medium |
| CN114489543A (en) * | 2022-01-25 | 2022-05-13 | 广州小鹏汽车科技有限公司 | Multi-screen processing method, device, chip, vehicle and medium for intelligent cabin |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
| CN114756321A (en) * | 2022-04-28 | 2022-07-15 | 重庆长安汽车股份有限公司 | System and method for realizing and displaying instrument interactive interface based on vehicle machine |
| CN114756321B (en) * | 2022-04-28 | 2024-02-06 | 重庆长安汽车股份有限公司 | System and method for realizing instrument interaction interface and displaying based on vehicle-mounted device |
| CN115871560A (en) * | 2023-01-29 | 2023-03-31 | 蔚来汽车科技(安徽)有限公司 | Reverse image display method, control device, vehicle and computer storage medium |
| CN115934603A (en) * | 2023-01-30 | 2023-04-07 | 中瓴智行(成都)科技有限公司 | Intelligent cabin domain controller based on modularization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111240626A (en) | Method and system for double-screen interaction of intelligent cabin operating system based on Hypervisor | |
| US9047102B2 (en) | Instant remote rendering | |
| US8957905B2 (en) | Cross-environment user interface mirroring | |
| US8819705B2 (en) | User interaction support across cross-environment applications | |
| US8933949B2 (en) | User interaction across cross-environment applications through an extended graphics context | |
| CN102053871B (en) | Application program image display method and device | |
| EP3627319B1 (en) | Display resource scheduling method and device for embedded system | |
| CN113032080B (en) | Page implementation method, application program, electronic device and storage medium | |
| CN104205050A (en) | Accessing a device on a remote machine | |
| WO2021227688A1 (en) | Screen extension method and apparatus, and terminal device and computer-readable storage medium | |
| WO2023138020A1 (en) | Image generation method and apparatus, electronic device, and storage medium | |
| CN114398018A (en) | Picture display method, device, storage medium and electronic equipment | |
| CN112698874B (en) | Method for simultaneously displaying ast display card and independent display card in kylin system | |
| CN116126272A (en) | Screen projection method and device, electronic equipment and nonvolatile storage medium | |
| CN117857513A (en) | Interactive processing method and device for remote operation and maintenance, terminal equipment and storage medium | |
| CN116483301A (en) | Multi-screen display method, device, equipment and storage medium | |
| CN117492607A (en) | Multi-screen collaboration method, vehicle and computer storage medium | |
| JP2003256872A (en) | Shared information setting method in virtual space communication system, virtual space display method, its program and recording medium having its program recorded thereon | |
| CN115374029A (en) | Information transmission method, information transmission device, storage medium and electronic equipment | |
| CN117519860A (en) | Application window display method and device and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |