CN115826898B - Cross-screen display method, system, device, equipment and storage medium - Google Patents
Cross-screen display method, system, device, equipment and storage medium Download PDFInfo
- Publication number
- CN115826898B CN115826898B CN202310001106.2A CN202310001106A CN115826898B CN 115826898 B CN115826898 B CN 115826898B CN 202310001106 A CN202310001106 A CN 202310001106A CN 115826898 B CN115826898 B CN 115826898B
- Authority
- CN
- China
- Prior art keywords
- screen
- display
- display device
- displayed
- cross
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000000694 effects Effects 0.000 claims description 47
- 238000004891 communication Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 6
- 238000002955 isolation Methods 0.000 claims description 3
- 239000008186 active pharmaceutical agent Substances 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000001965 increasing effect Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The disclosure provides a cross-screen display method, a system, a device, equipment and a storage medium, wherein the method comprises the following steps: receiving cross-screen display request information sent by first display equipment; based on the cross-screen display request information, driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device; and driving the second display equipment to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer equipment so as to enable the second display equipment to display the image frames to be displayed across the screen. By adopting the method, each application program in the display equipment does not need to have mutually compatible information sharing protocols and APIs, but the image frames needing to be displayed in a cross-screen mode are directly cached by using the preset hardware caching equipment, and the cross-screen display is directly supported on the hardware level, so that better display equipment compatibility is achieved, and the problem that the cross-screen display cannot be realized without supporting the virtualized scheduling by the application program is solved.
Description
Technical Field
The disclosure relates to the technical field of information interaction, and in particular relates to a cross-screen display method, a system, a device, equipment and a storage medium.
Background
For an application scenario in which a plurality of display screens are configured on the same vehicle, in order to facilitate a user to view display contents of the plurality of display screens at the same time, cross-screen display is often required between different display screens, for example, part or all of display contents in one display screen need to be displayed in another display screen.
In the existing cross-screen display method, the same virtual machine platform corresponds to different display screens in a vehicle in a virtualized mode, and then when the cross-screen display is required, display contents among different display screens under different operating systems are displayed in the same display screen in a cross-screen mode by calling a virtualized API (Application Program Interface ).
However, the manner of realizing the cross-screen display through the virtual machine platform requires that each application program has mutually compatible information sharing protocols and APIs, has high development requirements on the application, and cannot realize the cross-screen display if the application program does not support the virtualized scheduling.
Disclosure of Invention
The present disclosure provides a method, a system, an apparatus, a device, and a storage medium for displaying a screen across, so as to at least solve the above technical problems in the prior art.
According to a first aspect of the present disclosure, there is provided a cross-screen display method, the method comprising:
receiving cross-screen display request information sent by first display equipment; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
based on the cross-screen display request information, driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device; the image frame to be displayed across the screen is an image frame displayed by the first display device;
driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen; and the second display device identifies the corresponding display device for the target display device.
In an embodiment, the driving the first display device to perform the operation of writing the image frame to be displayed across the screen into the preset hardware buffer device based on the information of the request for displaying across the screen includes:
Based on the cross-screen display request information, driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device according to a preset animation effect;
the driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen, including:
and driving the second display device to execute the operation of reading the image frames to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frames to be displayed across the screen according to the preset animation effect.
In an embodiment, the image frame to be displayed across the screen read by the second display device from the preset hardware buffer device is an image frame that has been completely written into the preset hardware buffer device.
In an implementation manner, the cross-screen display request information comprises a plurality of target display device identifiers, and each target display device identifier corresponds to one second display device;
The driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen, including:
and driving each second display device to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer device, so that each second display device displays the image frames to be displayed across the screen in a mode that the image frames to be displayed across the screen replace the original display content of the target display position of the second display device.
According to a second aspect of the present disclosure, there is provided a cross-screen display system, the system comprising:
the first display device is used for sending the cross-screen display request information to the display driving device after receiving the cross-screen display triggering operation; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
the display driving device is used for receiving the cross-screen display request information and driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device based on the cross-screen display request information; and driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen; the image frame to be displayed across the screen is an image frame displayed by the first display device; the second display device identifies a corresponding display device for the target display device;
And the second display device is used for displaying the image frames to be displayed across the screen.
In an embodiment, the display driving device is specifically configured to, based on the cross-screen display request information, drive the first display device to perform an operation of writing, according to a preset animation effect, an image frame to be displayed across the screen into a preset hardware cache device; and driving the second display device to execute the operation of reading the image frame to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen according to the preset animation effect.
In an implementation manner, the first display device is a device in a first hardware domain of the multi-core heterogeneous chip, the second display device is a device in a second hardware domain on the multi-core heterogeneous chip, and the display driving device is a device in a third hardware domain of the multi-core heterogeneous chip; the multi-core heterogeneous chip comprises a plurality of processor cores with different architectures, wherein each processor core and hardware resources connected with the processor core form a hardware domain, and physical isolation exists among all the hardware domains in the multi-core heterogeneous chip; information transmission between the first display device and the second display device and the display driving device is completed through inter-core communication programs among the hardware domains of the multi-core heterogeneous chip.
According to a third aspect of the present disclosure, there is provided a cross-screen display device, the device comprising:
the information receiving module is used for receiving cross-screen display request information sent by the first display equipment; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
the first driving module is used for driving the first display device to execute the operation of writing the image frame to be displayed in a cross-screen mode into a preset hardware cache device based on the cross-screen display request information; the image frame to be displayed across the screen is an image frame displayed by the first display device;
the second driving module is used for driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen so as to enable the second display device to display the image frame to be displayed across the screen; and the second display device identifies the corresponding display device for the target display device.
According to a fourth aspect of the present disclosure, there is provided an electronic device comprising:
At least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described in the present disclosure.
According to a fourth aspect of the present disclosure, there is provided a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of the present disclosure.
According to the cross-screen display method, system, device, equipment and storage medium, each application program in the display equipment is not required to have the mutually compatible information sharing protocol and API, but image frames needing to be displayed in a cross-screen mode are directly cached by using the preset hardware caching equipment, better compatibility of the display equipment is achieved through directly supporting the cross-screen display on a hardware layer, and the problem that the cross-screen display cannot be achieved without supporting the virtualized scheduling by the application program is solved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
The above, as well as additional purposes, features, and advantages of exemplary embodiments of the present disclosure will become readily apparent from the following detailed description when read in conjunction with the accompanying drawings. Several embodiments of the present disclosure are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings, in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
FIG. 1 shows a schematic diagram of a cross-screen display;
fig. 2 illustrates a schematic flowchart of one implementation of a cross-screen display method provided by an embodiment of the disclosure;
FIG. 3 illustrates a schematic view of an image display provided by the present disclosure;
FIG. 4 illustrates another image display schematic provided by the present disclosure;
FIG. 5 illustrates a schematic diagram of one configuration of a cross-screen display system provided by an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a cross-screen display system provided by an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a cross-screen display device according to an embodiment of the present disclosure;
fig. 8 shows a schematic diagram of a composition structure of an electronic device according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, features and advantages of the present disclosure more comprehensible, the technical solutions in the embodiments of the present disclosure will be clearly described in conjunction with the accompanying drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. Based on the embodiments in this disclosure, all other embodiments that a person skilled in the art would obtain without making any inventive effort are within the scope of protection of this disclosure.
Fig. 1 shows a schematic view of a cross-screen display, as shown in fig. 1, for an application scenario in which a plurality of display screens are configured on the same vehicle, each display screen corresponds to a different operating system, so that in order to facilitate a user to view display contents of the plurality of display screens at the same time, cross-screen display is often required between the display screens under different operating systems. As shown in fig. 1, each display screen corresponds to different operating systems in the vehicle, the first display screen corresponds to the first operating system, the second display screen corresponds to the second operating system, and the third display screen corresponds to the third operating system. The first display screen is used for displaying the first application program in the first operating system, the second display screen is used for displaying the second application program in the second operating system, the third display screen is used for displaying the third application program in the third operating system, and data can be transmitted between different operating systems through the information sharing interface. As shown in FIG. 1, in the existing cross-screen display method, the same virtual machine management platform corresponds to different display screens in a vehicle in a virtualized mode, and then when the cross-screen display is required, the virtual API is called to display the display contents among different display screens under different operating systems to the same display screen in a cross-screen manner.
However, the manner of realizing the cross-screen display through the virtual machine platform requires that each application program has mutually compatible information sharing protocols and APIs, has high development requirements on the application, and cannot realize the cross-screen display if the application program does not support the virtualized scheduling.
Accordingly, in order to solve the above-mentioned problems, the present disclosure provides a method, a system, an apparatus, a device, and a storage medium for cross-screen display. The method provided by the present disclosure can be applied to any electronic device capable of performing data processing, including, but not limited to, computers, mobile phones, tablet computers, and the like.
The technical solutions of the embodiments of the present disclosure will be described below with reference to the drawings in the embodiments of the present disclosure.
Fig. 2 shows a schematic flowchart of an implementation of a cross-screen display method according to an embodiment of the disclosure, as shown in fig. 2, where the method includes:
s201, receiving cross-screen display request information sent by a first display device.
The cross-screen display request information comprises a target display device identifier.
In the disclosure, the first display device is an image processing device, and a display screen connected with the first display device may display an image processed by the first display device. The target display device is also an image processing device, and a display screen connected to the target display device can display an image processed by the target display device.
An application scene of a plurality of display screens such as a first display device and a second display device is configured for the same vehicle, and if a user wants to view the display contents of the plurality of display devices at the same time, the display contents of the application program can be projected to another screen. Specifically, each display device may configure a cross-screen display function, and when the user triggers the cross-screen function, it may select to which target display device the display device is displayed in a cross-screen manner. After the user selects the corresponding target display device, cross-screen display request information containing the target display device identifier can be received.
S202, driving the first display device to execute the operation of writing the image frame to be displayed in a cross-screen mode into a preset hardware cache device based on the cross-screen display request information.
The image frame to be displayed across the screen is an image frame displayed by the first display device. Specifically, the image frame may be an image frame currently displayed on a display screen connected to the first display device, or may be any image in the first display device.
In this step, the receiving of the cross-screen display request information indicates that the first display device needs to write the image frame to be displayed in the preset hardware buffer device, and then the first display device may be driven to execute writing of the image frame to be displayed in the preset hardware buffer device.
S203, driving a second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen.
And the second display device identifies the corresponding display device for the target display device.
In the disclosure, after the second display device reads the image frame to be displayed across the screen from the preset hardware buffer device, the original display content of the preset area can be replaced by the image frame to be displayed across the screen, and the image frame to be displayed across the screen is displayed in the preset area of the display screen connected with the second display device. The preset area is an area in a preset display screen connected with the second display device, and specifically may be an upper left corner area or a lower right corner area of the display screen connected with the second display device.
In an embodiment, in order to avoid the splash screen caused by the read-write collision when displaying the image frames, a hardware buffer device is preset in the present disclosure to buffer at least two frames of image frames, one frame is the image frame to be displayed across the screen, which is already written, for the second display device to read, and the other frame is the image frame being written. And the image frames to be displayed in a cross-screen mode, read from the preset hardware cache device, of the second display device are the image frames which are completely written into the preset hardware cache device.
By adopting the method provided by the disclosure, each application program in the display device is not required to have mutually compatible information sharing protocols and APIs, but image frames needing to be displayed in a cross-screen manner are directly cached by using the preset hardware caching device, and the better compatibility of the display device is achieved by directly supporting the cross-screen display on a hardware level, so that the problem that the cross-screen display cannot be realized without supporting the virtualized scheduling by the application program is solved.
In an embodiment, the driving the first display device to perform the operation of writing the image frame to be displayed across the screen into the preset hardware buffer device based on the request information for displaying across the screen may specifically include step A1:
and A1, driving the first display device to execute the operation of writing the image frames to be displayed in a cross-screen manner into a preset hardware cache device according to a preset animation effect based on the cross-screen display request information.
In the present disclosure, the preset animation effect may include a display content gradually increasing effect, a display content moving effect, and the like.
Wherein, the content gradually increasing effect is specifically expressed as: and in the process of displaying the image frames to be displayed on the screen connected with the target display device, gradually increasing the transverse and longitudinal sizes of the image frames to be displayed on the screen so as to realize the effect of dynamically expanding the image frames to be displayed on the screen.
The display content moving effect is specifically expressed as follows: and in the process of displaying the image frame to be displayed on the screen connected with the target display device, gradually increasing the position coordinates of the image frame to be displayed on the screen so as to realize the effect that the image frame to be displayed on the screen slides from the upper left corner to the lower left corner.
In this embodiment, the driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen may specifically include step B1:
and B1, driving a second display device to execute the operation of reading the image frames to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frames to be displayed across the screen according to the preset animation effect.
If the first display device executes writing of the image frames to be displayed across the screen into the preset hardware buffer device according to the preset animation effect, the second display device can read the image frames to be displayed across the screen and the preset animation effect from the preset hardware buffer device, and display the image frames to be displayed across the screen in a display screen connected with the second display device according to the preset animation effect.
For example, the first display device may write the read-write address of the preset animation effect into the preset hardware cache device, and the second display device reads the read-write address of the preset animation effect, and may obtain the preset animation effect according to the read-write address, so that the image frame to be displayed across the screen is displayed in the display screen connected to the second display device according to the preset animation effect. Fig. 3 shows a schematic image display provided by the present disclosure, and as shown in fig. 3, the preset animation effect is a display content movement effect. The inserted display content is an image frame to be displayed across the screen, the original display content is an original image displayed at a preset area of a display screen connected with the second display device, and X and Y are respectively the horizontal coordinates and the vertical coordinates of the inserted display content.
Fig. 4 shows another image display schematic provided by the present disclosure, and as shown in fig. 4, the preset animation effect is a content gradual increase effect. The inserted display content is an image frame to be displayed across the screen, the original display content is an original image displayed at a preset area of a display screen connected with the second display device, and H and V are values of the horizontal and vertical sizes of the inserted display content respectively.
In an implementation manner, the cross-screen display request information comprises a plurality of target display device identifiers, and each target display device identifier corresponds to one second display device; the driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen, which specifically includes the step C1:
and step C1, driving each second display device to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer device, so that each second display device displays the image frames to be displayed across the screen.
In the disclosure, during cross-screen display, a broadcasting effect that a plurality of second display devices simultaneously display one content can be achieved by simultaneously reading data cached by one hardware by the plurality of second display devices.
By adopting the cross-screen display method provided by the disclosure, a cross-screen interaction interface is not required to be supported by related cross-screen display application, and better compatibility can be achieved through direct support on a hardware level. And the display content can achieve a certain animation effect through address change in the cache, so that a user obtains better interactive experience. Compared with the existing software compatible mode, the method reduces the intermediate process of image transmission when the cross-screen display is realized, and further reduces the time delay when the cross-screen display is realized. In addition, under special conditions such as virtual machine hanging, the virtual machine display content which works normally can be directly displayed in other screens by bypassing the virtualization platform, and the system redundancy is improved. And the preset hardware cache device can be set as an external storage device under the condition of time delay permission, so that the hardware cost is further reduced.
Based on the same inventive concept, according to the method for displaying a screen in a cross-screen manner provided in the above embodiment of the present disclosure, correspondingly, another embodiment of the present disclosure further provides a system for displaying a screen in a cross-screen manner, a schematic structural diagram of which is shown in fig. 5, which specifically includes:
the first display device 501 is configured to send cross-screen display request information to the display driving device after receiving a cross-screen display trigger operation; the cross-screen display request information comprises a target display device identifier;
the display driving device 502 is configured to receive the cross-screen display request information, and based on the cross-screen display request information, drive the first display device to perform an operation of writing an image frame to be displayed in a cross-screen manner into a preset hardware cache device; driving a second display device to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer device; the image frame to be displayed across the screen is an image frame displayed by the first display device; the second display device identifies a corresponding display device for the target display device;
the second display device 503 is configured to display the image frame to be displayed across the screen.
By adopting the cross-screen display system disclosed by the invention, each application program in the display equipment does not need to have mutually compatible information sharing protocols and APIs, but image frames needing to be displayed in a cross-screen manner are directly cached by using the preset hardware caching equipment, and the cross-screen display is directly supported on a hardware level, so that better display equipment compatibility is achieved, and the problem that the cross-screen display cannot be realized without supporting virtualized scheduling by the application program is solved.
In an implementation manner, the display driving device 502 is specifically configured to, based on the cross-screen display request information, drive the first display device to perform an operation of writing, according to a preset animation effect, an image frame to be displayed across the screen into a preset hardware cache device; and driving a second display device to execute the operation of reading the image frames to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frames to be displayed across the screen according to the preset animation effect.
In an implementation manner, the cross-screen display request information further comprises a target display position of the second display device;
the display driving device 502 is specifically configured to drive a second display device to perform an operation of reading the image frame to be displayed across the screen from the preset hardware cache device; and driving the second display equipment to execute the operation of replacing the original display content of the target display position by the image frame to be displayed across the screen.
In an embodiment, the image frame to be displayed across the screen read by the second display device from the preset hardware buffer device is an image frame that has been completely written into the preset hardware buffer device.
In an implementation manner, the cross-screen display request information comprises a plurality of target display device identifiers, and each target display device identifier corresponds to one second display device;
the display driving device 502 is specifically configured to drive each of the second display devices to perform an operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, so that each of the second display devices displays the image frame to be displayed across the screen.
For example, fig. 6 is a schematic diagram of a cross-screen display system provided by an embodiment of the present disclosure, as shown in fig. 6, in which the "complete machine system" in fig. 6 is a vehicle system, the "hardware cache" is a preset hardware cache device, the "display screen one" is a display screen connected to the first display device, the display content in the "display screen one" is an image frame to be displayed across the screen, and the preset animation in the "display screen one" is set as a preset animation effect. The second display screen is a display screen connected with the second display device, the original display content in the second display screen is an image originally displayed in a preset area of the second display screen, and the inserting display content represents that an image frame to be displayed in a cross-screen mode is inserted at the original display content position in the second display screen, and the original display content in the second display screen is replaced. The display driving unit in fig. 6 is a device in the complete system for driving the first display device to write the display content into the hardware buffer and for driving the second display device to read the image in the hardware buffer. The cross-screen display method provided by the embodiment of the disclosure can be applied to a display driving unit.
As shown in fig. 6, when a user needs to project the display content of the application program in the first display screen to the second display screen, a "cross-screen operation triggering" function may be triggered, and then the display driving unit may drive the first display device connected to the first display screen to write the image frame to be displayed (the content to be displayed) in the hardware cache, and after the image frame to be displayed is completely written in the hardware cache, the display driving unit may drive the second display device connected to the second display screen to read the image frame to be displayed as the inserted display content, so as to replace the original display content in the second display screen.
And after the user triggers the cross-screen operation, the first display device can take the current display image frame in the first display screen as the image frame to be cross-screen display, and write the image frame to be cross-screen display into the hardware cache according to the preset animation effect. After receiving the request of the display driving unit, the second display device can replace the display content in the preset area in the second display screen with the image frame to be displayed across the screen according to the preset animation effect. The preset animation effect may be a moving effect of the display content shown in fig. 3, or a gradually increasing effect of the display content shown in fig. 4, which is not described herein.
At least two frames of images can be stored in the hardware cache, one frame is a frame of the image to be displayed to be cross-screen read by the second display device, which is already written, and the other frame is a frame of the image in writing, and can be used for avoiding screen display caused by read-write conflict when displaying a picture.
In the disclosure, during cross-screen display, a broadcasting effect that a plurality of second display devices simultaneously display one content can be achieved by simultaneously reading data cached by one hardware by the plurality of second display devices.
By adopting the cross-screen display system provided by the disclosure, a cross-screen interaction interface is not required to be supported by related cross-screen display application, and better compatibility can be achieved through direct support on a hardware level. And the display content can achieve a certain animation effect through address change in the cache, so that a user obtains better interactive experience. Compared with the existing software compatible mode, the method reduces the intermediate process of image transmission when the cross-screen display is realized, and further reduces the time delay when the cross-screen display is realized. In addition, under special conditions such as virtual machine hanging, the virtual machine display content which works normally can be directly displayed in other screens by bypassing the virtualization platform, and the system redundancy is improved. And the preset hardware cache device can be set as an external storage device under the condition of time delay permission, so that the hardware cost is further reduced.
In a possible implementation manner, the first display device, the second display device and the display driving device in the cross-screen display system provided by the disclosure may be devices of different hardware domains in the multi-core heterogeneous chip. Specifically, the first display device is a device in a first hardware domain of the multi-core heterogeneous chip, the second display device is a device in a second hardware domain on the multi-core heterogeneous chip, and the display driving device is a device in a third hardware domain of the multi-core heterogeneous chip. The multi-core heterogeneous chip comprises a plurality of processor cores with different architectures, wherein each processor core and hardware resources connected with the processor core form a hardware domain, and physical isolation exists among all the hardware domains in the multi-core heterogeneous chip; the information transmission between the first display device and the second display device and the display driving device is completed through an inter-core communication program between the hardware domains of the multi-core heterogeneous chip.
Based on this, the process of implementing information cross-screen display by the first display device, and the display driving device may include:
the first display device sends the cross-screen display request information to the display driving device through an inter-core communication program of the multi-core heterogeneous chip after receiving the cross-screen display triggering operation;
The display driving device receives the cross-screen display request information through the inter-core communication program, sends driving information to the first display device and the second display device through the inter-core communication program based on the cross-screen display request information, and drives the first display device to execute the operation of writing the image frames to be displayed in a cross-screen mode into the preset hardware cache device; driving the second display device to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer device; the image frame to be displayed across the screen is an image frame displayed by the first display device; the second display device is a display device corresponding to the target display device identifier;
and the second display equipment is used for displaying the image frames to be displayed across the screen.
In the disclosure, in order to ensure the security of the hardware device, the preset hardware cache device generally selects the cache device in the hardware domain with the highest security level in the first hardware domain, the second hardware domain and the third hardware domain. For example, if the security level of the first hardware domain is highest in the first hardware domain, the second hardware domain and the third hardware domain of the multi-core heterogeneous chip, the preset hardware cache device is a cache device in the first hardware domain.
Based on the same inventive concept, according to the method for displaying a screen in a cross-screen manner provided in the above embodiment of the present disclosure, correspondingly, another embodiment of the present disclosure further provides a cross-screen display device, a schematic structural diagram of which is shown in fig. 7, where the device includes:
an information receiving module 701, configured to receive cross-screen display request information sent by a first display device; the cross-screen display request information comprises a target display device identifier;
the first driving module 702 is configured to drive, based on the cross-screen display request information, the first display device to perform an operation of writing an image frame to be displayed in a cross-screen manner into a preset hardware cache device; the image frame to be displayed across the screen is an image frame displayed by the first display device;
a second driving module 703, configured to drive a second display device to perform an operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen; and the second display device identifies the corresponding display device for the target display device.
By adopting the cross-screen display device disclosed by the invention, each application program in the display equipment is not required to have mutually compatible information sharing protocols and APIs, but image frames needing to be displayed in a cross-screen manner are directly cached by using the preset hardware cache equipment, and the cross-screen display is directly supported on a hardware level, so that better compatibility of the display equipment is achieved, and the problem that the cross-screen display cannot be realized without supporting virtualized scheduling by the application program is solved.
In an implementation manner, the first driving module 702 is specifically configured to, based on the cross-screen display request information, drive the first display device to perform an operation of writing, according to a preset animation effect, an image frame to be displayed across a screen into a preset hardware cache device;
the second driving module 703 is specifically configured to drive a second display device to perform an operation of reading the image frame to be displayed across the screen and the preset animation effect from the preset hardware cache device, so that the second display device displays the image frame to be displayed across the screen according to the preset animation effect.
In an implementation manner, the cross-screen display request information further comprises a target display position of the second display device;
the second driving module 703 is specifically configured to drive a second display device to perform an operation of reading the image frame to be displayed across the screen from the preset hardware cache device; and driving the second display equipment to execute the operation of replacing the original display content of the target display position by the image frame to be displayed across the screen.
In an embodiment, the image frame to be displayed across the screen read by the second display device from the preset hardware buffer device is an image frame that has been completely written into the preset hardware buffer device.
In an implementation manner, the cross-screen display request information comprises a plurality of target display device identifiers, and each target display device identifier corresponds to one second display device;
the second driving module 703 is specifically configured to drive each of the second display devices to perform an operation of reading the image frame to be displayed across the screen from the preset hardware cache device, so that each of the second display devices displays the image frame to be displayed across the screen.
By adopting the cross-screen display device provided by the disclosure, a cross-screen interaction interface is not required to be supported by related cross-screen display application, and better compatibility can be achieved through direct support on a hardware level. And the display content can achieve a certain animation effect through address change in the cache, so that a user obtains better interactive experience. Compared with the existing software compatible mode, the method reduces the intermediate process of image transmission when the cross-screen display is realized, and further reduces the time delay when the cross-screen display is realized. In addition, under special conditions such as virtual machine hanging, the virtual machine display content which works normally can be directly displayed in other screens by bypassing the virtualization platform, and the system redundancy is improved. And the preset hardware cache device can be set as an external storage device under the condition of time delay permission, so that the hardware cost is further reduced.
According to embodiments of the present disclosure, the present disclosure also provides an electronic device and a readable storage medium.
Fig. 8 illustrates a schematic block diagram of an example electronic device 800 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 8, the apparatus 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.
Various components in device 800 are connected to I/O interface 805, including: an input unit 806 such as a keyboard, mouse, etc.; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, or the like. The communication unit 809 allows the device 800 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
The computing unit 801 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as the cross-screen display method. For example, in some embodiments, the cross-screen display method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 800 via ROM 802 and/or communication unit 809. When a computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the cross-screen display method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the cross-screen display method in any other suitable manner (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems-on-a-chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In the description of the present disclosure, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the disclosure, and it is intended to cover the scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.
Claims (10)
1. A method of cross-screen display, the method comprising:
receiving cross-screen display request information sent by first display equipment; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
based on the cross-screen display request information, driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device; the image frame to be displayed across the screen is an image frame displayed by the first display device;
driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen; and the second display device identifies the corresponding display device for the target display device.
2. The method of claim 1, wherein the driving the first display device to perform writing of the image frame to be displayed across the screen to a preset hardware cache device based on the request information for display across the screen comprises:
Based on the cross-screen display request information, driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device according to a preset animation effect;
the driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen, including:
and driving the second display device to execute the operation of reading the image frames to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frames to be displayed across the screen according to the preset animation effect.
3. The method of claim 1, wherein the image frames to be displayed across the screen read by the second display device from the preset hardware cache device are image frames that have been completely written to the preset hardware cache device.
4. The method of claim 1, wherein the cross-screen display request information includes a plurality of target display device identifications, each of the target display device identifications corresponding to a second display device;
The driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen, so that the second display device displays the image frame to be displayed across the screen, including:
and driving each second display device to execute the operation of reading the image frames to be displayed across the screen from the preset hardware buffer device, so that each second display device displays the image frames to be displayed across the screen in a mode that the image frames to be displayed across the screen replace the original display content of the target display position of the second display device.
5. A cross-screen display system, the system comprising:
the first display device is used for sending the cross-screen display request information to the display driving device after receiving the cross-screen display triggering operation; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
the display driving device is used for receiving the cross-screen display request information and driving the first display device to execute the operation of writing the image frames to be cross-screen displayed into a preset hardware cache device based on the cross-screen display request information; and driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device, and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen; the image frame to be displayed across the screen is an image frame displayed by the first display device; the second display device identifies a corresponding display device for the target display device;
And the second display device is used for displaying the image frames to be displayed across the screen.
6. The system according to claim 5, wherein the display driving device is specifically configured to drive, based on the cross-screen display request information, the first display device to perform an operation of writing, according to a preset animation effect, an image frame to be displayed across a screen to a preset hardware buffer device; and driving the second display device to execute the operation of reading the image frame to be displayed across the screen and the preset animation effect from the preset hardware buffer device, so that the second display device displays the image frame to be displayed across the screen according to the preset animation effect.
7. The system of claim 5, wherein the first display device is a device in a first hardware domain of a multi-core heterogeneous chip, the second display device is a device in a second hardware domain on the multi-core heterogeneous chip, and the display driver device is a device in a third hardware domain of the multi-core heterogeneous chip; the multi-core heterogeneous chip comprises a plurality of processor cores with different architectures, wherein each processor core and hardware resources connected with the processor core form a hardware domain, and physical isolation exists among all the hardware domains in the multi-core heterogeneous chip; information transmission between the first display device and the second display device and the display driving device is completed through inter-core communication programs among the hardware domains of the multi-core heterogeneous chip.
8. A cross-screen display device, the device comprising:
the information receiving module is used for receiving cross-screen display request information sent by the first display equipment; the cross-screen display request information comprises a target display device identifier and a target display position of the second display device;
the first driving module is used for driving the first display device to execute the operation of writing the image frame to be displayed in a cross-screen mode into a preset hardware cache device based on the cross-screen display request information; the image frame to be displayed across the screen is an image frame displayed by the first display device;
the second driving module is used for driving the second display device to execute the operation of reading the image frame to be displayed across the screen from the preset hardware buffer device and driving the second display device to execute the operation of replacing the original display content of the target display position with the image frame to be displayed across the screen so as to enable the second display device to display the image frame to be displayed across the screen; and the second display device identifies the corresponding display device for the target display device.
9. An electronic device, comprising:
At least one processor; and
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-4.
10. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310001106.2A CN115826898B (en) | 2023-01-03 | 2023-01-03 | Cross-screen display method, system, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310001106.2A CN115826898B (en) | 2023-01-03 | 2023-01-03 | Cross-screen display method, system, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115826898A CN115826898A (en) | 2023-03-21 |
| CN115826898B true CN115826898B (en) | 2023-04-28 |
Family
ID=85519989
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310001106.2A Active CN115826898B (en) | 2023-01-03 | 2023-01-03 | Cross-screen display method, system, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115826898B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898506A (en) * | 2016-05-03 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and system for multi-screen playing of media files |
| CN109308174A (en) * | 2018-10-10 | 2019-02-05 | 烟台职业学院 | Across screen picture splicing control method |
| CN112799619A (en) * | 2021-01-07 | 2021-05-14 | 恩亿科(北京)数据科技有限公司 | Cross-screen creating method and system |
| WO2021227688A1 (en) * | 2020-05-15 | 2021-11-18 | 华为技术有限公司 | Screen extension method and apparatus, and terminal device and computer-readable storage medium |
| WO2022042769A2 (en) * | 2020-08-24 | 2022-03-03 | 荣耀终端有限公司 | Multi-screen interaction system and method, apparatus, and medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111709978A (en) * | 2020-05-06 | 2020-09-25 | 广东康云科技有限公司 | Cross-screen target tracking method, system, device and storage medium |
| CN114915810B (en) * | 2021-02-08 | 2023-06-27 | 聚好看科技股份有限公司 | Media resource pushing method and intelligent terminal |
| CN115080158B (en) * | 2021-03-12 | 2024-07-09 | Oppo广东移动通信有限公司 | Interface display method, device, terminal equipment and computer readable storage medium |
| CN115407951A (en) * | 2021-05-26 | 2022-11-29 | 华为云计算技术有限公司 | Screen projection method and screen projection device |
| CN114173183B (en) * | 2021-09-26 | 2023-01-24 | 荣耀终端有限公司 | Screen projection method and electronic equipment |
| CN115525453B (en) * | 2022-01-19 | 2023-08-04 | 荣耀终端有限公司 | Multi-screen collaborative interrupt processing method and electronic equipment |
-
2023
- 2023-01-03 CN CN202310001106.2A patent/CN115826898B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898506A (en) * | 2016-05-03 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and system for multi-screen playing of media files |
| CN109308174A (en) * | 2018-10-10 | 2019-02-05 | 烟台职业学院 | Across screen picture splicing control method |
| WO2021227688A1 (en) * | 2020-05-15 | 2021-11-18 | 华为技术有限公司 | Screen extension method and apparatus, and terminal device and computer-readable storage medium |
| WO2022042769A2 (en) * | 2020-08-24 | 2022-03-03 | 荣耀终端有限公司 | Multi-screen interaction system and method, apparatus, and medium |
| CN112799619A (en) * | 2021-01-07 | 2021-05-14 | 恩亿科(北京)数据科技有限公司 | Cross-screen creating method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115826898A (en) | 2023-03-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20170161865A1 (en) | Method and System to Virtualize Graphic Processing Services | |
| US20130055254A1 (en) | Methods and apparatuses for providing a virtual machine with dynamic assignment of a physical hardware resource | |
| JP5620506B2 (en) | Application image display method and apparatus | |
| JP2019512749A (en) | Application program processing method and terminal device | |
| US20220230271A1 (en) | Full screen processing in multi-application environments | |
| US20190325562A1 (en) | Window rendering method and terminal | |
| EP3671627A1 (en) | Image processing method and device | |
| CN113655975B (en) | Image display method, image display device, electronic apparatus, and medium | |
| CN113886019B (en) | Virtual machine creation method, device, system, medium and equipment | |
| CN113900754A (en) | Desktop sharing method and device, computer equipment and storage medium | |
| CN115904761B (en) | System on chip, vehicle and video processing unit virtualization method | |
| CN115309511B (en) | Xen-based data interaction method and device, storage medium and electronic equipment | |
| CN111209080A (en) | Transparent transmission method for graphic processor | |
| CN116360928A (en) | Optimization method and device of android container display system and electronic equipment | |
| CN114116227A (en) | Display method, device and equipment based on Wayland protocol without GPU support | |
| CN115826898B (en) | Cross-screen display method, system, device, equipment and storage medium | |
| CN115373618B (en) | Multi-screen display method and device, vehicle machine and storage medium | |
| EP4203487A1 (en) | Method and apparatus for processing multimedia resource | |
| CN114090118A (en) | Method, device and equipment for starting small program and storage medium | |
| CN112100409A (en) | Multimedia information display method and device, storage medium and terminal | |
| US20180300160A1 (en) | Host and Component Relationship between Applications | |
| WO2019079940A1 (en) | Graphics processing method, and related apparatus and device | |
| CN116977468A (en) | Image frame drawing processing method, device, equipment and medium | |
| CN117274028A (en) | Data processing method, data processing circuit, electronic device, and storage medium | |
| CN115344352A (en) | Virtualization system operation method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |