CN116931767A - Screen linkage method and device, electronic equipment and storage medium - Google Patents

Abstract

The present disclosure provides a screen linkage method and apparatus, an electronic device, a readable medium, and a computer program product. The method is applied to first equipment, a screen of the first equipment is provided with at least two display areas, at least two display areas are provided with different display contents, and the first equipment is pre-bound with second equipment with linked screens, and the method comprises the following steps: receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area; according to the operation type and the display area, a linkage operation instruction is sent; and performing a display content of the display area and a screen linkage operation of the second device. The display linkage control of the multiple devices is realized, the screen utilization rate is improved, and the user operation convenience and experience are improved.

Description

Screen linkage method and device, electronic equipment and storage medium

Technical Field

The disclosure relates to the technical field of display, and in particular relates to a screen linkage method and device, electronic equipment and a storage medium.

Background

With the development of intelligent devices, the use requirements of users on the intelligent devices are also continuously improved. Since the number of simultaneous tasks on the same device depends on the hardware capabilities of the device, the user may use more display devices when the user needs to perform multiple tasks simultaneously. However, at present, a one-to-one screen projection or equal proportion mirror image mode is mostly adopted for realizing multi-screen linkage interaction between intelligent devices, the application scene is single, and the adaptation degree to complex scenes with various display contents is low.

In addition, at present, the operation of a user is complicated in the process of multi-screen interaction, the real-time performance and the independence of linkage effects among multiple screens are not high, and the utilization rate of a display area on a screen is low.

Disclosure of Invention

In order to overcome the defects of the prior art, the present disclosure provides a screen linkage method, a screen linkage device, an electronic device, a storage medium and a computer program product, which can realize screen linkage between a plurality of terminal devices, improve the screen utilization rate, and improve the user operation convenience and experience.

According to a first aspect of the present disclosure, there is provided a screen linkage method, wherein the method is applied to a first device, a screen of the first device has at least two display areas, the at least two display areas have different display contents, and the first device is pre-bound to a second device of the screen linkage, the method comprising: receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area; according to the operation type and the display area, a linkage operation instruction is sent; and performing a display content of the display area and a screen linkage operation of the second device.

According to the embodiment, the first device can respond to the screen operation instruction to execute the display content of the display area and the screen linkage operation of the pre-bound second device, so that the real-time linkage of the display content of the multiple devices is realized, the multi-device linkage is realized through one-time operation, and the operation convenience and the experience of a user are improved.

In some embodiments, when the screen operation instruction is a sharing instruction, performing the screen linkage operation of the display content of the display area and the second device includes: determining a first display area; sharing the display content of the first display area to second equipment, wherein the second equipment is used for displaying the display content shared by the first display area; and removing the first display area from the first device.

In some embodiments, when the screen operation instruction is an exchange instruction, performing a screen linkage operation of the display content of the display area and the second device includes: determining a second display area; and exchanging display contents of the second display area with current display contents of the second device.

According to the embodiment, the contents displayed on the first device and the second device can be displayed in an exchanging mode, and the user can realize linkage control of a plurality of devices only by one-time operation, so that the operation complexity of the user is reduced.

In some embodiments, when the screen operation instruction is an end instruction, performing a screen linkage operation of the display content of the display area and the second device includes: creating a third display area, and displaying the current display content of the second device on the third display area; and sending a control instruction to the second device, wherein the control instruction is used for controlling the second device to stop displaying the current display content and returning to the main interface.

According to the embodiment, when the user needs to stop displaying the shared content on the second device, a new display area can be created on the first device for displaying the content at the same time, and the display on the second device is ended, so that the smoothness of content display among multiple devices is realized, and switching is performed among the devices under the condition that the display state of the content is not interrupted.

In some embodiments, when the screen operation instruction is an end instruction, performing a screen linkage operation of the display content of the display area and the second device includes: receiving an ending request, wherein the ending request is used for notifying the first equipment to display the current display content of the second equipment; and creating a third display area, and displaying the current display content of the second device on the third display area.

According to the embodiment, the second device can actively end the display and inform the first device to display, so that the adaptation width of user operation is enhanced, and the operation convenience is improved.

In some embodiments, the first device pre-binds with the second device by obtaining identification information of the second device and according to the identification information.

According to the embodiment, the first device can bind with the second device by acquiring the identification information of the second device, and a complex communication link or a third party device such as a server is not needed.

In some embodiments, the method further comprises: and dynamically adjusting the display size of the residual display area on the first device according to a preset rule.

According to the embodiment, the display content quantity on the device is changed due to real-time linkage among the devices, and the screen utilization rate can be enhanced to the greatest extent by dynamically adjusting the sizes of the display areas on the device, so that a user is ensured to have a good watching effect.

According to a second aspect of the present disclosure, there is provided a screen linkage method applied to a second device, the screen of the second device having at least one display area, the second device pre-binding a first device of the screen linkage, the method comprising: receiving a linkage operation instruction; and executing screen linkage operation of display contents of at least one display area of the second device and the display area of the first device according to the linkage operation instruction.

According to a third aspect of the present disclosure, there is provided a screen linkage arrangement arranged at a first device, the screen of the first device having at least two display areas, the at least two display areas having different display content, the first device pre-binding a second device of the screen linkage, the arrangement comprising: the receiving module is used for receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area; the sending module is used for sending linkage operation instructions according to the operation type and the display area; and the linkage operation module is used for executing linkage operation of display content of the display area and a screen of the second equipment according to the operation type and the display area.

According to a fourth aspect of the present disclosure, there is provided a screen linkage arrangement arranged at a second device, the screen of the second device having at least one display area, the second device pre-binding the first device with the screen linked, the arrangement comprising: the receiving module is used for receiving the linkage operation instruction; and the linkage operation module is used for executing screen linkage operation of display contents of at least one display area of the second equipment and the display area of the first equipment according to the linkage operation instruction.

According to a fifth aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first or second aspect described above.

According to a sixth aspect of the present disclosure there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of the foregoing first or second aspect.

According to a seventh aspect of the present disclosure there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of the first or second aspect as described above.

According to an eighth aspect of the present disclosure, there is provided a vehicle including: a screen; at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first or second aspect described above.

According to the screen linkage method, the device, the electronic equipment, the storage medium and the computer program product, the first equipment can respond to the screen operation instruction, display content of the display area and screen linkage operation of the pre-bound second equipment are executed, real-time linkage of display content of multiple equipment is achieved, multi-equipment linkage is achieved through one-time operation, multi-screen utilization rate and display smoothness of a complex display scene are improved, operation complexity of a user is reduced, and operation convenience and experience of the user are improved.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the application or to delineate the scope of the application. Other features of the present application will become apparent from the description that follows.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a schematic flow chart of a screen linkage method according to an embodiment of the disclosure;

fig. 2 is a flowchart of a screen linkage method according to another embodiment of the disclosure;

FIG. 3 is a schematic diagram of an interface when a screen operation command is a sharing command according to an embodiment of the disclosure;

FIG. 4 is a flowchart of a screen linkage method according to another embodiment of the present disclosure;

FIG. 5 is a schematic diagram of an interface when the screen operation instruction is an exchange instruction according to an embodiment of the disclosure;

FIG. 6 is a flowchart of a screen linkage method according to another embodiment of the present disclosure;

FIG. 7 is a schematic diagram of an interface when a screen operation command is an end command according to an embodiment of the present disclosure;

FIG. 8 is a flowchart of a screen linkage method according to another embodiment of the present disclosure;

FIG. 9 is a flowchart of a screen linkage method according to another embodiment of the present disclosure;

fig. 10 is a flowchart of a screen linkage method according to an embodiment of the disclosure;

FIG. 11 is a schematic diagram of a screen linkage provided in an embodiment of the present disclosure;

FIG. 12 is a schematic diagram of a screen linkage provided by the disclosed embodiments;

fig. 13 is a schematic block diagram of an example electronic device 1100 provided by an embodiment of the disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

The screen linkage method, apparatus, electronic device, and storage medium of the embodiments of the present disclosure are described below with reference to the accompanying drawings.

As the number of intelligent devices owned by users increases, and the resolution of screens increases, technologies such as screen projection technology and remote control are mature. However, in the related art, the screen linkage interaction between the cross-terminal devices is mostly dependent on the traditional screen projection scheme, for example, based on one-to-one projection and equal-proportion mirroring, or single remote control, which is difficult to meet the user requirements for more complex application scenes. For example, for video playing scenes, such as sports events or game videos, which need to be synchronously played at multiple angles, the requirement on hardware capability is high when the video playing scenes are displayed and played on the same device, and the user-friendly multi-screen linkage control effect is not better met temporarily. In addition, for different types of display contents, the display contents are difficult to realize in a multi-screen linkage scene through simple user operation, and the user operation is complex and the linkage effect is poor.

The utility model provides a screen linkage interaction scheme between many devices can realize the different content that show on the same equipment through the simple operation of user and other equipment and realize coordinated control to improve the smoothness nature of showing content coordinated control between many devices, improve the screen utilization ratio, reduce the CPU occupancy rate of single equipment, promote user's operation convenience and experience degree, break through the ecological ability between the terminal equipment, make full use of the ability of many screens, thereby reach better display effect.

Fig. 1 is a flowchart of a screen linkage method according to an embodiment of the disclosure.

As shown in fig. 1, the method is applied to a first device, a screen of the first device has at least two display areas, the at least two display areas have different display contents, and the first device is pre-bound with a second device with which the screen is linked, and the method comprises the following steps.

Step 101, receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area.

In one embodiment, the first device may receive a screen operation instruction input by a user, where the screen operation instruction may be any one of a sharing instruction, an exchange instruction, and an end instruction. It should be appreciated that a first device may be pre-tied to at least one second device and perform subsequent linkage operations.

For example, the user may operate any display area (for example, the first display area) displayed on the first device, when the user clicks a video that is being played in a certain display area, a share hover button pops up on the display area, and the user clicks the hover button, so that the first device receives a screen operation instruction, where the operation type is a sharing operation, and the display area is the first display area.

For another example, the user may click the general control button outside the video display area, and may select a display area to be operated, a corresponding operation type, or a corresponding bound device, thereby performing a corresponding operation. For example, a user may select to share a video displayed in a first display area to one of a plurality of bundled second devices to enable the video to be displayed on the second device.

In one embodiment, the content displayed by the plurality of display areas of the first device may be any content capable of being displayed on a screen of the terminal device, including, but not limited to, documents, web pages, application interfaces, games, chat interfaces, video call interfaces, and the like. For example, different shooting angle videos of the same video source, or entirely different video sources, or entirely different kinds of display contents may be displayed on the plurality of display areas. For completely different video sources, the audio output may be selected by the user, or the audio of the video with the highest priority may be output according to the video priority, for example, the priority of the video with the largest display proportion is the highest, and when the display proportions are the same, the priority of the video played first is the highest.

It should be understood that the user operation is not limited to a point touch (e.g., a single click, a double click, a long click, etc.), a drag (e.g., drag the content of a certain display area to a certain area), a multi-finger control (e.g., three fingers simultaneously clicking the content of a certain display area), a gesture control (e.g., a gesture triggering operation by a user through a space grip, etc.), or an iris recognition control (e.g., a point where the user aims at the terminal screen is recognized by a camera to trigger a corresponding operation).

Step 102, sending a linkage operation instruction according to the operation type and the display area.

In one embodiment, the first device will respond to the screen operation instruction and send a linkage operation instruction to the second device pre-bound with the first device, and notify the second device pre-bound with the second device that the screen linkage operation is to be performed.

It should be noted that the present disclosure enables a two-channel communication mode when screen coordinated control is performed. The first channel is a control channel and is established through binding and used for transmitting signaling, and the first equipment sends linkage operation instructions to the second equipment through the control channel; the second channel is a data channel for transmitting big data, and when information is shared among a plurality of devices in a coordinated control manner, 60 images are transmitted for transmission of a large data packet, such as a video stream, according to 1 second, and the size of each image is about hundreds of kb, so that the large data can be shared and transmitted through the data channel. Therefore, the method and the device adopt different channels for transmission aiming at data with different sizes, so that the transmission efficiency is effectively improved, and the resource waste is reduced.

And step 103, performing linkage operation of display contents of the display area and a screen of the second device.

In one embodiment, after receiving the linkage operation instruction sent by the first device, the second device may perform screen linkage operation with the first device. For example, when the screen operation instruction received by the first device is a sharing instruction, the second device receives the operation type and the display area indicated by the first device, for example, shares the display content of the first display area to the second device for display, and then the second device can display the content on the first display area of the first device, so as to realize linkage control.

In summary, according to this embodiment, the first device may respond to the screen operation instruction, perform the screen linkage operation of the display content of the display area and the pre-bound second device, and may realize real-time linkage of the display content of the multiple devices by controlling one device, so as to realize multi-device linkage by one operation, thereby improving the operation convenience of the user, better realizing the operation experience of the user on the multiple terminal devices, and improving the video playing and the picture display effect. Meanwhile, the peripheral screen equipment is fully utilized, physical boundaries of a plurality of terminal equipment are opened, seamless migration and circulation of videos are realized, ecology of the equipment is better expanded, and smoother equipment switching experience is provided for users.

Fig. 2 is a flowchart of a screen linkage method according to another embodiment of the disclosure. As shown in fig. 2, the method includes the following steps.

In step 201, a screen operation instruction is received, where the screen operation instruction includes an operation type and a display area.

In one embodiment, the screen operation instruction is a sharing instruction, that is, the operation type is a sharing operation.

Step 202, according to the operation type and the display area, a linkage operation instruction is sent.

In one embodiment, the first device sends a linkage operation instruction to the second device, and notifies the second device that the sharing operation is to be performed.

In step 203, a first display area is determined.

In one embodiment, the first device determines the first display area according to the received screen operation instruction, so that the first device sends the content displayed on the first display area to the second device, and the second device is used for displaying the display content shared by the first display area. For example, as shown in fig. 3, the first device (device 1) has three display areas, and when the user clicks the share hover button on the display area in the upper right corner, the area is determined to be the first display area.

In step 204, the display content of the first display area is shared to a second device, where the second device is configured to display the display content shared by the first display area.

In one embodiment, the first device shares content displayed on the first display area to the second device. For example, as shown in fig. 3, content (e.g., video) displayed on a display area in the upper right corner on the first device (device 1) is projected onto the second device (device 2) for display.

In fig. 3, taking two second devices (device 2 and device 3) as an example, the above procedure is repeated, and the display area in the lower right corner of the first device may be determined as a first display area, and the content displayed in the area may be projected to device 3 for display.

As an alternative embodiment, when only one second device (device 2) can perform the linkage operation, the user may share the content displayed in the lower right corner of the first device to the device 2, and at this time, the device 2 may simultaneously display the content displayed in the two display areas on the right side of the first device in a split screen mode.

Preferably, taking the example that the first device shares the video to the second device, two display areas (for example, area 1 and area 2) are currently displayed on the first device, and different videos are played on each display area, and each video has a progress bar for adjusting the playing progress of the video itself. After the first device shares the video 1 played in the area 1 to the second device, the first device continues to play the video 2 displayed in the area 2, and the first device and the second device respectively generate a second progress bar for the videos played on the two devices according to the current videos respectively, wherein the second progress bar is used for controlling the progress of the videos played on the two devices in a linkage mode. In other words, after the sharing operation, the video 2 is played on the first device, the video 2 has a first progress bar capable of adjusting the progress of the video 2 and the progress of the video 1 on the second device in a linkage manner, when the user adjusts the second progress bar, the videos played on the first device and the second device can be linked in a synchronous manner, and similarly, the video 1 is played on the second device, the video 1 has a first progress bar capable of adjusting the progress of the video 1 and the progress of the video 2 on the first device in a linkage manner, and when the user adjusts the second progress bar, the videos played on the first device and the second device can be linked in a synchronous manner. The second progress bar may be reserved or removed when the user ends the ganged operation, for example, when a video displayed on the second device is pulled back onto the first device.

Step 205, the first display area is removed from the first device.

In one embodiment, the first display area is removed from the screen of the first device after the first device shares the content displayed on the first display area to the second device for display. Taking fig. 3 as an example, the content displayed on the two right display areas of the first device is shared with the two second devices (device 2 and device 3), respectively, and at this time, the first device removes the two right display areas, and only one left display area remains.

In summary, according to this embodiment, the first device may project any split screen content displayed by itself to the second device for display, cancel the display area of the content by itself, reduce the CPU occupancy rate of the first device in real time, promote the multi-screen usage rate in the complex display scene, and simultaneously implement split screen linkage control, thereby opening the ecological capability between the terminal devices, and fully utilizing the multi-screen capability, so as to achieve a better display effect.

Fig. 4 is a flowchart of a screen linkage method according to another embodiment of the disclosure. As shown in fig. 4, the method includes the following steps.

Step 401, receiving a screen operation instruction, where the screen operation instruction includes an operation type and a display area.

In one embodiment, the screen operation instruction is a swap instruction, i.e., the operation type is a swap operation.

And step 402, transmitting a linkage operation instruction according to the operation type and the display area.

In one embodiment, the first device sends a coordinated operation instruction to the second device informing the second device that a swap operation is to be performed.

Step 403, determining a second display area.

In one embodiment, the first device determines the second display area according to the received screen operation instruction, so that the first device performs exchange display on the content displayed on the second display area and the content currently displayed by the second device. For example, as shown in fig. 5, the first device (device 1) has a display area, and when the user clicks at any one of the display areas, the hover buttons "switch 2" and "switch 3" are displayed, and clicking any one of the hover buttons displayed in that area can determine that area is the second display area.

And step 404, exchanging display contents of the second display area with current display contents of the second device.

As shown in fig. 5, when the user clicks the hover button "swap device 2" on device 1, the content being displayed on device 1 (e.g., video 1 being played) may be projected onto device 2, while the content being displayed on device 2 (e.g., video 2 being played) is returned to device 1 for display.

In an alternative embodiment, when multiple regions are currently displayed on device 2, after the user clicks "switch 2" on the first device, further operational controls are displayed on device 1 for the user to secondarily select which region on switch 2 displays content. Alternatively, after the user clicks "exchange device 2" on the first device, the user may directly operate device 2, for example, click on the display area desired to be exchanged on device 2, and the corresponding display content is projected onto device 1 for display, without requiring the user to make a secondary selection on device 1.

In summary, according to the embodiment, the content displayed on the first device and the second device may be displayed in an exchanged manner, so that the user may implement the coordinated control of the multiple devices only by one operation, thereby reducing the operation complexity of the user. Meanwhile, by the coordinated control exchanging only the content displayed on the different devices, and not intending to display the content (for example, exchanging the display does not interrupt or reset the video being played), the display smoothness and user experience of the coordinated control are improved.

Fig. 6 is a flowchart of a screen linkage method according to another embodiment of the disclosure. As shown in fig. 6, the method includes the following steps.

In step 601, a screen operation instruction is received, where the screen operation instruction includes an operation type and a display area.

In one embodiment, the screen operation instruction is an end instruction, i.e., the operation type is an end operation.

Step 602, according to the operation type and the display area, a linkage operation instruction is sent.

In one embodiment, the first device sends a linkage operation instruction to the second device informing the second device that an end operation is to be performed.

Step 603, creating a third display area, and displaying the current display content of the second device on the third display area.

In one embodiment, when the user wants to end the coordinated control, i.e., pull the content shared to the second device back to the first device for display, the first device may create a new display area for displaying the content currently displayed on the second device in response to receiving the end instruction. For example, as shown in fig. 7, the first device (device 1) has a display area, and when the user clicks at any one of the display areas, the hover buttons "pull back device 2" and "pull back device 3" are displayed, and the hover button displayed at any one of the areas is clicked, that is, a new display area is created for the content displayed on the pulled back device.

In an alternative embodiment, when the user wants to end the coordinated control of all the second devices, that is, pull back the content shared to all the second devices to the first device for display at one time, the user clicks any one of the display areas on the first device to display a hover button "end", and clicks the hover button, that is, creates a plurality of new display areas, where the number of newly created display areas is the same as the number of already bound second devices. For example, there are a plurality of second devices (device 2 and device 3) bound to device 1, and content displayed on device 2 and device 3 can be pulled back to device 1 for display at once, at which time device 1 will create two new display areas for displaying content displayed on device 2 and device 3.

And step 604, sending a control instruction to the second device, wherein the control instruction is used for controlling the second device to stop displaying the current display content and returning to the main interface.

In one embodiment, the content displayed on the second device is pulled back to the first device for display, and the second device will cease to display and return to the main interface. For example, video played on the second device is pulled back onto the first device to continue playing, and the second device will revert to the default interface or the main interface.

Step 605, receiving an end request, where the end request is used to notify the first device to display the current display content of the second device.

In an alternative embodiment, the operation may be performed by the second device when the user wants to end the coordinated control of the second device. The user may operate on the display area of the second device, for example, click any place on the display area of the second device, at which time an exit hover button is displayed on the second device, and when the user clicks the button, the second device will send an end request to the bound first device, where the end request is used to inform the first device to display the current display content of the second device.

Step 606, creating a third display area, and displaying the current display content of the second device on the third display area.

In an embodiment of the present disclosure, after the second device issues an end request to the first device, the first device creates a new display area in response to the end request to display content displayed on the second device.

In summary, according to the embodiment, when the user needs to stop displaying the shared content on the second device, a new display area may be created on the first device for displaying the content at the same time, so that smoothness of content display between multiple devices is achieved, and switching is performed between the devices without interrupting the display state of the content. In addition, the linkage control of multiple devices can be realized in multiple simple operation modes, and the operation of a user is simplified.

Fig. 8 is a flowchart of a screen linkage method according to another embodiment of the disclosure. Specifically, the first device and the second device may be bound before performing the coordinated control. As shown in fig. 8, the method includes:

step 801, obtaining identification information of the second device, and binding the second device according to the identification information.

It can be appreciated that, before the linkage interaction, in order to make the user perceivable, the unique identifier of the device can be exchanged at the same time for subsequent device discovery and management, and the first device can acquire the identifier information of the second device and complete binding with the second device according to the identifier information.

In an optional embodiment, the second device may obtain the mac address information of the second device, generate the two-dimensional code according to the mac address information, and perform two-dimensional code scanning and identification by the first device through calling the camera module, so as to complete binding with the second device.

In another alternative embodiment, the second device may generate a string of random numbers (e.g., a pin code) and complete the binding with the second device by entering the set of random numbers on the first device.

The binding mode of the device is not limited in the present disclosure, and the binding can be completed by using technologies such as NFC, UWB, infrared, wifi, and the like. It should be understood that the binding does not need to be repeated, and after the first device and the second device complete the first binding, the first device and the second device can directly enter the linkage control state before unbinding operation is performed, and even if power-off or shutdown occurs, the second device does not need to be bound again.

Step 802, receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area.

Step 803, according to the operation type and the display area, a linkage operation instruction is sent.

Step 804, performing a linkage operation of the display content of the display area and the screen of the second device.

The steps 802-804 may be performed with reference to the above embodiments, and are not described herein.

In summary, according to this embodiment, the first device may bind with the second device by acquiring the identification information of the second device, without requiring a complex communication link or a third party device such as a server.

Fig. 9 is a flowchart of a screen linkage method according to another embodiment of the disclosure. As shown in fig. 9, the method includes the following steps.

Step 901, receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area.

And step 902, transmitting a linkage operation instruction according to the operation type and the display area.

Step 903, performing a display content linkage operation of the display area and the screen of the second device.

The steps 901 to 903 may be performed with reference to the above embodiments, and are not described herein.

Step 904, dynamically adjusting the display size of the remaining display area on the first device according to a preset rule.

In this embodiment, the number of display areas on the first device and the second device will change in real time as the coordinated operation proceeds. In particular, when the sharing operation shown in fig. 2 and 3 is performed, the display area on the first device will decrease with the progress of the sharing linkage operation, and the display area on the second device may increase with the progress of the sharing linkage operation, whereas when the ending operation shown in fig. 6 and 7 is performed, the display area on the first device will increase with the progress of the sharing linkage operation, and the display area on the second device may decrease with the progress of the sharing linkage operation.

Therefore, when the number of the regions is changed, the sizes of the remaining display regions are adjusted in a linkage manner according to a preset algorithm. As an example, the preset rule may be calculated by a preset algorithm such that the display sizes of the plurality of display areas display the maximum ratio on the screen: when the number of the remaining display areas is one, the width and the height of the display areas are the same as those of the screen, namely full screen display is performed, when the number of the remaining display areas is more than or equal to two, split screen display is performed, specifically, when the number of the remaining display areas is two, the width of the two display areas is half of the width of the screen, the height is adaptively adjusted according to the crazy scale of the content displayed by the two display areas, when the number of the remaining display areas is three, the width of one area is 2/3 of the width of the screen, the width of the other two areas is 1/3 of the width of the screen, and when the number of the remaining display areas is four, the height and the width of each display area are half of the height and the width of the screen.

In summary, according to this embodiment, since the real-time linkage between a plurality of devices will cause the change of the number of display contents on the devices, the screen utilization rate can be enhanced to the greatest extent by dynamically adjusting the sizes of a plurality of display areas on the devices, and meanwhile, the user is ensured to have a good viewing effect.

Fig. 10 is a flowchart of a screen linkage method according to an embodiment of the disclosure. Corresponding to the screen linkage method executed on the first device side described above, the screen linkage method in this embodiment is applied to a second device whose screen has at least one display area, the second device prebounting the first device whose screen is linked, the method comprising the following steps.

Step 1001, a linkage operation instruction is received.

Step 1002, executing screen linkage operation of display contents of at least one display area of the second device and the display area of the first device according to the linkage operation instruction.

In this embodiment, the second device may receive a linkage operation instruction from the first device linked to the pre-binding screen, and perform a linkage operation with the first device in response to the linkage operation instruction. The second device may share and exchange the displayed content with the first device, and may also stop the linkage with the first device. Specific embodiments may be referred to the embodiments shown in fig. 1 to 9, and will not be described herein.

In summary, according to the embodiment of the present disclosure, the second device may perform the linkage operation with the first device in response to the linkage operation instruction from the pre-bound first device, so as to implement real-time linkage of the display content of the multiple devices, so as to implement multi-device linkage with one operation, improve the operation convenience and experience of the user, and immediately reduce the CPU occupancy rate of the first device, improve the multi-screen usage rate and display smoothness of the complex display scene, and reduce the operation complexity of the user.

Corresponding to the screen linkage method, the present disclosure also provides a screen linkage device. Fig. 11 is a schematic structural diagram of a screen linkage 1100 according to an embodiment of the present disclosure, where the screen linkage is disposed on a first device, the screen of the first device has at least two display areas, the at least two display areas have different display contents, and the first device is pre-bound to a second device linked with the screen. As shown in fig. 11, the apparatus includes the following modules.

The receiving module 1110 is configured to receive a screen operation instruction, where the screen operation instruction includes an operation type and a display area.

And the sending module 1120 is used for sending the linkage operation instruction according to the operation type and the display area.

And a linkage operation module 1130 for performing a linkage operation of the display content of the display area and the screen of the second device according to the operation type and the display area.

Further, in one possible implementation manner of this embodiment, when the screen operation instruction is a sharing instruction, the linkage operation module includes: the first determining unit is used for determining a first display area, and the second device is used for displaying the display content shared by the first display area; the sharing unit is used for sharing the display content of the first display area to the second equipment; and a removing unit for removing the first display area from the first device.

Further, in one possible implementation manner of this embodiment, when the screen operation instruction is an exchange instruction, the linkage operation module includes: a second determination unit configured to determine a second display area; and the exchange unit is used for exchanging and displaying the display content of the second display area with the current display content of the second device.

Further, in one possible implementation manner of this embodiment, when the screen operation instruction is an end instruction, the linkage operation module includes: the creation unit is used for creating a third display area and displaying the current display content of the second device on the third display area; and the control unit is used for controlling the second equipment to stop displaying the current display content and returning to the main interface.

Further, in a possible implementation manner of this embodiment, the control unit is further configured to: and responding to the first control on the screen of the first device or responding to the ending request sent by the second device, controlling the second device to stop displaying the current display content and returning to the main interface.

Further, in a possible implementation manner of this embodiment, the apparatus further includes: and the binding module is used for acquiring the identification information of the second equipment and binding the second equipment according to the identification information.

Further, in a possible implementation manner of this embodiment, the apparatus further includes: and the adjusting module is used for dynamically adjusting the display size of the residual display area on the first device according to a preset rule.

It should be noted that, since the apparatus embodiments of the present disclosure correspond to the method embodiments described above, the foregoing explanation of the method embodiments also applies to the apparatus of the present embodiment. Details not disclosed in the device embodiments may refer to the above method embodiments, and are not described herein.

In summary, the display linkage control of multiple devices is realized, the screen utilization rate is improved, the CPU occupation rate of a single device is reduced, and the operation convenience and experience of a user are improved.

Fig. 12 is a schematic structural diagram of a screen linkage 1200 according to an embodiment of the disclosure, where the apparatus is disposed on a second device, and a screen of the second device has at least one display area, and the second device is pre-tied to a first device of the screen linkage, as shown in fig. 12, and the apparatus includes the following modules.

The receiving module 1210 is configured to receive a linkage operation instruction.

And the linkage operation module 1220 is used for executing screen linkage operation of display contents of at least one display area of the second device and the display area of the first device according to the linkage operation instruction.

It should be noted that, since the apparatus embodiments of the present disclosure correspond to the method embodiments described above, the foregoing explanation of the method embodiments also applies to the apparatus of the present embodiment. Details not disclosed in the device embodiments may refer to the above method embodiments, and are not described herein.

In summary, according to the embodiment of the present disclosure, the second device may perform the linkage operation with the first device in response to the linkage operation instruction from the pre-bound first device, so as to implement real-time linkage of the display content of the multiple devices, so as to implement multi-device linkage with one operation, improve the operation convenience and experience of the user, and immediately reduce the CPU occupancy rate of the first device, improve the multi-screen usage rate and display smoothness of the complex display scene, and reduce the operation complexity of the user.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, a computer program product, and a vehicle.

Fig. 13 illustrates a schematic block diagram of an example electronic device 1300 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as smart terminals with display screens, e.g., cell phones, tablet computers, TVs, smart car systems, laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 13, the apparatus 1300 includes a computing unit 1301 that can perform various appropriate actions and processes according to a computer program stored in a ROM (Read-Only Memory) 1302 or a computer program loaded from a storage unit 1308 into a RAM (Random Access Memory ) 1303. In the RAM 1303, various programs and data required for the operation of the device 1300 can also be stored. The computing unit 1301, the ROM 1302, and the RAM 1303 are connected to each other through a bus 1304. An I/O (Input/Output) interface 1305 is also connected to bus 1304.

Various components in device 1300 are connected to I/O interface 1305, including: an input unit 1306 such as a keyboard, a mouse, or the like; an output unit 1307 such as various types of displays, speakers, and the like; storage unit 1308, such as a magnetic disk, optical disk, etc.; and a communication unit 1309 such as a network card, a modem, a wireless communication transceiver, or the like. The communication unit 1309 allows the device 1300 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

The computing unit 1301 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 1301 include, but are not limited to, a CPU (Central Processing Unit ), GPU (Graphic Processing Units, graphics processing unit), various dedicated AI (Artificial Intelligence ) computing chips, various computing units running machine learning model algorithms, DSP (Digital Signal Processor ), and any suitable processor, controller, microcontroller, etc. The computing unit 1301 performs the respective methods and processes described above, such as a screen linkage method. For example, in some embodiments, the screen linkage method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1308. In some embodiments, part or all of the computer program may be loaded and/or installed onto the device 1300 via the ROM 1302 and/or the communication unit 1309. When the computer program is loaded into RAM 1303 and executed by computing unit 1301, one or more steps of the method described above may be performed. Alternatively, in other embodiments, computing unit 1301 may be configured to perform the aforementioned screen linkage method in any other suitable manner (e.g., by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit System, FPGA (Field Programmable Gate Array ), ASIC (Application-Specific Integrated Circuit, application-specific integrated circuit), ASSP (Application Specific Standard Product, special-purpose standard product), SOC (System On Chip ), CPLD (Complex Programmable Logic Device, complex programmable logic device), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory, erasable programmable read-Only Memory) or flash Memory, an optical fiber, a CD-ROM (Compact Disc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display ) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network ), WAN (Wide Area Network, wide area network), internet and blockchain networks.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service ("Virtual Private Server" or simply "VPS") are overcome. The server may also be a server of a distributed system or a server that incorporates a blockchain.

It should be noted that, artificial intelligence is a subject of studying a certain thought process and intelligent behavior (such as learning, reasoning, thinking, planning, etc.) of a computer to simulate a person, and has a technology at both hardware and software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, a machine learning/deep learning technology, a big data processing technology, a knowledge graph technology and the like.

Embodiments of the present disclosure also provide a vehicle including a screen, at least one processor, and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor, the at least one processor being capable of performing the screen linkage method described in the previous embodiments of the present disclosure when the instructions are executed by the at least one processor.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (14)

1. A screen linkage method, wherein the method is applied to a first device, a screen of the first device has at least two display areas, the at least two display areas have different display contents, and the first device is pre-bound to a second device of the screen linkage, the method comprising:

receiving a screen operation instruction, wherein the screen operation instruction comprises an operation type and a display area;

according to the operation type and the display area, a linkage operation instruction is sent; and

and executing the linkage operation of the display content of the display area and the screen of the second device.

2. The method of claim 1, wherein when the screen operation instruction is a sharing instruction, the performing the screen linkage operation of the display content of the display area and the second device includes:

Determining a first display area;

sharing the display content of the first display area to the second device, wherein the second device is used for displaying the display content shared by the first display area; and

the first display area is removed from the first device.

3. The method according to claim 1 or 2, wherein when the screen operation instruction is an exchange instruction, the performing the screen linkage operation of the display content of the display area and the second device includes:

determining a second display area; and

and exchanging and displaying the display content of the second display area with the current display content of the second device.

4. The method of claim 1 or 2, wherein when the screen operation instruction is an end instruction, the performing the screen linkage operation of the display content of the display area and the second device includes:

creating a third display area, and displaying the current display content of the second device on the third display area; and

and sending a control instruction to the second equipment, wherein the control instruction is used for controlling the second equipment to stop displaying the current display content and returning to the main interface.

5. The method of claim 1 or 2, wherein when the screen operation instruction is an end instruction, the performing the screen linkage operation of the display content of the display area and the second device includes: :

receiving an end request, wherein the end request is used for notifying the first equipment to display the current display content of the second equipment; and

creating a third display area, and displaying the current display content of the second device on the third display area.

6. The method according to any one of claims 1 to 5, wherein the first device pre-binds with the second device by obtaining identification information of the second device and according to the identification information.

7. The method of any one of claims 1 to 5, wherein the method further comprises:

and dynamically adjusting the display size of the residual display area on the first device according to a preset rule.

8. A screen linkage method, wherein the method is applied to a second device, a screen of the second device has at least one display area, and the second device is pre-bound to a first device of the screen linkage, the method comprising:

Receiving a linkage operation instruction; and

and executing screen linkage operation of display contents of at least one display area of the second equipment and the display area of the first equipment according to the linkage operation instruction.

9. A screen linkage, wherein the apparatus is disposed on a first device, a screen of the first device having at least two display areas with different display content, the first device pre-binding a second device of the screen linkage, the apparatus comprising:

the receiving module is used for receiving screen operation instructions, wherein the screen operation instructions comprise operation types and display areas;

the sending module is used for sending linkage operation instructions according to the operation types and the display areas; and

and the linkage operation module is used for executing linkage operation of display content of the display area and a screen of the second equipment according to the operation type and the display area.

10. A screen linkage, wherein the apparatus is disposed on a second device, a screen of the second device having at least one display area, the second device pre-binding a first device of the screen linkage, the apparatus comprising:

The receiving module is used for receiving the linkage operation instruction;

and the linkage operation module is used for executing screen linkage operation of display contents of at least one display area of the second equipment and the display area of the first equipment according to the linkage operation instruction.

11. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7 or claim 8.

12. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-7 or claim 8.

13. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-7 or claim 8.

14. A vehicle, characterized by comprising:

a screen;

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7 or claim 8.