CN115291823A - Multi-screen cooperative display method and device and terminal equipment - Google Patents
Multi-screen cooperative display method and device and terminal equipment Download PDFInfo
- Publication number
- CN115291823A CN115291823A CN202210801301.9A CN202210801301A CN115291823A CN 115291823 A CN115291823 A CN 115291823A CN 202210801301 A CN202210801301 A CN 202210801301A CN 115291823 A CN115291823 A CN 115291823A
- Authority
- CN
- China
- Prior art keywords
- application
- screen
- display
- picture
- display area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
Abstract
The application is applicable to the technical field of computer application, and provides a multi-screen cooperative display method, a multi-screen cooperative display device and terminal equipment, wherein the method comprises the following steps: establishing multi-screen cooperative connection with associated equipment, and starting a picture-in-picture display mode; displaying a first application operation interface corresponding to a first application in a first display area of a display screen according to a received first application starting instruction; sending a first application picture corresponding to the first application to the associated equipment so that the associated equipment displays the first application picture; and receiving a second application picture corresponding to a second application sent by the associated equipment, wherein the first application picture and the second application picture are respectively image data generated according to the first application operation interface and the second application operation interface, and the second application picture is displayed in a second display area of the display screen. Therefore, the self application picture is sent to the associated equipment to be displayed, and the application picture of the associated equipment is displayed, so that the flexibility and the interactivity of multi-screen cooperative display are improved.
Description
Technical Field
The application belongs to the technical field of computer application, and particularly relates to a multi-screen cooperative display method and device, a terminal device and a computer readable storage medium.
Background
With the development of intelligent terminal technology, a user or a home often has a plurality of electronic devices capable of communicating with each other. Various terminal devices generally have respective device characteristics, for example, a mobile phone is better in portability, and a television screen is better in display effect. In order to fully exert the advantages of different terminal devices, the electronic device can switch and display the display data among a plurality of devices in a screen projection mode and the like.
In the related art, when multi-screen cooperative display is performed, mutually cooperative devices cannot simultaneously display application interfaces of the other side, and a local computer cannot be operated when the application interfaces of the cooperative devices are displayed, so that flexibility and interactivity of the multi-screen cooperative display are poor, and user experience is influenced.
Disclosure of Invention
The multi-screen cooperative display method, the multi-screen cooperative display device and the terminal device can solve the problems that when multi-screen cooperative display is carried out, mutually cooperative devices cannot simultaneously display application interfaces of the other side, and a local machine cannot be operated when the application interfaces of the cooperative devices are displayed, so that flexibility and interactivity of multi-screen cooperative display are poor, and user experience is influenced.
In a first aspect, an embodiment of the present application provides a multi-screen cooperative display method, including:
establishing multi-screen cooperative connection with associated equipment, and starting a picture-in-picture display mode; displaying a first application operation interface corresponding to a first application in a first display area of a display screen according to a received first application starting instruction; sending a first application picture corresponding to the first application to the associated equipment so that the associated equipment displays the first application picture, wherein the first application picture is image data generated according to a first application operation interface; receiving a second application picture corresponding to a second application sent by the associated device, wherein the second application picture is image data generated according to a second application operation interface corresponding to the second application; and displaying the second application picture in a second display area of the display screen.
In a second aspect, an embodiment of the present application provides a multi-screen cooperative display device, including: the multi-screen cooperative connection module is used for establishing multi-screen cooperative connection with the associated equipment and starting a picture-in-picture display mode; the first display module is used for displaying a first application operation interface corresponding to a first application in a first display area of a display screen according to a received first application starting instruction; the sending module is used for sending a first application picture corresponding to the first application to the associated equipment so as to enable the associated equipment to display the first application picture, wherein the first application picture is image data generated according to the first application operation interface; the receiving module is used for receiving a second application picture corresponding to a second application sent by the associated device, wherein the second application picture is image data generated according to a second application operation interface corresponding to the second application; and the second display module is used for displaying the second application picture in a second display area of the display screen.
In a third aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the multi-screen cooperative display method according to any one of the first aspect when executing the computer program.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the multi-screen cooperative display method according to any one of the first aspects is implemented.
In a fifth aspect, an embodiment of the present application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the multi-screen cooperative display method according to any one of the foregoing first aspects.
It is to be understood that, for the beneficial effects of the second aspect to the fifth aspect, reference may be made to the relevant description in the first aspect, and details are not described herein again.
Compared with the prior art, the embodiment of the application has the beneficial effects that: the method comprises the steps of establishing multi-screen cooperative connection with associated equipment, starting a picture-in-picture display mode, displaying a first application operation interface corresponding to a first application in a first display area of a display screen when a received first application starting instruction is received, sending a first application picture generated according to the first application operation interface to the associated equipment so that the associated equipment displays the first application picture, and receiving a second application picture corresponding to a second application sent by the associated equipment, wherein the second application picture is image data generated according to the second application operation interface corresponding to the second application, and further displaying the second application picture in a second display area of the display screen. Therefore, the application picture of the current terminal equipment is sent to the associated equipment for displaying, and the application picture of the associated equipment and the operation interface for operating the local application are displayed locally, so that the flexibility and the interactivity of multi-screen cooperative display are improved, and the user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic flowchart of a multi-screen cooperative display method according to an embodiment of the present application;
fig. 2 is a schematic view of a display interface corresponding to a display screen of a current terminal device according to an embodiment of the present application;
fig. 3 is a schematic view of a display interface corresponding to a display screen of a current terminal device according to another embodiment of the present application;
fig. 4 is a flowchart illustrating a multi-screen cooperative display method according to another embodiment of the present application;
fig. 5 is a schematic view of a display interface corresponding to a display screen of a current terminal device according to another embodiment of the present application;
fig. 6 is a schematic view of a display interface corresponding to a display screen of a current terminal device according to another embodiment of the present application;
FIG. 7 is a flowchart illustrating a multi-screen cooperative display method according to another embodiment of the present application;
FIG. 8 is a schematic structural diagram of a multi-screen cooperative display apparatus according to an embodiment of the present disclosure;
FIG. 9 is a schematic structural diagram of a multi-screen cooperative display apparatus according to another embodiment of the present application;
FIG. 10 is a schematic diagram illustrating a multi-screen cooperative display apparatus according to another embodiment of the present disclosure;
fig. 11 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".
Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.
Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless otherwise specifically stated.
It should be understood that, the sequence numbers of the steps in this embodiment do not mean the execution sequence, and the execution sequence of each process should be determined by the function and the inherent logic of the process, and should not constitute any limitation to the implementation process of the embodiment of the present application.
In the related art, when multi-screen cooperative display is performed, mutually cooperative devices cannot simultaneously display application interfaces of the other side, and a local computer cannot be operated when the application interfaces of the cooperative devices are displayed, so that flexibility and interactivity of the multi-screen cooperative display are poor, and user experience is influenced.
The application provides a multi-screen cooperative display method, which includes the steps of establishing multi-screen cooperative connection with associated equipment, starting a picture-in-picture display mode, displaying a first application operation interface corresponding to a first application in a first display area of a display screen when a received first application starting instruction is received, sending a first application picture generated according to the first application operation interface to the associated equipment, enabling the associated equipment to display the first application picture, receiving a second application picture corresponding to a second application sent by the associated equipment, wherein the second application picture is image data generated according to a second application operation interface corresponding to the second application, and further displaying the second application picture in a second display area of the display screen. Therefore, the application picture of the current terminal equipment is sent to the associated equipment for displaying, and the application picture of the associated equipment and the operation interface for operating the local application are displayed locally, so that the flexibility and the interactivity of multi-screen cooperative display are improved, and the user experience is improved.
According to the multi-screen cooperative display method, the execution main body can be terminal equipment. In order to explain the technical solution of the present application, an execution subject of the method is taken as an example of a terminal device to explain an implementation process of the multi-screen cooperative display method provided in the embodiment of the present application.
In one embodiment, referring to fig. 1, a multi-screen cooperative display method is provided, by way of example and not limitation, as shown in fig. 1, the multi-screen cooperative display method may include the following steps:
The associated device may be a terminal device that establishes a multi-screen cooperative connection with the current terminal device, and there may be one or multiple associated devices that establish a multi-screen cooperative connection with the current terminal device.
It should be understood that the current terminal device refers to a terminal device that performs a multi-screen cooperative display method.
It should be understood that the multi-screen cooperative connection established with the associated device may be initiated by any one of the current terminal device and the associated device, such as: in a scene that drawing boards are communicated and communicated with each other and used for learning, a teacher and students need to communicate with each other, the teacher and the students respectively have own terminal equipment, a multi-screen cooperative connection initiated to the terminal equipment of each student by the teacher through the terminal equipment can be provided, or any one of the students can initiate a multi-screen cooperative connection to the terminal equipment of other students and the terminal equipment of the teacher through the terminal equipment, and the terminal equipment for receiving the multi-screen cooperative connection can choose to agree with the establishment of the multi-screen cooperative connection or choose not to agree with the establishment of the multi-screen cooperative connection.
It should be understood that the opening of the pip display mode may be that any one of the current terminal device and the current associated device is opened, and after the any one of the current terminal device and the current associated device opens the pip display mode, the other terminal devices automatically enter the pip display mode.
The multi-screen cooperation can be cross-system and cross-device cooperation, data sharing and cooperation are realized between the terminal device and the terminal device, the distance between the terminal device and the terminal device is not limited, and data transmission can be realized through a network.
In the embodiment of the application, after the multi-screen cooperative connection is established between the current terminal device and the associated device, respective application operation interfaces can be mutually transmitted between the current terminal device and the associated device to be displayed by the other terminal device.
The picture-in-picture display mode may be a mode in which application screens of a plurality of terminal devices are displayed on the same display screen.
The first application start instruction may be an instruction triggered when the user starts/opens the first application on the current terminal device. The first application may be any application program installed on the current terminal device. The first application operation interface may be an interface that is displayed during the use of the first application and is capable of operating the first application.
The display screen refers to a display screen used for displaying by the current terminal equipment.
It should be understood that the first display area may be a display area of a display screen of the current terminal device, where the display screen is used to display a first application operation interface corresponding to the first application, and the first display area may be a whole display area of the display screen or a partial display area of the display screen.
In the embodiment of the application, after the start instruction of the first application is acquired, the current terminal device may start the first application and display a first application operation interface corresponding to the first application in a display screen, so that a user may operate the first application through the first application operation interface. In addition, the first application operation interface may be selected to be displayed in a full screen manner in the display screen according to actual needs, or the first application operation interface may be selected to be displayed in a partial area of the display screen, which is not limited in the embodiment of the present application.
The first application screen may be image data generated in real time according to the first application operation interface.
As a possible implementation manner, after the current terminal device establishes the multi-screen cooperative connection with the associated device, the current terminal device may send an application interface of the current terminal device to the associated device, so that the associated device may display a first application screen on which the current terminal device operates the first application.
And 104, receiving a second application picture corresponding to a second application sent by the associated device, wherein the second application picture is image data generated according to a second application operation interface corresponding to the second application.
The second application may be an application program currently operating on the associated device.
The second application screen may be image data generated on the associated device in real time according to the second application operation interface.
In the embodiment of the application, after the multi-screen cooperative connection is established between the current terminal device and the associated device, the second application picture sent by the associated device can be received in real time, so that the process of operating the second application in the associated device is displayed in the current terminal device, and therefore the current terminal device and the associated device can simultaneously display the application operation interface of the other side, and the flexibility and the interactivity of the multi-screen cooperative display are better.
And 105, displaying the second application picture in a second display area of the display screen.
The second display area may be a display area on a display screen of the current terminal device, where the display screen is used to display a second application screen, and the second display area may be a partial display area of the display screen.
It should be understood that, in the case where there are a plurality of associated apparatuses, there are also a plurality of second display regions, respectively, each corresponding to the second application screen of one associated apparatus.
In one possible embodiment, the current terminal device may display the second application screen in the second display area in a floating window manner, where the first display area includes the second display area.
As an example, in a scene where a multi-screen cooperative connection is established with an associated device and a pip display mode is started, as shown in fig. 2, a display interface diagram corresponding to a display screen of a current terminal device displays a first application operation interface in a first display area 11, displays a second application screen in a second display area 12, where the second application screen is overlaid on the first application operation interface, and a display position of the second application screen may be moved arbitrarily.
In one possible embodiment, the first application operation interface and the second application screen are displayed in a display screen in a partition mode, wherein the first display area and the second display area are not overlapped.
As an example, in a scene where a multi-screen cooperative connection is established with an associated device and a pip display mode is started, as shown in fig. 3, a display interface diagram corresponding to a display screen of a current terminal device, a first application operation interface and a second application screen are displayed in a display screen in a partition manner, the first application operation interface is displayed in a first display area 21, and the second application screen is displayed in a second display area 22.
It can be understood that, no matter the second application picture is displayed above the first display area in a floating window manner, even if the first application operation interface and the second application picture are respectively displayed in a display screen of the current terminal device in a partition manner, the display of the second application picture in the current terminal device does not influence the user to operate the first application in the first application operation interface; in addition, the associated device may also display the second application operation interface and the first application screen in the display screen of the associated device in the same manner, so that when the associated device displays the first application screen, the user is not influenced to operate the second application in the second application operation interface. Therefore, the multi-screen cooperative display method in the embodiment of the application can enable the mutually cooperative devices to simultaneously display the application pictures of the devices of the other side, and can not affect the normal operation of the local application.
Furthermore, if the resolution of the display screen of the associated device is different from the resolution of the display screen of the current terminal device, the resolution of the second application picture can be adjusted, so as to improve the display effect of the second application picture in the current terminal device. That is, in a possible implementation manner of the embodiment of the present application, the step 105 may include:
under the condition that the resolution of the display screen of the associated equipment is different from the resolution of the display screen, adjusting the resolution of the second application picture according to the resolution of the display screen to generate an adjusted second application picture;
and displaying the adjusted second application picture in a second display area.
And the resolution ratio of the adjusted second application picture is matched with the resolution ratio of the display screen of the current terminal equipment.
Illustratively, when a drawing board application program is used for communication and study, a teacher and a student operate on a plurality of terminal devices respectively, and the teacher does unobstructed operation on own terminal device in order to show the sequence and position skills of drawing; the graphic data display formed by the teacher's real-time drawing instruction can be seen on the student's terminal equipment; the student simulates the drawing after learning, and the teacher can directly see the action and the drawing sequence of the student on the terminal equipment of the teacher in real time; the teaching aid breaks through the concept of traditional teaching, teachers and students do not need to attend classes together, and details can be displayed without hindrance; meanwhile, a plurality of picture effects can be visually compared, and great convenience is achieved.
According to the multi-screen cooperative display method, the multi-screen cooperative connection is established with the associated equipment, the picture-in-picture display mode is started, when a received first application starting instruction is received, the first application operation interface corresponding to the first application is displayed in the first display area of the display screen, the first application picture generated according to the first application operation interface is sent to the associated equipment, so that the associated equipment displays the first application picture, the second application picture corresponding to the second application sent by the associated equipment is received, the second application picture is image data generated according to the second application operation interface corresponding to the second application, and the second application picture is displayed in the second display area of the display screen. Therefore, the application picture of the current terminal equipment is sent to the associated equipment for displaying, and the application picture of the associated equipment and the operation interface for operating the local application are displayed locally, so that the flexibility and the interactivity of multi-screen cooperative display are improved, and the user experience is improved.
In an embodiment, referring to fig. 4, a schematic flowchart of another multi-screen cooperative display method provided in the embodiment of the present application includes:
For the specific implementation process and principle of the foregoing steps 401 to 402, reference may be made to the detailed description of the foregoing embodiments, which are not described herein again.
The third display area may be a display area on a display screen of the current terminal device, where the display screen is used to display the first application screen, and the third display area may be a partial display area of the display screen.
In one possible embodiment, the first application picture is displayed in a third display area of the display screen in a floating window mode, wherein the first display area comprises the third display area.
As an example, in a scenario where a multi-screen cooperative connection is established with an associated device and a pip display mode is started, as shown in fig. 5, a display interface diagram corresponding to a display screen of a current terminal device displays a first application operation interface in a first display area 31, displays a second application screen in a second display area 32, displays a first application screen in a third display area 33, where the second application screen covers the first application operation interface, and the first application screen covers the first application operation interface, and display positions of the first application screen and the second application screen may be arbitrarily moved.
In one possible embodiment, the first application operation interface, the second application screen and the first application screen are displayed in the display screen in a partitioned manner, wherein the first display area, the second display area and the first application screen are not overlapped.
As an example, in a scenario where a multi-screen cooperative connection is established with an associated device and a pip display mode is started, as shown in fig. 6, a display interface diagram corresponding to a display screen of a current terminal device is shown, where a first application operation interface, a second application screen, and a first application screen are displayed in a display screen of the current terminal device in a partitioned manner, the first application operation interface is displayed in a first display area 41, the second application screen is displayed in a second display area 42, and the first application screen is displayed in a third display area 43.
For the detailed implementation process and principle of the steps 404 to 406, reference may be made to the detailed description of the foregoing embodiments, which are not described herein again.
According to the multi-screen cooperative display method, the multi-screen cooperative connection is established with the associated equipment, the picture-in-picture display mode is started, when a received first application starting instruction is received, the first application operation interface corresponding to the first application is displayed in the first display area of the display screen, the first application picture is displayed in the third display area of the display screen, the first application picture generated according to the first application operation interface is sent to the associated equipment, so that the associated equipment displays the first application picture, the second application picture corresponding to the second application sent by the associated equipment is received, and the second application picture is displayed in the second display area of the display screen. Therefore, the application picture of the current terminal equipment is sent to the associated equipment for displaying, and the application picture of the associated equipment, the application picture of the current terminal equipment and the operation interface for operating the local application are displayed locally, so that the flexibility and the interactivity of multi-screen cooperative display are further improved, and the user experience is improved.
In an embodiment, referring to fig. 7, a flowchart of another multi-screen cooperative display method provided in the embodiment of the present application includes:
The detailed implementation process and principle of the steps 701 to 702 may refer to the detailed description of the above embodiments, and are not described herein again.
The first application screen may include a plurality of first video frames and a timestamp corresponding to each first video frame.
It should be understood that the first video frame may be a video frame generated by the first application operating interface during the operation of the first application through the first application operating interface.
It should be understood that the process of operating the first application may be a process in which the user opens the first application and displays the first application on the display screen; or, the method may further include a process of operating the first application operation interface after the first application operation interface is displayed on the display screen.
The second application screen may include a plurality of second video frames and a timestamp corresponding to each of the second video frames.
As a possible implementation manner, the second application screen may be represented by video data, and since the second application screen needs to be displayed in the remote device, in order to avoid abnormal situations such as data delay and the like of the second application screen during transmission, a timestamp corresponding to each video frame in the second application screen may be recorded when the second application screen is generated, so as to mark a display sequence of each video frame by using the timestamp, so as to prevent an abnormal situation that the video frames are confused when the second application screen is displayed in the current terminal device. That is, in a possible implementation manner of this embodiment of the application, the second application screen may include a plurality of second video frames and a timestamp corresponding to each second video frame, and correspondingly, the step 706 may include:
and sequentially displaying each second video frame in the second display area according to the corresponding time stamp of each second video frame.
The second video frame may be a video frame generated by recording the second application operation interface in the process of operating the second application by the associated device.
In this embodiment of the application, after the current terminal device receives the second application picture, the display order of each video frame may be determined according to the timestamp of each video frame in the second application picture, and the video frames are sequentially displayed in the second display area according to the display order of each video frame.
For the detailed implementation process and principle of the above steps 704-706, reference may be made to the detailed description of the above embodiments, which is not repeated herein.
According to the multi-screen cooperative display method, the multi-screen cooperative connection is established with the associated equipment, the picture-in-picture display mode is started, the first application operation interface corresponding to the first application is displayed in the first display area of the display screen when the received first application starting instruction is received, the first application operation interface is recorded in the process of operating the first application, the first application picture is generated and sent to the associated equipment to be displayed, then the second application picture corresponding to the second application sent by the associated equipment is received, and each second video frame is sequentially displayed in the second display area of the display screen according to the timestamp of each second video frame in the second application picture. Therefore, the application picture of the current terminal device is sent to the associated device to be displayed, and the application picture of the associated device and the operation interface for operating the local application are displayed locally according to the timestamp of the video frame, so that the flexibility and the interactivity of multi-screen cooperative display are improved, the reliability of the multi-screen cooperative display is improved, and the user experience is further improved.
It should be understood that although the steps in the flowcharts of fig. 1, 4, and 7 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 1, 4 and 7 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the steps or stages is not necessarily sequential, but may be performed alternately or alternately with other steps or at least some of the other steps.
In one embodiment, as shown in fig. 8, a multi-screen cooperative display apparatus is provided, where the apparatus may adopt a software module or a hardware module, or a combination of the two modules, as a part of a computer device, and the apparatus specifically includes: the multi-screen cooperative connection module 410, the first display module 420, the sending module 430, the receiving module 440, and the second display module 450, wherein:
the multi-screen cooperative connection module 410 is configured to establish a multi-screen cooperative connection with an associated device and start a pip display mode.
The first display module 420 is configured to display a first application operation interface corresponding to a first application in a first display area of the display screen according to the received first application start instruction.
The sending module 430 is configured to send a first application screen corresponding to the first application to the associated device, so that the associated device displays the first application screen, where the first application screen is image data generated according to the first application operation interface.
The receiving module 440 is configured to receive a second application screen corresponding to a second application sent by the associated device, where the second application screen is image data generated according to a second application operation interface corresponding to the second application.
The second display module 450 is configured to display the second application screen in a second display area of the display screen.
In one embodiment, the second display module 450 is further configured to: and displaying the second application picture in a second display area in a floating window mode, wherein the first display area comprises the second display area.
In one embodiment, the second display module 450 is further configured to: the first application operation interface and the second application picture are displayed in a display screen in a partition mode, wherein the first display area and the second display area are not overlapped.
Referring to fig. 9, in an embodiment, the multi-screen cooperative display apparatus further includes a third display module 460 for displaying the first application screen in a third display area of the display screen.
In one embodiment, the third display module 460 is further configured to: the first display area, the second display area and the third display area are not overlapped.
In one embodiment, the third display module 460 is further configured to: and displaying the first application picture in a third display area of the display screen in a floating window mode, wherein the first display area comprises the third display area.
Referring to fig. 10, in an embodiment, the multi-screen cooperative display apparatus further includes a recording module 470, configured to record the first application operation interface in the process of operating the first application, so as to generate the first application screen.
The first application picture comprises a plurality of first video frames and a timestamp corresponding to each first video frame.
In one embodiment, the second application screen includes a plurality of second video frames and a timestamp corresponding to each of the second video frames, and the second display module 450 is further configured to: and sequentially displaying each second video frame in the second display area according to the corresponding time stamp of each second video frame.
In one embodiment, the second display module 450 is further configured to: under the condition that the resolution of the display screen of the associated equipment is different from the resolution of the display screen, adjusting the resolution of the second application picture according to the resolution of the display screen to generate an adjusted second application picture; and displaying the adjusted second application picture in a second display area.
For specific limitations of the multi-screen cooperative display apparatus, reference may be made to the above limitations on the multi-screen cooperative display method, which is not described herein again. The modules in the multi-screen cooperative display device can be wholly or partially realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
Fig. 11 is a schematic structural diagram of a terminal device provided in an embodiment of the present application. As shown in fig. 11, the terminal device 700 of this embodiment includes: at least one processor 710 (only one shown in fig. 11), a memory 720, and a computer program 721 stored in the memory 720 and operable on the at least one processor 710, wherein the processor 710 executes the computer program 721 to implement the steps in the multi-screen cooperative display method embodiment.
The terminal device 700 may be a desktop computer, a notebook, a palm computer, a cloud server, or other computing devices. The terminal device may include, but is not limited to, a processor 710, a memory 720. Those skilled in the art will appreciate that fig. 11 is merely an example of the terminal device 700, and does not constitute a limitation of the terminal device 700, and may include more or less components than those shown, or combine some components, or different components, such as an input output device, a network access device, etc.
The Processor 710 may be a Central Processing Unit (CPU), and the Processor 710 may be other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 720 may in some embodiments be an internal storage unit of the terminal device 700, such as a hard disk or a memory of the terminal device 700. The memory 720 may also be an external storage device of the terminal device 700 in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the terminal device 700. Further, the memory 720 may also include both an internal storage unit and an external storage device of the terminal device 700. The memory 720 is used for storing an operating system, an application program, a Boot Loader (Boot Loader), data, and other programs, such as program codes of the computer programs. The memory 720 may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer-readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
When the computer program product runs on a terminal device, the steps in the method embodiments can be implemented when the terminal device executes the computer program product.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same. Although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (10)
1. A multi-screen cooperative display method is characterized by comprising the following steps:
establishing multi-screen cooperative connection with associated equipment, and starting a picture-in-picture display mode;
displaying a first application operation interface corresponding to a first application in a first display area of a display screen according to a received first application starting instruction;
sending a first application picture corresponding to the first application to the associated equipment so that the associated equipment can display the first application picture, wherein the first application picture is image data generated according to the first application operation interface;
receiving a second application picture corresponding to a second application sent by the associated device, wherein the second application picture is image data generated according to a second application operation interface corresponding to the second application;
and displaying the second application picture in a second display area of the display screen.
2. A multi-screen cooperative display method as recited in claim 1, wherein the displaying the second application screen in a second display region of the display screen comprises:
and displaying the second application picture in the second display area in a floating window mode, wherein the first display area comprises the second display area.
3. A multi-screen cooperative display method as recited in claim 1, wherein the first application operating interface and the second application screen are displayed in a partitioned manner on the display screen, and wherein the first display area and the second display area are not overlapped.
4. A multi-screen cooperative display method according to claim 1, wherein, according to the received first application start instruction, displaying a first application operation interface corresponding to the first application in a first display area of a display screen, further comprising:
and displaying the first application picture in a third display area of the display screen.
5. A multi-screen cooperative display method as recited in claim 4, wherein the first display region, the second display region, and the third display region are non-overlapping.
6. A multi-screen cooperative display method as recited in claim 4, wherein the displaying the first application screen in a third display area of the display screens comprises:
and displaying the first application picture in a third display area of the display screen in a floating window mode, wherein the first display area comprises the third display area.
7. A multi-screen cooperative display method as recited in any of claims 1-6, wherein, prior to sending the first application screen corresponding to the first application to the associated device to cause the associated device to display the first application screen, further comprising:
and recording the first application operation interface in the process of operating the first application to generate the first application picture.
8. A multi-screen cooperative display apparatus, comprising:
the multi-screen cooperative connection module is used for establishing multi-screen cooperative connection with the associated equipment and starting a picture-in-picture display mode;
the first display module is used for displaying a first application operation interface corresponding to a first application in a first display area of a display screen according to a received first application starting instruction;
a sending module, configured to send a first application screen corresponding to the first application to the associated device, so that the associated device displays the first application screen, where the first application screen is image data generated according to the first application operation interface;
a receiving module, configured to receive a second application screen corresponding to a second application sent by the associated device, where the second application screen is image data generated according to a second application operation interface corresponding to the second application;
and the second display module is used for displaying the second application picture in a second display area of the display screen.
9. A terminal device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210801301.9A CN115291823A (en) | 2022-07-08 | 2022-07-08 | Multi-screen cooperative display method and device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210801301.9A CN115291823A (en) | 2022-07-08 | 2022-07-08 | Multi-screen cooperative display method and device and terminal equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115291823A true CN115291823A (en) | 2022-11-04 |
Family
ID=83822315
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210801301.9A Pending CN115291823A (en) | 2022-07-08 | 2022-07-08 | Multi-screen cooperative display method and device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115291823A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115964011A (en) * | 2023-03-16 | 2023-04-14 | 深圳市湘凡科技有限公司 | Method and related device for displaying application interface based on multi-screen cooperation |
-
2022
- 2022-07-08 CN CN202210801301.9A patent/CN115291823A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115964011A (en) * | 2023-03-16 | 2023-04-14 | 深圳市湘凡科技有限公司 | Method and related device for displaying application interface based on multi-screen cooperation |
| CN115964011B (en) * | 2023-03-16 | 2023-06-06 | 深圳市湘凡科技有限公司 | Method and related device for displaying application interface based on multi-screen cooperation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11151359B2 (en) | Face swap method, face swap device, host terminal and audience terminal | |
| CN111526415B (en) | Double-screen display equipment and HDMI switching method thereof | |
| CN115291823A (en) | Multi-screen cooperative display method and device and terminal equipment | |
| CN106469070A (en) | The method of panel parameter self-regeneration | |
| CN114205529A (en) | Single-camera calling method and device, terminal and readable storage medium | |
| CN112616078A (en) | Screen projection processing method and device, electronic equipment and storage medium | |
| CN112433689A (en) | Data transmission method and device for same-screen device, same-screen device and medium | |
| WO2023125273A1 (en) | Image display method of electronic equipment, image processing circuit and electronic equipment | |
| CN114356264A (en) | Signal generation method, device, equipment and readable storage medium | |
| CN111447402B (en) | Menu display control method, device and equipment | |
| KR101366327B1 (en) | A method of multi-tasking in mobile communication terminal | |
| CN112839097A (en) | Remote control method, equipment and system | |
| CN112083901A (en) | Image processing method, device, equipment and storage medium | |
| CN112653788B (en) | User interface display method, mobile terminal and storage medium | |
| CN108769565B (en) | Automatic switching method of picture layout, server and local recording and broadcasting system | |
| CN108984074B (en) | Sidebar operation method, device and system, terminal equipment and server | |
| CN110753194A (en) | Dual-screen different display method, storage medium and electronic equipment | |
| CN112162719A (en) | Display content rendering method and device, computer readable medium and electronic equipment | |
| CN101546221A (en) | Method, device and system for data processing | |
| CN108881999A (en) | A kind of screenshotss processing method and system | |
| CN112312054B (en) | Image processing method, device, equipment, system and storage medium | |
| CN104735537A (en) | Display screen signal display switching method and device | |
| CN114691000B (en) | Multi-screen linkage method, device, equipment and storage medium | |
| CN111641855B (en) | Double-screen display equipment and audio output method thereof | |
| CN113497966B (en) | Double-screen display equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |