CN110515580B - Display control method, device and terminal - Google Patents
Display control method, device and terminal Download PDFInfo
- Publication number
- CN110515580B CN110515580B CN201910823343.0A CN201910823343A CN110515580B CN 110515580 B CN110515580 B CN 110515580B CN 201910823343 A CN201910823343 A CN 201910823343A CN 110515580 B CN110515580 B CN 110515580B
- Authority
- CN
- China
- Prior art keywords
- terminal
- content
- information
- desktop
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a display control method, a display control device and a display control terminal, wherein first information is sent to a second terminal through connection between the first terminal and the second terminal, the first information is displayed on a desktop of the second terminal, and the first information is used for representing input control information of the first terminal; responding to the first operation, and obtaining first content currently displayed by the second terminal through connection; displaying first content on a desktop of a first terminal; the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal. Therefore, after the control information is sent to other terminals through the connection between the terminals and displayed, the first content currently displayed by the other terminals can be obtained under the control of the control information and displayed on the current terminal, so that the output control between the terminals can be freely realized, the screen projection control mode is enriched, and the use experience of a user on the terminal can be obviously improved.
Description
Technical Field
The present application relates to the field of output control, and in particular, to a display control method, device and terminal.
Background
At present, projection display can be performed between electronic devices. For example, a desktop running on the first electronic device and a user interface displayed on the desktop may be projected to the second electronic device together, and displayed by using a display screen of the second electronic device. At this time, the second electronic device is equivalent to an external display screen of the first electronic device, that is, the first electronic device copies the desktop of the first electronic device and the user interface displayed on the desktop to the second electronic device.
In summary, the screen projection is a process of copying a desktop operated by the first electronic device and a user interface displayed on the desktop to the second electronic device, and is single in form.
Disclosure of Invention
The application provides a display control method, a display control device and a terminal, which specifically comprise the following steps:
the application provides a display control method, which comprises the following steps:
sending first information to a second terminal through connection between the first terminal and the second terminal, wherein the first information is displayed on a desktop of the second terminal and is used for representing input control information of the first terminal;
responding to a first operation, and obtaining first content currently displayed by the second terminal through the connection;
displaying the first content on a desktop of the first terminal;
the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal.
In the above method, preferably, the obtaining, through the connection and in response to the first operation, the first content currently displayed by the second terminal includes:
and responding to the operation of moving the first content currently displayed by the second terminal to the desktop of the first terminal, and obtaining the first content currently displayed by the second terminal through the connection, wherein the first content comprises display data and/or control data.
The above method, preferably, further comprises at least one of:
responding to a second operation, sending second information to the second terminal through the connection, wherein the second information is used for displaying second content on a desktop of the second terminal;
obtaining third information based on the connection, the third information being for displaying third content at the first terminal;
the second content is from the first terminal, the third content is from the second terminal, the second content is the same as or different from the third content, the third information includes information obtained by the second terminal processing the second content, and the second information includes information obtained by the first terminal processing the third content.
Preferably, the sending, in response to the second operation, the second information to the second terminal through the connection includes:
responding to the operation of moving the second content in the desktop of the first terminal to the second terminal, and sending the second content to the second terminal through the connection, wherein the second content comprises display data and/or control data;
or the like, or, alternatively,
and sending data information generated by processing the second content to the second terminal through the connection in response to the operation of processing the second content.
The above method, preferably, the obtaining third information based on the connection includes:
under the condition that the second terminal processes second content displayed on a desktop of the second terminal, obtaining data information generated by processing the second content based on the connection;
or the like, or a combination thereof,
and under the condition that the first terminal processes second content displayed on the desktop of the second terminal, obtaining data information generated by processing the second content based on the connection.
The above method, preferably, the first terminal has a first display output area, and the third content is configured to be displayed in the first display output area;
when the first terminal is in a first mode, the first display output area is a desktop of the first terminal;
and when the first terminal is in the second mode, the desktop of the first terminal is a part of the first display output area.
The above method, preferably, the second terminal has a second display output area, and the second content is configured to be displayed in the second display output area;
when the second terminal is in a first mode, the second display output area is a desktop of the second terminal;
the second terminal is in a second mode, and the desktop of the second terminal is a part of the second display output area; and the first display output area and the second display output area are the same or different.
In the method, preferably, a window area associated with the second terminal is provided on the desktop of the first terminal;
wherein the first content is configured to be displayed at the window area.
The present application also provides a display control apparatus, including:
the device comprises a sending unit, a receiving unit and a sending unit, wherein the sending unit is used for sending first information to a second terminal through connection between the first terminal and the second terminal, the first information is displayed on a desktop of the second terminal, and the first information is used for representing input control information of the first terminal;
an obtaining unit, configured to obtain, in response to a first operation, first content currently displayed by the second terminal through the connection;
the display unit is used for displaying the first content on a desktop of the first terminal;
the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal.
The present application also provides a terminal, which includes as a first terminal:
a display;
the processor is used for sending first information to the second terminal through the connection between the first terminal and the second terminal, the first information is displayed on a desktop of the second terminal, and the first information is used for representing input control information of the first terminal; responding to a first operation, and obtaining first content currently displayed by the second terminal through the connection; displaying the first content on a desktop of the display;
the first content is a content pointed by the input control information of the first terminal, and the first content is a part or all of a currently displayed content of the second terminal.
According to the technical scheme, the display control method, the display control device and the display control terminal send the first information to the second terminal through the connection between the first terminal and the second terminal and display the first information on the desktop of the second terminal, and then respond to the first operation, obtain the first content currently displayed by the second terminal through the connection and display the first content on the desktop of the first terminal. It can be seen that, in the application, after the connection between the terminal and other terminals is established, the control information (mouse control data) is sent to other terminals through the connection between the terminals and displayed, and then the first content currently displayed by other terminals can be obtained under the control of the control information (mouse control data) and displayed on the current terminal, so that the output control between the terminals can be free, the screen projection mode is enriched, and the use experience of the user on the terminal can be obviously improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a display control method according to an embodiment of the present disclosure;
FIGS. 2-11 are respective illustrations of embodiments of the present application;
fig. 12 is a schematic structural diagram of a display control apparatus according to a second embodiment of the present application;
fig. 13 is a schematic structural diagram of a terminal according to a third embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
Referring to fig. 1, a flowchart of an implementation of a display control method provided in an embodiment of the present application is shown, where the method may be applied to a terminal or a device having a display output area, such as a terminal, such as a computer, a mobile phone, a pad, or a server, having a display screen. The method in the embodiment is mainly used for performing display control of bidirectional screen projection between the current terminal and other terminals.
Specifically, the method in this embodiment may include the following steps:
step 101: and sending the first information to the second terminal through the connection between the first terminal and the second terminal.
The first information is displayed on the desktop of the second terminal and can be used for representing input control information of the first terminal. For example, the first information may be information related to a control, such as control information or mouse information, and includes at least one of display size information, display position information, appearance posture information, and the like of a control, such as a cursor or a mouse. The input control information of the first terminal characterized by the first information may be understood as: the first terminal inputs control (first operation) related information, such as region selection, position clicking or object dragging, on the desktop of the second terminal through a mouse.
It should be noted that the connection between the first terminal and the second terminal may be implemented by bluetooth connection between the first terminal and the second terminal, or may be implemented by a communication network, such as WiFi, a local area network, a zigbee, or a mobile communication network.
And the first information is displayed on the desktop of the second terminal, which can be understood as: the first information is displayed in any area on the desktop of the second terminal, or the first information is displayed in a specific area on the desktop of the second terminal for the first terminal, and so on.
Step 102: and responding to the first operation, and obtaining the first content currently displayed by the second terminal through connection.
The first content is a content pointed by input control (first operation) information of the first terminal, and the first content is a part or all of currently displayed content of the second terminal, for example, the first content is desktop content of the second terminal, or the first content is specific window content or specific application, icon, file, or the like on a desktop of the second terminal.
The first operation may be understood as an input control operation of the first information (a control such as a mouse) on the desktop of the second terminal, for example, an operation of selecting, clicking, dragging, or the like on the desktop of the second terminal by the control such as the mouse or a cursor.
Accordingly, at least a part of the content currently displayed by the second terminal forms the first content under the first operation, and the first content on the second terminal is obtained through the connection between the first terminal and the second terminal at the first terminal. That is, after the first terminal transmits and displays the first information to the second terminal, the second terminal can generate and transmit the first content to the first terminal, and the first content may also be a media stream formed by a screenshot.
Step 103: and displaying the first content on a desktop of the first terminal.
In this embodiment, the displaying of the first content on the desktop of the first terminal may be understood as: the first content is displayed in an arbitrary area on the desktop of the first terminal, or the first content is displayed in a specific area on the desktop of the first terminal for the second terminal, and so on.
In view of the above, in the display control method provided in the first embodiment of the present application, the first information is sent to the second terminal through the connection between the first terminal and the second terminal and is displayed on the desktop of the second terminal, and then the first content currently displayed on the second terminal is obtained through the connection in response to the first operation and is displayed on the desktop of the first terminal. It can be seen that, in this embodiment, after the connection between the terminal and the other terminal is established, the control information is sent to the other terminal through the connection between the terminals and is displayed, and then the first content currently displayed by the other terminal can be obtained under the control of the control information and is displayed on the current terminal, so that the output control between the terminals can be freely performed, thereby enriching the screen projection mode and significantly improving the user experience of the user on the terminal.
In a specific implementation, the first operation in this embodiment may be an operation of moving the first content currently displayed by the second terminal to the desktop of the first terminal, as shown in fig. 2, the first operation may be an operation of dragging the window content (or a certain icon, file, etc.) of a certain chat application to move toward the direction of the desktop of the first terminal under an input operation of a control such as a mouse or a cursor, and at this time, in step 102, the display data and/or the control data in the first content currently displayed on the second terminal may be obtained through the connection between the first terminal and the second terminal, that is, or in this embodiment, the first content displayed on the first terminal may include the specific display data and/or the specific control data currently displayed on the second terminal, as shown in fig. 2, the contents of the window displayed on the first terminal include voice data for a voice conversation and operation data for controlling the play of the voice conversation.
Of course, in this embodiment, when the first content is obtained, data information generated by processing the first content on the first terminal or the second terminal may also be obtained and displayed on the desktop of the first terminal, for example, data information that is hidden and displayed when the first content is displayed on the desktop of the first terminal in a content adaptive manner, data information corresponding to the first content after zooming a window or expanding a window, data information generated by operating the first content with a control such as a mouse or a cursor, or data information that is content-changed in the first content due to execution of a corresponding application, and the like.
In an implementation manner, in this embodiment, the first terminal may further send, in response to the second operation, second information to the second terminal through a connection, where the second information is used to display second content on a desktop of the second terminal, where the second content is content from the first terminal, and the second information may include information obtained by processing the specific content by the first terminal, so that, in this embodiment, after the specific content is processed on the first terminal, information generated by the processing is sent to the second terminal, so that the corresponding content on the first terminal is displayed on the desktop of the second terminal, and thus, the second content corresponding to the processing of the specific content on the first terminal is displayed on the desktop of the second terminal, and at this time, the second terminal synchronizes with a change state of the specific content on the first terminal;
based on this, the first terminal of this embodiment may further obtain third information based on the connection between the first terminal and the second terminal, where the third information is used to display third content on the first terminal. In this embodiment, after the second terminal processes the specific content, information generated by the second terminal processing may be obtained on the first terminal, so that the desktop of the first terminal displays the corresponding content on the second terminal. Therefore, the third content corresponding to the specific content processing on the second terminal is displayed on the desktop of the first terminal, and at the moment, the change state of the specific content on the second terminal is synchronized on the first terminal.
Specifically, the second information includes information obtained by the first terminal processing the third content, and the third information includes information obtained by the second terminal processing the second content, and the third content displayed on the first terminal may be the same as or different from the second content displayed on the second terminal. Therefore, in this embodiment, after processing the third content synchronized to the first terminal by the second terminal on the first terminal, the second information generated by the processing is sent to the second terminal, so that the corresponding content on the first terminal is displayed on the desktop of the second terminal, and after processing the second content synchronized to the second terminal by the first terminal by the second terminal, the third information generated by processing the second content by the second terminal is obtained on the first terminal, so that the corresponding content on the second terminal is displayed on the desktop of the first terminal. Therefore, the second content corresponding to the processing of the third content on the first terminal is displayed on the desktop of the second terminal, and the third content corresponding to the processing of the second content on the second terminal is displayed on the desktop of the first terminal.
It should be noted that the second content may be a content that is displayed by the first terminal by screen-casting to the second terminal through an input operation, the third content may be a content that is displayed by the second terminal by screen-casting to the first terminal through an input operation, the second content is different from the third content, and the first terminal and the second terminal synchronize the respective screen-casting contents thereof respectively; alternatively, the second content is the same as the third content, and is displayed by the first terminal being subjected to screen-casting by the input operation, or may be displayed by the second terminal being subjected to screen-casting by the input operation, and the first terminal and the second terminal synchronize the content at the same time, as shown in fig. 3.
The second operation may be an operation of moving the second content in the desktop of the first terminal to the second terminal on the first terminal, for example, dragging a window content of a certain chat application on the first terminal to move to the second terminal, so in this embodiment, the second information, that is, the second content, is sent to the second terminal through the connection, where the second content includes display data and/or control data, for example, the second content includes voice data of a voice conversation in the window content of the chat application and operation data for controlling the play of the voice conversation;
alternatively, the second operation may be an operation of processing the second content on the first terminal, and accordingly, in this embodiment, in response to the operation of processing the second content, the data information generated by processing the second content is sent to the second terminal through the connection. Wherein, the data information generated by processing the second content can be understood as: and correspondingly, after data information generated by processing the second content is sent to the second terminal, the second terminal displays the corresponding second content, and the second content displayed on the second terminal is the content processed on the same basis as the first content on the basis of the original second content, so that the first terminal and the second terminal are synchronized with respect to the content on the first terminal.
When the first terminal obtains the third information capable of displaying the third content on the first terminal based on the connection, there may be the following cases:
in one case, in a case where the second terminal processes the second content displayed on the desktop of the second terminal, the first terminal obtains data information generated by the second terminal processing the second content based on the connection. Wherein, the data information generated by the second terminal processing the second content can be understood as: the second terminal performs corresponding processing operation on the basis of the second content to generate incremental data, such as data of character change, size change or position movement, and correspondingly, the first terminal acquires data generated by processing the second content by the second terminal and displays corresponding third content on the first terminal, at this time, the third content displayed on the first terminal is the second content processed on the basis of the original second content of the second terminal, or it can be understood that the third content displayed on the first terminal is: performing content which is processed in the same way as the second terminal on the basis of the original third content of the first terminal, thereby realizing the synchronization between the first terminal and the second terminal about the content on the second terminal;
in another case, in a case where the first terminal processes the second content displayed on the desktop of the second terminal, the first terminal obtains data information generated by the second terminal processing the second content based on the connection. The data information generated by the first terminal processing the second content may be understood as: the first terminal controls incremental data generated by corresponding processing operation on the basis of second content displayed on a desktop of the second terminal through input of first information, such as data of character change, size change or position movement, and accordingly, the first terminal acquires data generated by processing the second content by the first terminal and displays corresponding third content on the first terminal, at the moment, the third content displayed on the first terminal is the second content processed on the basis of the original second content of the second terminal, or the third content displayed on the first terminal is understood to be the content processed on the basis of the original third content of the first terminal and the same as the first terminal, so that synchronization between the first terminal and the second terminal about the content on the second terminal is realized.
In one implementation, the first terminal has a first display output area, and the third content may be configured to be displayed in the first display output area. Specifically, the first display output area of the first terminal is a display area of a desktop of the first terminal when the first terminal is in the first mode, as shown in fig. 4, the first display output area of the first terminal is a display area of the desktop when the first terminal is in the normal mode; and when the first terminal is in the second mode, the first display area of the first terminal includes both the display area of the desktop of the first terminal and other display areas, and at this time, the desktop of the first terminal is only a part of the first display output area thereof, as shown in fig. 5, when the first terminal is in the screen projection mode, the display output area of the first terminal includes both the display area of the desktop and the display area of the extended screen. At this time, the third content from the second terminal on the first terminal may be displayed on the desktop of the first terminal, and specifically may be the first display area on the desktop of the first terminal.
Additionally, the second terminal has a second display output area where the second content may be configured to be displayed. Specifically, the second display output area of the second terminal is a display area of a desktop of the second terminal when the second terminal is in the first mode, as shown in fig. 6, the display output area of the second terminal is a display area of the desktop when the second terminal is in the normal mode; and when the second terminal is in the second mode, the second display area of the second terminal includes both the display area of the desktop of the second terminal and other display areas, and at this time, the desktop of the second terminal is only a part of the second display output area thereof, as shown in fig. 7, when the second terminal is in the screen projection mode, the display output area of the second terminal includes both the display area of the desktop and the display area of the extended screen. At this time, the second content from the first terminal on the second terminal may be displayed on a desktop of the second terminal, and specifically may be a second display area on the desktop of the second terminal.
It should be noted that, in this embodiment, the expansion screen of the first terminal may be on the second terminal or other terminals or a wall surface, and the expansion screen of the second terminal may be on the first terminal or other terminals or a wall surface.
Specifically, a window region associated with the second terminal (the first terminal acts as an extended screen of the second terminal) may be disposed on a desktop of the first terminal, and the first content is configured to be displayed in the window region. As shown in fig. 8, a first window area is provided at a lower left corner on a desktop of the first terminal for displaying a first content (e.g., a third content) obtained from the second terminal, and thus, based on the above synchronization scheme between the first terminal and the second terminal, information (e.g., a second information) obtained by the first terminal processing the first content may be transmitted to the second terminal so that the second terminal performs the same processing on a content corresponding to the first content, or information (e.g., a third information) obtained by the second terminal processing the first content displayed on the desktop thereof may be transmitted to the first terminal so that the first terminal performs the same processing on the synchronized first content, so that the first terminal and the second terminal synchronize the first content on screen casting.
It should be noted that, when the first content is displayed in the window area, the display size of the first content may be determined according to the size of the window area, for example, the display size of the first content is reduced or enlarged according to the size of the window area, or the first content may hide part of the content according to the window area, so that the first content is displayed according to the original size; alternatively, the size of the window area may be adjusted according to the actual size of the first content, so that the first content is entirely displayed in the window area in the original posture.
Similarly, a window area associated with the first terminal may be set on the desktop of the second terminal (the second terminal serves as an extended screen of the first terminal), and the fourth content that the first terminal casts the screen to the second terminal may be displayed in the window area. As shown in fig. 9, a second window area is provided at the lower left corner on the desktop of the second terminal for displaying a fourth content (e.g., a second content) obtained from the first terminal, so that, based on the above synchronization scheme between the first terminal and the second terminal, information (e.g., a second information) obtained by the first terminal processing the fourth content displayed on the desktop thereof can be sent to the second terminal so that the second terminal performs the same processing on a content corresponding to the fourth content, or information (e.g., a third information) obtained by the second terminal processing the fourth content projected by the first terminal is also sent to the first terminal so that the first terminal performs the same processing on the fourth content displayed on the desktop thereof so that the first terminal and the second terminal synchronize with respect to the projected fourth content.
In one implementation manner, in this embodiment, a virtual window for the first terminal may be set on the second terminal, and the first operation may be an operation of moving the first content currently displayed by the second terminal to the virtual window, as shown in fig. 10, at this time, the first terminal obtains the first content through the connection and displays the first content.
Similarly, a virtual window for the second terminal may be set on the first terminal, and when the operation of moving the fourth content currently displayed in the first terminal to the virtual window is obtained on the first terminal, the second terminal obtains the fourth content through connection and displays the fourth content, thereby implementing bidirectional screen projection of the first terminal and the second terminal.
Here, the virtual window in the first terminal or the second terminal may be understood as a specific area set between the first terminal and the second terminal, and if a mouse drags the content to the specific area in the terminal, it is considered that the content needs to be displayed on the other terminal by a screen.
It should be noted that, the above virtual window may be provided with a hidden mode and a display mode, when a screen is required to be projected, the virtual window may be displayed on the desktop by setting a transparency parameter in an overlaid manner, for example, by setting a transparency parameter, the virtual window presents a semi-transparent or non-transparent display effect on the desktop, and when the screen is not required to be projected, the virtual window may be configured to be hidden under the desktop.
In connection with the above embodiments, the two-way screen projection mode between two personal computers PC (personal computer)1 and PC2 is illustrated as follows:
firstly, the PC1 and the PC2 can be connected through Bluetooth or wifi pairing;
after the PC1 and the PC2 are successfully paired, the PC1 and the PC2 still respectively display their desktop contents, simulate a video card driver, and construct respective virtual expansion screens S1 and S2, which can be displayed on the desktop in a virtual window manner.
Then, when the PC1 drags the application a1(PC1 APP) to the virtual expansion S1, the PC1 starts continuously sending the display data and the mouse control data of the application a1 on S1 to the PC 2.
Thereafter, the PC2 receives display data of the application a1, and creates a window a2 of the same size, displaying the a1 in the window a 2.
Meanwhile, the PC2 receives mouse control data of the PC1, and realizes content synchronization of a1 in a 2. Whereas if the mouse is found in the PC2 dragging the application b2(PC2 APP) of the PC2 onto the virtual expansion screen S2, a window b1 is constructed in the PC1, and b2 content is displayed in the window b1, as shown in fig. 11, similarly to the above process.
Therefore, the two-way expansion screen and mouse control can be realized in the embodiment, the windows of the two computers can be dragged to the screen of the other computer for display and operation, the function of cross-screen sharing is enhanced, the use experience of a user is improved, and the use efficiency of the user on the computers is further improved.
The method is described in detail in the embodiments disclosed in the present application, and the method of the present application can be implemented by various types of apparatuses, so that an apparatus is also disclosed in the present application, and the following detailed description is given of specific embodiments.
Referring to fig. 12, a schematic structural diagram of a display control apparatus according to a second embodiment of the present disclosure is provided, where the apparatus may be disposed in a terminal or a device having a display output area, such as a terminal having a display screen, a mobile phone, a pad, or a server. The device in the embodiment is mainly used for performing display control of bidirectional screen projection between the current terminal and other terminals.
Specifically, the apparatus in this embodiment may include the following functional units:
a sending unit 1201, configured to send the first information to the second terminal through the connection between the first terminal and the second terminal.
The first information is displayed on a desktop of the second terminal and can be used for representing input control information of the first terminal. For example, the first information may be information related to a control, such as control information or mouse information, and includes at least one of display size information, display position information, appearance posture information, and the like of a control, such as a cursor or a mouse. The input control information of the first terminal characterized by the first information may be understood as: the first terminal inputs control (first operation) related information, such as region selection, position clicking or object dragging, on the desktop of the second terminal through a mouse.
It should be noted that the connection between the first terminal and the second terminal may be implemented by a bluetooth connection between the first terminal and the second terminal, or may be implemented by a communication network, such as a WiFi, a local area network, a zigbee, or a mobile communication network.
And the first information is displayed on the desktop of the second terminal, which can be understood as: the first information is displayed in any area on the desktop of the second terminal, or the first information is displayed in a specific area on the desktop of the second terminal for the first terminal, and so on.
An obtaining unit 1202, configured to obtain, through the connection, first content currently displayed by the second terminal in response to a first operation.
The first content is a content pointed by input control (first operation) information of the first terminal, and the first content is a part or all of currently displayed content of the second terminal, for example, the first content is desktop content of the second terminal, or the first content is specific window content or specific application, icon, file, or the like on a desktop of the second terminal.
It should be noted that the first operation may be understood as an input control operation of the first information (a control such as a mouse) on the desktop of the second terminal, for example, an operation of selecting, clicking, dragging, and the like of the control such as a mouse or a cursor on the desktop of the second terminal.
Accordingly, at least a part of the content currently displayed by the second terminal forms the first content under the first operation, and the first content on the second terminal is obtained through the connection between the first terminal and the second terminal at the first terminal. That is, after the first terminal transmits and displays the first information to the second terminal, the second terminal can generate and transmit the first content to the first terminal, and the first content may also be a media stream formed by screen capture.
A display unit 1203, configured to display the first content on a desktop of the first terminal;
in this embodiment, the displaying of the first content on the desktop of the first terminal may be understood as: the first content is displayed in an arbitrary area on the desktop of the first terminal, or the first content is displayed in a specific area on the desktop of the first terminal for the second terminal, and so on.
In view of the above, in the display control apparatus provided in the second embodiment of the present application, the first information is sent to the second terminal through the connection between the first terminal and the second terminal and is displayed on the desktop of the second terminal, and then the first content currently displayed on the second terminal is obtained through the connection in response to the first operation and is displayed on the desktop of the first terminal. It can be seen that, in this embodiment, after the connection between the terminal and the other terminal is established, the control information is sent to the other terminal through the connection between the terminals and is displayed, and then the first content currently displayed by the other terminal can be obtained under the control of the control information and is displayed on the current terminal, so that the output control between the terminals can be freely performed, thereby enriching the screen projection mode and significantly improving the user experience of the user on the terminal.
In an implementation manner, the obtaining unit 1202 may specifically implement the following steps in obtaining the first content currently displayed by the second terminal through the connection:
and responding to the operation of moving the first content currently displayed by the second terminal to the desktop of the first terminal, and obtaining the first content currently displayed by the second terminal through the connection, wherein the first content comprises display data and/or control data.
In addition, the sending unit 1201 in this embodiment may also be configured to:
responding to a second operation, sending second information to the second terminal through the connection, wherein the second information is used for displaying second content on a desktop of the second terminal;
the obtaining unit 1202 in this embodiment may be further configured to obtain third information based on the connection, where the third information is used to display third content on the first terminal; the second content is from the first terminal, the third content is from the second terminal, the second content is the same as or different from the third content, the third information includes information obtained by the second terminal processing the second content, and the second information includes information obtained by the first terminal processing the third content.
Specifically, the sending unit 1201 may be configured to send, in response to an operation of moving the second content in the desktop of the first terminal to the second terminal, the second content to the second terminal through the connection, where the second content includes display data and/or control data; alternatively, the transmitting unit 1201 may be configured to transmit data information resulting from processing the second content to the second terminal through the connection in response to an operation of processing the second content.
Specifically, the obtaining unit 1202 may be configured to, in a case where the second terminal processes a second content displayed on a desktop of the second terminal, obtain data information generated by processing the second content based on the connection; alternatively, the obtaining unit 1202 may be configured to, in a case where the first terminal processes the second content displayed on the desktop of the second terminal, obtain data information generated by processing the second content based on the connection.
In one implementation, the first terminal has a first display output area, and the third content is configured to be displayed in the first display output area; when the first terminal is in a first mode, the first display output area is a desktop of the first terminal; and when the first terminal is in the second mode, the desktop of the first terminal is a part of the first display output area.
In one implementation, the second terminal has a second display output area, and the second content is configured to be displayed in the second display output area; when the second terminal is in a first mode, the second display output area is a desktop of the second terminal; the second terminal is in a second mode, and the desktop of the second terminal is a part of the second display output area; and the first display output area and the second display output area are the same or different.
In addition, a window area associated with the second terminal is arranged on the desktop of the first terminal; wherein the first content is configured to be displayed in the window area.
It should be noted that, for the specific implementation of each functional unit in the apparatus in the present embodiment, reference may be made to the corresponding content in the foregoing, and details are not described here.
Referring to fig. 13, a schematic structural diagram of a terminal according to a third embodiment of the present disclosure is provided, where the terminal may be a terminal or a device having a display output area as a first terminal, such as a computer, a mobile phone, a pad, or a server having a display screen. The terminal in this embodiment is mainly used for performing display control of bidirectional screen projection with other terminals.
Specifically, the first terminal in this embodiment may include the following structure:
a display 1301 for displaying content;
a processor 1302, configured to send first information to a second terminal through a connection between the first terminal and the second terminal, where the first information is displayed on a desktop of the second terminal, and the first information is used to represent input control information of the first terminal; responding to a first operation, and obtaining first content currently displayed by the second terminal through the connection; displaying the first content on a desktop of the display 1301;
the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal.
According to the scheme, the third terminal provided by the embodiment of the application sends the first information to the second terminal through the connection with the second terminal and displays the first information on the desktop of the second terminal, and then obtains the first content currently displayed by the second terminal through the connection in response to the first operation and displays the first content on the desktop of the first terminal. It can be seen that, in this embodiment, after the connection between the terminal and the other terminals is established, the control information is sent to the other terminals through the connection between the terminals and is displayed, and then the first content currently displayed by the other terminals can be obtained under the control of the control information and is displayed on the current terminal, so that the output control between the terminals can be freely performed, thereby enriching the screen projection mode and significantly improving the user experience of the user on the terminal.
It should be noted that, the specific implementation of the processor in the terminal in the present embodiment may refer to the corresponding content in the foregoing, and is not described in detail here.
It should be noted that, in this specification, each embodiment is described in a progressive manner, and each embodiment focuses on differences from other embodiments, and portions that are the same as and similar to each other in each embodiment may be referred to. For the device or system type embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A display control method comprising:
sending first information to a second terminal through connection between the first terminal and the second terminal, wherein the first information is displayed on a desktop of the second terminal and is used for representing input control information of the first terminal;
responding to a first operation, and obtaining currently displayed first content sent by the second terminal through the connection;
displaying the first content on a desktop of the first terminal;
the first terminal can send information obtained by processing the first content to the second terminal so that the second terminal can perform the same processing on the content corresponding to the first content; the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal; the first content comprises display data and/or control data.
2. The method according to claim 1, wherein the obtaining of the first content currently displayed by the second terminal through the connection in response to the first operation comprises:
and responding to the operation of moving the first content currently displayed by the second terminal to the desktop of the first terminal, and obtaining the first content currently displayed by the second terminal through the connection.
3. The method of claim 1, further comprising at least one of:
responding to a second operation, sending second information to the second terminal through the connection, wherein the second information is used for displaying second content on a desktop of the second terminal;
obtaining third information based on the connection, the third information being used for displaying third content at the first terminal;
the second content is from the first terminal, the third content is from the second terminal, the second content is the same as or different from the third content, the third information includes information obtained by the second terminal processing the second content, and the second information includes information obtained by the first terminal processing the third content.
4. The method of claim 3, wherein said sending second information to the second terminal over the connection in response to the second operation comprises:
responding to the operation of moving the second content in the desktop of the first terminal to the second terminal, and sending the second content to the second terminal through the connection, wherein the second content comprises display data and/or control data;
or the like, or, alternatively,
and responding to the operation of processing the second content, and sending data information generated by processing the second content to the second terminal through the connection.
5. The method of claim 3, the obtaining third information based on the connection, comprising:
under the condition that the second terminal processes second content displayed on a desktop of the second terminal, obtaining data information generated by processing the second content based on the connection;
or the like, or a combination thereof,
and under the condition that the first terminal processes second content displayed on the desktop of the second terminal, obtaining data information generated by processing the second content based on the connection.
6. The method of claim 3, the first terminal having a first display output area, the third content configured to be displayed at the first display output area;
when the first terminal is in a first mode, the first display output area is a desktop of the first terminal;
and when the first terminal is in the second mode, the desktop of the first terminal is a part of the first display output area.
7. The method of claim 6, the second terminal having a second display output area, the second content configured to be displayed at the second display output area;
when the second terminal is in a first mode, the second display output area is a desktop of the second terminal;
the second terminal is in a second mode, and the desktop of the second terminal is a part of the second display output area; and the first display output area and the second display output area are the same or different.
8. The method of claim 1, a window area associated with the second terminal being provided on a desktop of the first terminal;
wherein the first content is configured to be displayed in the window area.
9. A display control apparatus comprising:
the device comprises a sending unit, a receiving unit and a sending unit, wherein the sending unit is used for sending first information to a second terminal through connection between the first terminal and the second terminal, the first information is displayed on a desktop of the second terminal, and the first information is used for representing input control information of the first terminal;
an obtaining unit, configured to obtain, in response to a first operation, currently displayed first content sent by the second terminal through the connection;
the display unit is used for displaying the first content on a desktop of the first terminal;
the first terminal can send information obtained by processing the first content to the second terminal so that the second terminal can perform the same processing on the content corresponding to the first content; the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal; the first content comprises display data and/or control data.
10. A terminal, the terminal comprising as a first terminal:
a display;
the processor is used for sending first information to the second terminal through the connection between the first terminal and the second terminal, the first information is displayed on a desktop of the second terminal, and the first information is used for representing input control information of the first terminal; responding to a first operation, and obtaining currently displayed first content sent by the second terminal through the connection; displaying the first content on a desktop of the display;
the first terminal can send information obtained by processing the first content to the second terminal so that the second terminal can perform the same processing on the content corresponding to the first content; the first content is the content pointed by the input control information of the first terminal, and the first content is part or all of the content currently displayed by the second terminal; the first content comprises display data and/or control data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910823343.0A CN110515580B (en) | 2019-09-02 | 2019-09-02 | Display control method, device and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910823343.0A CN110515580B (en) | 2019-09-02 | 2019-09-02 | Display control method, device and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110515580A CN110515580A (en) | 2019-11-29 |
| CN110515580B true CN110515580B (en) | 2022-08-19 |
Family
ID=68630341
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910823343.0A Active CN110515580B (en) | 2019-09-02 | 2019-09-02 | Display control method, device and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110515580B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111158543B (en) * | 2019-12-24 | 2023-10-24 | 华为技术有限公司 | File processing method, electronic equipment, system and storage medium |
| CN111221491A (en) * | 2020-01-09 | 2020-06-02 | Oppo（重庆）智能科技有限公司 | Interaction control method and device, electronic equipment and storage medium |
| CN111880757A (en) * | 2020-06-30 | 2020-11-03 | 北京小米移动软件有限公司 | Screen projection method, screen projection device and storage medium |
| CN111970546A (en) * | 2020-07-21 | 2020-11-20 | 腾讯科技（深圳）有限公司 | Method and device for controlling terminal interaction, electronic equipment and storage medium |
| CN114442969B (en) * | 2020-10-30 | 2024-06-18 | 华为技术有限公司 | Inter-equipment screen collaboration method and equipment |
| CN115016685A (en) * | 2022-05-23 | 2022-09-06 | Oppo广东移动通信有限公司 | Display control method and device, wearable device and storage medium |
| CN115599255A (en) * | 2022-12-16 | 2023-01-13 | 深圳蓝普视讯科技有限公司（Cn） | Large-screen visual intelligent interactive data processing method and device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354639A (en) * | 2007-07-25 | 2009-01-28 | 联想(北京)有限公司 | Method and terminal for operating object between terminals |
| CN101937315A (en) * | 2010-06-29 | 2011-01-05 | 上海复创计算机信息技术有限公司 | Multi-screen display operation control system and method |
| CN105159537A (en) * | 2015-09-09 | 2015-12-16 | 西南大学 | Multiscreen-based real-time independent interaction system |
| CN107463267A (en) * | 2016-06-03 | 2017-12-12 | 罗技欧洲公司 | The automatic application that more main frames are enabled in the system of flowing starts |
| CN109343810A (en) * | 2018-09-30 | 2019-02-15 | 北京淳中科技股份有限公司 | Control switching method, device and KVM switch |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101447998B (en) * | 2008-12-25 | 2012-07-11 | 广东威创视讯科技股份有限公司 | Desktop sharing method and system |
| JP5472346B2 (en) * | 2012-03-14 | 2014-04-16 | コニカミノルタ株式会社 | Information processing system, user terminal device, information processing device, and program |
| CN106331287A (en) * | 2015-06-24 | 2017-01-11 | 中兴通讯股份有限公司 | Synchronization method and device for terminal screen contents |
| CN104915173A (en) * | 2015-06-29 | 2015-09-16 | 惠州华阳通用电子有限公司 | Method for controlling interaction of double screens |
| CN105430600B (en) * | 2015-11-05 | 2019-03-01 | 魅族科技（中国）有限公司 | A kind of data transmission method and the terminal of data transmission |
| CN106293583B (en) * | 2016-08-03 | 2019-10-11 | 广东威创视讯科技股份有限公司 | Desktop window sharing method and system |
| CN107977139A (en) * | 2016-10-25 | 2018-05-01 | 福州瑞芯微电子股份有限公司 | Screen interaction, the method and system of screen content processing between mobile terminal |
| CN106970467B (en) * | 2017-03-28 | 2020-03-24 | 联想(北京)有限公司 | Information display method and head-mounted display equipment |
| CN107291411B (en) * | 2017-05-19 | 2019-01-29 | 广州视源电子科技股份有限公司 | The method, apparatus and storage medium of information sharing in wireless screen transmission |
| CN108401463A (en) * | 2017-08-11 | 2018-08-14 | 深圳前海达闼云端智能科技有限公司 | Virtual display device, intelligent interaction method and cloud server |
| CN109118847A (en) * | 2018-07-20 | 2019-01-01 | 深圳点猫科技有限公司 | A kind of the classroom interaction throwing screen method and electronic equipment of Linux system level |
| CN109189356A (en) * | 2018-08-28 | 2019-01-11 | 万得信息技术股份有限公司 | A kind of multiple terminals roller blind system and method |
| CN110134356A (en) * | 2019-04-29 | 2019-08-16 | 维沃移动通信有限公司 | A kind of throwing screen method and terminal |
-
2019
- 2019-09-02 CN CN201910823343.0A patent/CN110515580B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101354639A (en) * | 2007-07-25 | 2009-01-28 | 联想(北京)有限公司 | Method and terminal for operating object between terminals |
| CN101937315A (en) * | 2010-06-29 | 2011-01-05 | 上海复创计算机信息技术有限公司 | Multi-screen display operation control system and method |
| CN105159537A (en) * | 2015-09-09 | 2015-12-16 | 西南大学 | Multiscreen-based real-time independent interaction system |
| CN107463267A (en) * | 2016-06-03 | 2017-12-12 | 罗技欧洲公司 | The automatic application that more main frames are enabled in the system of flowing starts |
| CN109343810A (en) * | 2018-09-30 | 2019-02-15 | 北京淳中科技股份有限公司 | Control switching method, device and KVM switch |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110515580A (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110515580B (en) | Display control method, device and terminal | |
| CN106484224B (en) | A kind of operating method and terminal | |
| US9608944B2 (en) | Information processing apparatus and information processing method | |
| RU2700188C2 (en) | Representing computing environment on multiple devices | |
| CN107704177A (en) | interface display method, device and terminal | |
| WO2018040943A1 (en) | Display data control method, device, and system | |
| CN107077348B (en) | Segmented application rendering across devices | |
| CN113286191B (en) | Content collaboration method, device, electronic equipment and storage medium | |
| CN113741765B (en) | Page jump method, device, equipment, storage medium and program product | |
| KR20130042010A (en) | Environment-dependent dynamic range control for gesture recognition | |
| CN107728885A (en) | Control method, device, mobile terminal and the storage medium of multitask | |
| US20140032699A1 (en) | Remote user interface in a terminal server environment | |
| JP2007522546A (en) | Multi-screen display system | |
| WO2016164702A1 (en) | Opening new application window in response to remote resource sharing | |
| JP2018525744A (en) | Method for mutual sharing of applications and data between touch screen computers and computer program for implementing this method | |
| CN111007982B (en) | Electronic whiteboard implementation method, device and related system | |
| CN109976605B (en) | Class board content display method, device and storage medium | |
| US10645144B2 (en) | Computer-implemented method for controlling a remote device with a local device | |
| CN106502496B (en) | Window switching method and device | |
| CN115865852A (en) | Instant messaging session information processing method and device and electronic equipment | |
| CN114895862A (en) | Screen projection method, device and equipment of intelligent terminal | |
| CN115373558A (en) | Screen projection method, device, equipment and storage medium | |
| JP6954045B2 (en) | Image processing system, user interface provision method, and computer program | |
| JP6591132B2 (en) | Content sharing system, content sharing method and program | |
| JP6596616B2 (en) | Content sharing system, content sharing method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |