CN110597474B - Information processing method and electronic equipment - Google Patents

Information processing method and electronic equipment Download PDF

Info

Publication number
CN110597474B
CN110597474B CN201910870232.5A CN201910870232A CN110597474B CN 110597474 B CN110597474 B CN 110597474B CN 201910870232 A CN201910870232 A CN 201910870232A CN 110597474 B CN110597474 B CN 110597474B
Authority
CN
China
Prior art keywords
information
input information
control instruction
display
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910870232.5A
Other languages
Chinese (zh)
Other versions
CN110597474A (en
Inventor
赵蕊
曹越
孙堯
宋丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201910870232.5A priority Critical patent/CN110597474B/en
Publication of CN110597474A publication Critical patent/CN110597474A/en
Priority to US17/018,832 priority patent/US11349976B2/en
Application granted granted Critical
Publication of CN110597474B publication Critical patent/CN110597474B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The present disclosure provides an information processing method, including: after establishing communication connection with the mobile terminal, receiving display data through a first transmission channel, wherein the display data are display data of a screen of the mobile terminal; presenting a display picture of display data in a first display area; obtaining first input information and second input information; converting the second input information into a control instruction; and determining a response object of the control instruction based on the first input information. If the first input information is located in the first display area, converting the first input information into first conversion information; sending the first conversion information and the control instruction through a second transmission channel so that the mobile terminal responds to the control instruction based on the first conversion information; and responding to the control command based on the first input information if the first input information is located in a second display area except the first display area. The present disclosure also provides an electronic device.

Description

Information processing method and electronic equipment
Technical Field
The disclosure relates to an information processing method and an electronic device.
Background
With the development of network technology, the frequency of using mobile phones by people is higher and higher. In order to meet the requirement of users for displaying the content of the mobile phone to others, a screen projection technology of electronic equipment for projecting the picture of the mobile phone to a large display screen is developed.
In the prior art, when a computer terminal operates a screen projection interface of a mobile phone, a mouse is basically used for simulating an existing interactive gesture of the mobile phone, and the simulated gesture is sent to the mobile phone and then is executed by the mobile phone, so that the screen projection interface is operated. However, some existing interaction gestures of the mobile phone are difficult to simulate on the mouse side (for example, all contents of a selected page, characters and the like) and are often realized only by complex mouse click operations. Therefore, the existing screen projection technology brings poor experience to users.
Disclosure of Invention
One aspect of the present invention provides an information processing method, including: after establishing communication connection with the mobile terminal, receiving display data through a first transmission channel, wherein the display data are display data of a screen of the mobile terminal; presenting a display picture of display data in a first display area; obtaining first input information and second input information; converting the second input information into a control instruction; and determining a response object of the control instruction based on the first input information. If the first input information is located in the first display area, converting the first input information into conversion information; transmitting the conversion information and the control instruction through a second transmission channel so that the mobile terminal responds to the control instruction based on the conversion information; and responding to the control command based on the first input information if the first input information is located in a second display area except the first display area.
Optionally, the information processing method further includes: update display data is received such that the display screen within the first display region is replaced based on the update display data. And updating the display data to be the changed display data of the screen of the mobile terminal when the mobile terminal responds to the control instruction based on the first conversion information.
Optionally, the first input information is coordinate information, and the second input information is trigger information generated when at least one key is triggered.
Optionally, the trigger information is trigger information generated when a button of the mouse is triggered; and/or the triggering information is triggering information generated when the keys of the keyboard are triggered.
Optionally, the converting the second input information into the control instruction includes: and determining a control instruction corresponding to the second input information based on the instruction mapping table.
Another aspect of the present disclosure provides an electronic device including an operating system and a screen projection function. The screen projection function is a functional module of an operating system, or the screen projection function is an application program with the screen projection function installed based on the operating system; the screen projection function comprises: the data receiving and sending unit is used for receiving display data through the first transmission channel after the electronic equipment establishes communication connection with the mobile terminal, wherein the display data are display data of a screen of the mobile terminal; a display control unit for presenting a display screen of display data in the first display area; an information acquisition unit for acquiring first input information and second input information; the information conversion unit is used for converting the second input information into a control instruction; and a determination unit configured to determine a response object of the control instruction based on the first input information. The information conversion unit is also used for converting the first input information into conversion information if the first input information is positioned in the first display area; the information transceiving unit is also used for sending the conversion information and the control instruction through the second transmission channel so that the mobile terminal responds to the control instruction based on the conversion information. The screen projection function further comprises a response unit, and the response unit is used for responding to the control instruction based on the first input information if the first input information is located in a second display area except the first display area.
Optionally, the data transceiver unit is further configured to: update display data is received such that the display screen within the first display region is replaced based on the update display data. And updating the display data to be the changed display data of the screen of the mobile terminal when the mobile terminal responds to the control instruction based on the first conversion information.
Optionally, the first input information is coordinate information, and the second input information is trigger information generated when at least one key is triggered.
Optionally, the information conversion unit is configured to determine, based on the instruction mapping table, a control instruction corresponding to the second input information.
Another aspect of the present disclosure provides an electronic device including a display; one or more memories having stored thereon computer-executable instructions; and one or more processors for executing the above-described information processing method based on computer-executable instructions.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause the processor to perform the above-described information processing method.
Another aspect of the present disclosure provides a computer program comprising computer executable instructions for implementing the information processing method as described above when executed.
Drawings
For a more complete understanding of the present disclosure and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
fig. 1 schematically illustrates an application scenario diagram of an information processing method and an electronic device according to an embodiment of the present disclosure;
fig. 2 schematically shows a flow chart of an information processing method according to a first exemplary embodiment of the present disclosure;
fig. 3 schematically shows a flow chart of an information processing method according to an exemplary embodiment two of the present disclosure;
fig. 4 schematically shows a flow chart of an information processing method according to a third exemplary embodiment of the present disclosure;
fig. 5 is a diagram schematically showing updating of a screen of a first display area by the information processing method described in fig. 4;
FIG. 6A schematically illustrates a block diagram of an electronic device according to an embodiment of the present disclosure;
FIG. 6B schematically illustrates a block diagram of a screen projection function according to an embodiment of the disclosure; and
fig. 7 schematically shows a block diagram of an electronic device adapted to perform an information processing method according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
Some block diagrams and/or flow diagrams are shown in the figures. It will be understood that some blocks of the block diagrams and/or flowchart illustrations, or combinations thereof, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which execute via the processor, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks. The techniques of this disclosure may be implemented in hardware and/or software (including firmware, microcode, etc.). In addition, the techniques of this disclosure may take the form of a computer program product on a computer-readable storage medium having instructions stored thereon for use by or in connection with an instruction execution system.
An embodiment of the present disclosure provides an information processing method, which is performed by an electronic device, and includes: after communication connection is established with the mobile terminal, display data is received through the first transmission channel, the display data is display data of a screen of the mobile terminal, and a display picture of the display data is displayed in the first display area, so that the display picture on the mobile terminal is projected to the electronic equipment. Then, the first input information and the second input information are obtained, and the second input information is converted into a control command. And finally, determining a response object of the control instruction based on the first input information so as to respond to the control execution. If the first input information is located in the first display area, converting the first input information into conversion information; and transmitting the conversion information and the control instruction through a second transmission channel so that the mobile terminal responds to the control instruction based on the conversion information. And responding to the control command based on the first input information if the first input information is located in a second display area except the first display area.
According to the information processing method, the response object is determined through the acquired first input information, under the condition that the response object is the mobile terminal, the first input information is converted into the conversion information matched with the mobile terminal, the second input information matched with the input logic of the electronic equipment is converted into the control instruction, the conversion information and the control instruction are sent to the mobile terminal, and the mobile terminal responds to the control instruction based on the conversion information, so that the effect of operating a screen projection interface of the mobile phone in an interactive mode of the electronic equipment can be achieved. Therefore, the defect that the screen projection interface of the mobile phone can be operated only by adopting complex operation at one end of the electronic equipment can be avoided, and the user experience is improved.
Fig. 1 schematically illustrates an application scenario 100 of an information processing method and an electronic device according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, an application scenario 100 of an embodiment of the present disclosure may include an electronic device 110 and a mobile terminal 120.
The electronic device 110 may be a terminal device such as a desktop computer, a notebook computer, a smart television, and a tablet. Similarly, the mobile terminal 120 may be, for example, a portable terminal such as a mobile phone, a tablet, or the like. The electronic device 110 and the mobile terminal 120 may communicate through a connection channel, for example. The connection channel may be, for example, a wifi direct connection channel, a networking connection channel, or a connection channel established through the network 130 shown in fig. 1. Network 130 may include, among other things, various connection types such as wired and/or wireless communication links, and so forth.
According to the embodiment of the present disclosure, the mobile terminal 120 may send the display data to the electronic device 110 through the connection channel, for example, so that the electronic device 110 displays a display screen corresponding to the display data of the mobile terminal 120, where the display data may be obtained by compressing the display screen currently displayed on the display screen of the mobile terminal 120, for example.
In an initial stage, the electronic device 110 and the mobile terminal 120 may establish a connection in a low power consumption manner, for example, to know the presence of each other in the surrounding environment. The Low power mode may be, for example, a Bluetooth Low Energy (BLE) channel. The establishment of the low power consumption connection may for example comprise: the electronic device 110 and the mobile terminal 120 each broadcast device information of their own device, which may include, for example, a bluetooth address, a wifi address, a device model name, etc., and know the existence of the other according to the broadcasted device information.
After the electronic device 110 establishes the low power consumption connection with the mobile terminal 120, the electronic device 110 may create a connection channel so that the mobile terminal 120 may transmit the image frames to the electronic device 110 through the connection channel. The connection channel may be established by the electronic device 110 by, for example: whether the mobile terminal 120 and the electronic device 110 are located in the same local area network is determined according to the SSID and the BSSID sent by the mobile terminal 120, and if the mobile terminal 120 and the electronic device 110 are located in the same local area network, a TCP connection is established with the mobile terminal 120. If the mobile terminal is located in a different local area network, a P2P group is created, and the connection with the mobile terminal 120 is established in a networking manner.
After the connection channel is established between the electronic device 110 and the mobile terminal 120, the transmission of the display data and the control instruction may be performed, so as to display the display screen of the mobile terminal 120 in the first display area 111 of the display screen of the electronic device 110 by projecting the screen, and control the mobile terminal 120 to change the display screen according to the input information obtained by the electronic device 110. Here, the position of the first display area 111 on the display screen of the electronic device 110 is merely an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.
According to embodiments of the present disclosure, display data and control instructions may be transmitted, for example, through a data transmission sub-channel and an instruction transmission sub-channel, respectively, to distinguish the transmission of different types of data. Alternatively, the display data and the control command can be transmitted through the same transmission sub-channel.
It is understood that the information processing method of the embodiment of the present disclosure may be executed by the electronic device 110, for example. Accordingly, the electronic device provided by the embodiments of the present disclosure may be the electronic device 110.
It should be understood that the types of electronic device 110, mobile terminal 120, and network 130 described above are merely illustrative. There may be any type of electronic device 110, mobile terminal 120, and network 130, as the implementation requires.
An information processing method according to an exemplary embodiment of the present disclosure is described below with reference to fig. 2 to 5 in conjunction with an application scenario of fig. 1.
Fig. 2 schematically shows a flowchart of an information processing method according to a first exemplary embodiment of the present disclosure.
As shown in fig. 2, the information processing method of the embodiment of the present disclosure may include operations S210 to S250, which may be performed by the electronic device 110, for example.
In operation S210, display data is received through a first transmission channel after a communication connection is established with a mobile terminal.
According to an embodiment of the present disclosure, the establishing of the communication connection may be, for example, establishing the aforementioned connection channel. The display data is display data of a screen of the mobile terminal 120, and may be, for example, a display interface displayed on the display screen of the mobile terminal 120 in real time. The display data includes image frames for the display interface, which may be dynamically updated, for example. For example, when an operation of returning to the previous interface is performed with respect to the mobile terminal 120, the display data of the mobile terminal 120 is changed from the current display interface to the previous interface, and dynamic update of the display data is realized.
According to the embodiment of the present disclosure, the first transmission channel may be, for example, the transmission channel established by the aforementioned TCP connection, or may be a dedicated data transmission channel. The mobile terminal 120 may transmit the display data to the electronic device 110 through the first transmission channel. According to an embodiment of the present disclosure, a transmission channel for TCP connection establishment may include a plurality of sub-channels, for example. The first transmission channel may be, for example, a data transmission subchannel among a plurality of subchannels.
In operation S220, a display screen displaying data is presented within a first display region.
The operation S220 may include: and after receiving the display data, decompressing the display data to form an image frame and displaying the image frame. According to an embodiment of the present disclosure, the electronic device 110 may be installed with a screen projection application, for example, and the first display area may be a display window of the screen projection application.
In operation S230, first input information and second input information are obtained.
According to the embodiment of the disclosure, the first input information may be, for example, coordinate information of a display object corresponding to an input device of the electronic device in a display screen of the electronic device, or may be coordinate information of an area covered by the display object when the display object moves, or the like. The input device may be, for example, a mouse, a keyboard, a capacitance pen, or a user's hand.
According to an embodiment of the present disclosure, the second input information may be, for example, input information generated by a user's hand, a capacitive pen, or the like touching a display screen of the electronic device. Or the second input information is trigger information generated by triggering at least one key of the input device of the electronic device. The trigger information may include, for example, trigger information generated when a key of a mouse is triggered, or may be trigger information generated when a key of a keyboard is triggered, or may be trigger information generated when a key of a mouse and a key of a keyboard are triggered simultaneously.
According to an embodiment of the present disclosure, the touching manner of the display screen of the electronic device by the hand of the user or the capacitive pen, and/or the triggering key may be performed according to the input logic of the electronic device 110, for example. The second input information thus obtained is information that logically matches the input of the electronic device. For example, if a part of the display content in the display screen is desired to be selected, the second input information may be: the display object moves in the display area of the part of the display content, and the area through which the display object moves covers the information of the display area; or when the Ctrl key in the keyboard is triggered, the left mouse key is triggered for multiple times to sequentially select the information of the multiple display contents in the first display area. If all the contents displayed on the display screen in the first display area are selected, the second input information may be information that the "Ctrl" key and the "a" key in the keyboard are simultaneously triggered. If the display screen is desired to be moved upwards, the second input information may be: a scroll wheel of a mouse is triggered to scroll down or up, or a "down-moving button" in a keyboard is triggered. It is to be understood that the second input information is only used as an example to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.
According to an embodiment of the present disclosure, the second input information may be, for example, trigger information that some keys on a keyboard of the electronic device 110 are simultaneously triggered, and may include, for example, in addition to trigger information that the "Ctrl" key and the "a" key are simultaneously triggered, at least one of the following: triggering information that the "Ctrl" key and the "C" key are simultaneously triggered, "triggering information that the" Ctrl "key and the" V "key are simultaneously triggered," triggering information that the "Ctrl" key and the "X" key are simultaneously triggered, or triggering information that a plurality of keys of the keyboard are continuously triggered, and the like. The second input information may further include, for example, trigger information that the keys of the keyboard and the mouse are triggered simultaneously, for example, in addition to that the "Ctrl" key is triggered and the left mouse key is triggered multiple times, the second input information may further include, for example: and triggering information and the like, wherein the left mouse button is triggered when the corresponding display object is positioned at two different positions while the 'Shift' key is continuously triggered. Alternatively, the second input information may also be trigger information in which a mouse button is triggered individually, for example, the trigger information may include trigger information in which a mouse wheel button is triggered by sliding down, trigger information in which a mouse left button is continuously triggered, trigger information in which a mouse left button is triggered twice in succession, trigger information in which a mouse is triggered in two different ways (for example, trigger information in which a mouse left button is first triggered, then the mouse left button is released, and then is continuously triggered), and the like.
In operation S240, the second input information is converted into a control command.
According to an embodiment of the present disclosure, the operation S240 may include, for example: according to the input logic of the electronic device, the operation that needs to be executed by the mobile device corresponding to the second input information is determined, and then the control instruction sent to the mobile terminal 120 is determined according to the operation.
According to the embodiment of the present disclosure, if the second input information is information that the keyboard key "Ctrl" key and the "a" key are simultaneously triggered, it is determined that the operation that needs to be executed by the mobile device is a full selection operation, and then it is determined that the control instruction sent to the mobile terminal 120 is an operation control instruction for controlling the mobile terminal 120 to select all contents in the display screen. For example, if the second input information is trigger information that the left mouse button is triggered first and then released, and then is triggered continuously, the operation that needs to be performed by the mobile device is determined to be an operation control instruction that the content at the position represented by the position information when the left mouse button is triggered first is moved. Or, according to the second input information, determining that the operation that needs to be performed by the mobile device may further include inputting an operation control instruction of a character string or the like in an input box at the position represented by the position information, and the like.
According to the embodiment of the disclosure, when the second input information is the trigger information that the left mouse button is firstly triggered and then released and then continuously triggered, and the position represented by the position information included in the first input information is moved from the first display area to another display area, and the display content at the initial position is a file, the determined control instruction may also be an operation control instruction for sending the file at the initial position to the electronic device.
According to an embodiment of the present disclosure, in order to facilitate determining the control command, the electronic device 110 may, for example, store a command mapping table in advance, where a corresponding relationship between the second input information and the control command is established in the command mapping table. Operation S240 may be: based on the instruction mapping table, a control instruction corresponding to the second input information obtained in operation S230 in the instruction mapping table is determined, thereby converting the second input information into the control instruction.
In operation S250, a response object of the control instruction is determined based on the first input information.
According to an embodiment of the present disclosure, the operation S250 may be to determine whether a location represented by the location information is located within the first display area according to the location information included in the first input information. The operation S250 may be implemented by, for example, operations S351 to S353 described in fig. 3, and will not be described in detail herein.
Fig. 3 schematically shows a flowchart of an information processing method according to an exemplary embodiment two of the present disclosure.
As shown in fig. 3, operation S250 of determining a response object of the control command may include operations S351 to S353.
In operation S351, it is determined whether the first input information is located in the first display region.
According to an embodiment of the present disclosure, since the first input information may be coordinate information, the operation S351 may include: it is determined whether the coordinate location represented by the coordinate information is located in the first display region. According to an embodiment of the present disclosure, the coordinate information may be, for example, coordinate values characterizing the display object in a first coordinate system established based on the display screen of the electronic device 110. The operation S351 may include: the coordinate range of the first display area in the first coordinate system is determined, and then whether the coordinate value represented by the coordinate information is located in the coordinate range is judged.
And if the coordinate value represented by the coordinate information is located in the coordinate range, judging that the obtained first input information is located in the first display area. In this case, it can be determined that the position of the display object of the input device is the first display area, and it can be determined that the user needs to operate the display screen of the first display area. Considering that the electronic device cannot operate the screen projection interface, it may be determined that a response object of the control instruction is the mobile terminal 120, that is, operation S352 is performed.
According to the disclosed embodiment, when it is determined that the response object of the control instruction is the mobile terminal, in order to cause the mobile terminal to change the display screen, as shown in fig. 3, the information processing method of the disclosed embodiment further includes operations S360 to S370. The operations S360 to S370 are performed after the operation S352.
In operation S360, the first input information is converted into conversion information.
According to an embodiment of the present disclosure, in consideration that the first input information may be coordinate information, the coordinate information may be coordinate values characterizing the display object in a first coordinate system established based on the display screen of the electronic device 110. In order to facilitate the mobile terminal 120 to determine an operation object in the display screen to which the first input information is directed, the first input information may be converted through operation S360.
Accordingly, operation S360 may include: the coordinate values represented by the coordinate information of the first input information are converted into coordinate values of a second coordinate system established based on the first display region 111, and the obtained conversion information is, for example, the converted coordinate values based on the second coordinate system. The size of the first display region 111 may be, for example, equal to the size of the display screen of the mobile terminal 120.
In operation S370, the conversion information and the control instruction are transmitted through the second transmission channel.
According to an embodiment of the present disclosure, the second transmission channel may be, for example, the aforementioned transmission channel for TCP connection establishment, or may be a dedicated control instruction transmission channel. According to an embodiment of the present disclosure, a transmission channel for TCP connection establishment may include a plurality of sub-channels, for example. The second transmission channel may be, for example, an instruction transmission subchannel among a plurality of subchannels. According to an embodiment of the present disclosure, the second transmission channel and the first transmission channel may also be the same transmission channel, for example.
After passing the conversion information and the control command through the second transmission channel, the mobile terminal 120 may receive the conversion information and the control command through the second transmission channel. According to the conversion information, the mobile terminal 120 may locate the content that the user needs to operate in the display screen and then operate the content that needs to be operated by responding to the control instruction, thereby changing the display screen. When the control instruction is an operation control instruction for sending a file to the electronic device, the mobile terminal 120 may send the file to the electronic device 110 through any one of the first transmission channel and the connection channel.
And if the coordinate value represented by the coordinate information is not located in the coordinate range, judging that the obtained first input information is not located in the first display area but located in a second display area except the first display area. In this case, it is possible to determine that the position of the display object of the input device is not within the first display area, and thus it is determined that the user needs to operate a screen other than the screen for projection in the electronic device. Accordingly, it may be determined that the response object of the control instruction is the electronic device 110, i.e., operation S353 is performed. The second display area is any area of the display screen of the electronic device 110 except for the first display area.
In order to facilitate the electronic device to respond to the control instruction according to the embodiment of the present disclosure, as shown in fig. 3, the information processing method of the embodiment of the present disclosure further includes an operation S380 of responding to the control instruction based on the first input information. This operation S380 may include, for example: the content which needs to be operated by the user is determined according to the first input information, and then the content which needs to be operated by the user is operated according to the control instruction.
According to an embodiment of the present disclosure, after the display screen is changed, in order to ensure that the electronic device 110 synchronously changes the display screen of the screen projection, the mobile terminal 120 may further compress the image frames of the display screen updated in real time, and compress the image frames to obtain updated display data. The updated display data is then sent to the electronic device 110, so that the electronic device 110 updates the display screen of the first display area. The mobile terminal 120 may transmit the updated display data through the first transmission channel, for example.
Fig. 4 schematically shows a flowchart of an information processing method according to a third exemplary embodiment of the present disclosure, and fig. 5 schematically shows a diagram of updating a screen of a first display area by the information processing method described in fig. 4.
As shown in fig. 4, the information processing method according to the embodiment of the present disclosure may further include operation S490 in addition to operations S360 to S370 after determining that the response object is the mobile terminal 120.
In operation S490, update display data is received such that a display screen within the first display area is replaced based on the update display data.
The updated display data is the updated display data sent by the mobile terminal 120 through the first transmission channel. Replacing the display screen within the first display area based on the updated display data may include, for example: an updated display screen is obtained according to the updated display data in a manner similar to operation S220, and then the updated display screen is displayed in the first display area, thereby overlaying the previous display screen.
According to the embodiment of the disclosure, as shown in fig. 5, in the initial state, the mobile terminal 120 displays the display screen 121, and through the first transmission channel established between the mobile terminal 120 and the electronic device 110, the mobile terminal 120 may transmit the display data obtained according to the display screen 121 to the electronic device 110, so that the electronic device 110 presents the display screen 121 in the first display area. At this time, if the electronic device 110 is located in the first display area, the first input information and the second input information are obtained by simultaneously triggering the "Ctrl" key and the "a" key of the keyboard, where the first input information is coordinate information of the cursor, and the second input information is simultaneously triggered by the "Ctrl" key and the "a" key of the keyboard. A control command is obtained through operations S240 to S250, and a response object of the control command is determined to be the mobile terminal 120, where the control command may be, for example, an operation control command for content full selection. At this time, operations S360 to S370 may be performed to send the conversion information and the control instruction to the mobile terminal 120 through the second transmission channel, and after receiving the conversion information and the control instruction, the mobile terminal 120 may select all the contents in the display screen 121 by responding to the control instruction, so as to obtain the display screen 122, that is, the display screen with the shadow in the contents in the display screen 121. At this time, the mobile terminal 120 may obtain the updated display data according to the display screen 122 and transmit the updated display data to the electronic device 110 through the first transmission channel. The electronic device 110 updates the display screen of the first display area according to the updated display data, specifically, replaces the display screen 121 with the display screen 122, thereby implementing synchronous update of the screen projection screen.
In summary, the information processing method according to the embodiment of the disclosure may implement, through interaction between the electronic device 110 and the mobile terminal 120, based on the input logic of the electronic device 110, change of the display screen of the mobile terminal 120, and change the screen projection interface of the electronic device 110 in time. Therefore, the defects that the simulation operation is complex and difficult to execute when the electronic device adopts the input logic based on the mobile terminal 120 for input in the prior art can be effectively avoided, and therefore, the user experience can be effectively improved.
Fig. 6A schematically shows a block diagram of an electronic device according to an embodiment of the present disclosure, and fig. 6B schematically shows a block diagram of a screen projection function according to an embodiment of the present disclosure.
As shown in fig. 6A, an electronic device 600 of an embodiment of the disclosure may include an operating system 610 and a screen projection function 620.
The screen projecting function 620 may be, for example, a functional module of the operating system 610, or the screen projecting function 620 may also be an application program with a screen projecting function installed based on the operating system 610.
According to an embodiment of the present disclosure, as shown in fig. 6A, the screen projecting function 620 may include, for example, a data transceiving unit 621, a display control unit 622, an information obtaining unit 623, an information converting unit 624, and a determining unit 625.
The data transceiving unit 621 is configured to receive the display data through the first transmission channel after the electronic device establishes a communication connection with the mobile terminal (operation S210). The display data is display data of a screen of the mobile terminal.
The display control unit 622 is configured to present a display screen of display data in the first display region (operation S220).
The information obtaining unit 623 is configured to obtain the first input information and the second input information (operation S230).
The information converting unit 624 is configured to convert the second input information into a control instruction (operation S240).
The determination unit 625 is configured to determine a response object of the control instruction based on the first input information (operation S250).
According to an embodiment of the present disclosure, if the determination unit 625 determines that the first input information is located within the first display area, it determines that the response object is the electronic device 700. In this case, the information conversion unit 624 is also configured to convert the first input information into conversion information (operation S360). The data transceiving unit 621 is further configured to transmit the conversion information and the control instruction through the second transmission channel (operation S370), so that the mobile terminal responds to the control instruction based on the conversion information.
According to an embodiment of the present disclosure, as shown in fig. 6B, the screen projecting function 620 may further include a response unit 626, configured to respond to the control instruction based on the first input information when the determination unit 626 determines that the first input information is located in the second display area except the first display area (operation S380).
According to an embodiment of the present disclosure, the data transceiving unit 621 is further configured to receive the updated display data, so that the display screen in the first display area is replaced based on the updated display data (operation S490). And updating the display data to be the changed display data of the screen of the mobile terminal when the mobile terminal responds to the control instruction based on the first conversion information.
According to an embodiment of the disclosure, the first input information is coordinate information, and the second input information is trigger information generated when at least one key is triggered.
According to the embodiment of the disclosure, the trigger information is the trigger information generated when the button of the mouse is triggered; and/or the triggering information is triggering information generated when the keys of the keyboard are triggered.
According to an embodiment of the present disclosure, the information conversion unit 624 may be configured to determine a control instruction corresponding to the second input information based on an instruction mapping table, for example.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any plurality of the operating system 610, the screen projecting function 620, the data transceiving unit 621, the display control unit 622, the information acquiring unit 623, the information converting unit 624, the determining unit 625, and the responding unit 626 may be combined into one module to be implemented, or any one of them may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the operating system 610, the screen projecting function 620, the data transceiving unit 621, the display control unit 622, the information obtaining unit 623, the information converting unit 624, the determining unit 625 and the responding unit 626 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware and firmware, or in a suitable combination of any of them. Alternatively, at least one of the operating system 610, the screen-projection function 620, the data transceiving unit 621, the display control unit 622, the information acquiring unit 623, the information converting unit 624, the determining unit 625, and the responding unit 626 may be at least partially implemented as a computer program module, which may perform a corresponding function when executed.
Fig. 7 schematically shows a block diagram of an electronic device adapted to perform an information processing method according to an embodiment of the present disclosure. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 7, electronic device 700 includes a display 710, a processor 720, and a computer-readable storage medium 730. The electronic device 700 may perform a method according to an embodiment of the present disclosure.
In particular, processor 720 may include, for example, a general purpose microprocessor, an instruction set processor and/or related chip set and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. Processor 720 may also include on-board memory for caching purposes. Processor 720 may be a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
Computer-readable storage medium 730, for example, may be a non-volatile computer-readable storage medium, specific examples including, but not limited to: magnetic storage devices, such as magnetic tape or Hard Disk Drives (HDDs); optical storage devices, such as compact disks (CD-ROMs); a memory, such as a Random Access Memory (RAM) or a flash memory; and so on.
The computer-readable storage medium 730 may comprise a computer program 731, which computer program 731 may comprise code/computer-executable instructions that, when executed by the processor 720, cause the processor 720 to perform a method according to an embodiment of the disclosure, or any variant thereof.
The computer program 731 may be configured with computer program code, for example comprising computer program modules. For example, in an example embodiment, code in the computer program 731 may include one or more program modules, including 731A, modules 731B, … …, for example. It should be noted that the division and number of modules are not fixed, and those skilled in the art may use suitable program modules or program module combinations according to actual situations, so that the processor 720 may execute the method according to the embodiment of the present disclosure or any variation thereof when the program modules are executed by the processor 720.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
While the disclosure has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents. Accordingly, the scope of the present disclosure should not be limited to the above-described embodiments, but should be defined not only by the appended claims, but also by equivalents thereof.

Claims (7)

1. An information processing method applied to an electronic device, the method comprising:
after communication connection is established with a mobile terminal, receiving display data through a first transmission channel, wherein the display data are display data of a screen of the mobile terminal;
presenting a display screen of the display data in a first display area;
obtaining first input information and second input information, wherein the first input information is coordinate information, the second input information is information logically matched with an input of the electronic equipment, and the second input information comprises at least one of the following information: triggering information generated by triggering the keys of the mouse independently, triggering information generated by triggering the keys of the keyboard independently, triggering information generated by triggering the keys of the mouse and the keyboard simultaneously, or triggering information generated by triggering a plurality of keys of the keyboard simultaneously;
converting the second input information into a control instruction; and
determining a response object of the control instruction based on the first input information;
if the first input information is located in the first display area, determining that a response object of the control instruction is the mobile terminal, and converting the first input information into conversion information so as to convert coordinate values in a first coordinate system established on the basis of a display screen of the electronic equipment and represented by the coordinate information into coordinate values in a second coordinate system established on the basis of the first display area; sending the conversion information and the control instruction through a second transmission channel so that the mobile terminal responds to the control instruction based on the conversion information;
if the first input information is located in a second display area except the first display area, determining that a response object of the control instruction is the electronic equipment, responding to the control instruction based on the first input information,
when the second input information is trigger information that a left mouse button is triggered first and then is triggered continuously, and the position represented by the first input information moves from the first display area to a second display area except the first display area, it is determined according to the second input information that the control instruction is that the content at the position where the left mouse button is triggered first moves to the position where the mouse is triggered continuously, and it is determined according to the first input information when the left mouse button is triggered that the response object is the mobile terminal, and then the control instruction is an operation of sending the content at the position where the left mouse button is triggered first to the position where the mouse is triggered continuously of the electronic device.
2. The method of claim 1, further comprising:
receiving update display data to cause replacement of a display screen within the first display region based on the update display data,
and updating the display data to be the changed display data of the screen of the mobile terminal when the mobile terminal responds to the control instruction based on the first conversion information.
3. The method of claim 1, wherein said converting the second input information into control instructions comprises:
and determining a control instruction corresponding to the second input information based on an instruction mapping table.
4. An electronic device, comprising:
an operating system;
a screen projection function, wherein the screen projection function is a functional module of the operating system, or the screen projection function is an application program with the screen projection function installed based on the operating system; the screen projection function comprises:
the data receiving and sending unit is used for receiving display data through a first transmission channel after the electronic equipment is in communication connection with the mobile terminal, wherein the display data are display data of a screen of the mobile terminal;
the display control unit is used for presenting a display picture of the display data in a first display area;
an information obtaining unit, configured to obtain first input information and second input information, where the first input information is coordinate information, the second input information is information logically matched with an input of the electronic device, and the second input information includes at least one of: triggering information generated by triggering the keys of the mouse independently, triggering information generated by triggering the keys of the keyboard independently, triggering information generated by triggering the keys of the mouse and the keyboard simultaneously, or triggering information generated by triggering a plurality of keys of the keyboard simultaneously;
the information conversion unit is used for converting the second input information into a control instruction; and
a determination unit configured to determine a response object of the control instruction based on the first input information;
if the first input information is located in the first display area, the determining unit determines that a response object of the control instruction is the mobile terminal, and the information converting unit is further configured to convert the first input information into conversion information so as to convert coordinate values in a first coordinate system established based on a display screen of the electronic device and represented by the coordinate information into coordinate values in a second coordinate system established based on the first display area; the data transceiver unit is further configured to send the conversion information and the control instruction through a second transmission channel, so that the mobile terminal responds to the control instruction based on the conversion information;
the screen projection function further comprises a response unit, if the first input information is located in a second display area except the first display area, the determination unit determines that a response object of the control instruction is the electronic equipment, the response unit responds to the control instruction based on the first input information,
when the second input information is trigger information that a left mouse button is triggered first and then is triggered continuously, and the position represented by the first input information moves from the first display area to a second display area except the first display area, the information conversion unit determines, according to the second input information, that the control instruction is that the content at the position where the left mouse button is triggered first moves to the position where the mouse is triggered continuously, the determination unit determines, according to the first input information when the left mouse button is triggered, that the response object is the mobile terminal, and then the control instruction is an operation of sending the content at the position where the left mouse button is triggered first to the position where the mouse of the electronic device is triggered continuously.
5. The device of claim 4, wherein the data transceiving unit is further to:
receiving update display data to cause replacement of a display screen within the first display region based on the update display data,
and updating the display data to be the changed display data of the screen of the mobile terminal when the mobile terminal responds to the control instruction based on the first conversion information.
6. The apparatus of claim 4, wherein:
the information conversion unit is used for determining a control instruction corresponding to the second input information based on an instruction mapping table.
7. An electronic device, the electronic device comprising:
a display;
one or more memories having stored thereon computer-executable instructions; and
one or more processors configured to: after communication connection is established with a mobile terminal, receiving display data through a first transmission channel, wherein the display data are display data of a screen of the mobile terminal; presenting a display screen of the display data in a first display area; obtaining first input information and second input information, wherein the first input information is coordinate information, the second input information is information logically matched with an input of the electronic equipment, and the second input information comprises at least one of the following information: triggering information generated by triggering the keys of the mouse independently, triggering information generated by triggering the keys of the keyboard independently, triggering information generated by triggering the keys of the mouse and the keyboard simultaneously, or triggering information generated by triggering a plurality of keys of the keyboard simultaneously; converting the second input information into a control instruction; and determining a response object of the control instruction based on the first input information; if the first input information is located in the first display area, determining that a response object of the control instruction is the mobile terminal, and converting the first input information into conversion information so as to convert coordinate values in a first coordinate system established on the basis of a display screen of the electronic equipment and represented by the coordinate information into coordinate values in a second coordinate system established on the basis of the first display area; sending the conversion information and the control instruction through a second transmission channel so that the mobile terminal responds to the control instruction based on the conversion information; if the first input information is located in a second display area except the first display area, determining that a response object of the control instruction is the electronic equipment, and responding to the control instruction based on the first input information, wherein when the second input information is trigger information that a left mouse button is triggered first and is continuously triggered, and a position represented by the first input information moves from the first display area to a second display area except the first display area, determining that the control instruction is that the content at the position where the left mouse button is triggered first moves to the position where the mouse is continuously triggered according to the second input information, and determining that the response object is the mobile terminal according to the first input information when the left mouse button is triggered, the control instruction is that the content at the position where the left mouse button is triggered first is sent to the position where the mouse of the electronic equipment is continuously triggered And (5) operating.
CN201910870232.5A 2019-09-12 2019-09-12 Information processing method and electronic equipment Active CN110597474B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910870232.5A CN110597474B (en) 2019-09-12 2019-09-12 Information processing method and electronic equipment
US17/018,832 US11349976B2 (en) 2019-09-12 2020-09-11 Information processing method, file transmission method, electronic apparatus, and computing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910870232.5A CN110597474B (en) 2019-09-12 2019-09-12 Information processing method and electronic equipment

Publications (2)

Publication Number Publication Date
CN110597474A CN110597474A (en) 2019-12-20
CN110597474B true CN110597474B (en) 2022-03-25

Family

ID=68859752

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910870232.5A Active CN110597474B (en) 2019-09-12 2019-09-12 Information processing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN110597474B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113129202B (en) * 2020-01-10 2023-05-09 华为技术有限公司 Data transmission method and device, data processing system and storage medium
CN111447598B (en) * 2020-03-23 2023-06-20 维沃移动通信有限公司 Interaction method and display device
CN111629240B (en) * 2020-05-06 2021-08-10 上海幻电信息科技有限公司 Multi-screen interactive display method and device
CN111913628B (en) * 2020-06-22 2022-05-06 维沃移动通信有限公司 Sharing method and device and electronic equipment
CN114077411A (en) * 2020-08-11 2022-02-22 华为技术有限公司 Data transmission method and device
CN112035048B (en) * 2020-08-14 2022-03-25 广州视源电子科技股份有限公司 Touch data processing method, device, equipment and storage medium
CN112083903A (en) * 2020-09-14 2020-12-15 北京字节跳动网络技术有限公司 Display device, terminal control method and device, display device, and storage medium
CN112328195B (en) * 2020-10-10 2023-10-24 当趣网络科技(杭州)有限公司 Screen projection control method, system, electronic equipment and medium
CN114741039B (en) * 2020-12-24 2023-09-08 华为技术有限公司 Equipment control method and terminal equipment
CN112905089B (en) * 2021-02-07 2022-09-16 北京小米移动软件有限公司 Equipment control method and device
CN113286381B (en) * 2021-04-28 2023-03-21 北京字节跳动网络技术有限公司 Wireless communication method, related equipment and system
CN115484440A (en) * 2021-05-31 2022-12-16 华为技术有限公司 Method and equipment for reverse control of screen projection
CN113721514A (en) * 2021-08-30 2021-11-30 联想(北京)有限公司 Control method and device
CN113992958B (en) * 2021-10-18 2023-07-18 深圳康佳电子科技有限公司 Multi-window same-screen interaction method, terminal and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095084A (en) * 2016-06-06 2016-11-09 乐视控股(北京)有限公司 Throw screen method and device
CN108228125A (en) * 2017-12-29 2018-06-29 广州酷狗计算机科技有限公司 The long-range control method and system of smart machine
CN108282677A (en) * 2018-01-24 2018-07-13 上海哇嗨网络科技有限公司 Realize that content throws method, throwing screen device and the system of screen by client
CN108415679A (en) * 2018-03-08 2018-08-17 广东美的制冷设备有限公司 Equipment and its method of toch control
CN109739450A (en) * 2018-04-08 2019-05-10 北京字节跳动网络技术有限公司 A kind of exchange method and device
CN109857321A (en) * 2019-01-23 2019-06-07 努比亚技术有限公司 Operating method, mobile terminal based on screen prjection, readable storage medium storing program for executing
CN110147199A (en) * 2019-05-23 2019-08-20 北京硬壳科技有限公司 Display on the same screen method, apparatus and touch control display

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105512086B (en) * 2016-02-16 2018-08-10 联想(北京)有限公司 Information processing equipment and information processing method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106095084A (en) * 2016-06-06 2016-11-09 乐视控股(北京)有限公司 Throw screen method and device
CN108228125A (en) * 2017-12-29 2018-06-29 广州酷狗计算机科技有限公司 The long-range control method and system of smart machine
CN108282677A (en) * 2018-01-24 2018-07-13 上海哇嗨网络科技有限公司 Realize that content throws method, throwing screen device and the system of screen by client
CN108415679A (en) * 2018-03-08 2018-08-17 广东美的制冷设备有限公司 Equipment and its method of toch control
CN109739450A (en) * 2018-04-08 2019-05-10 北京字节跳动网络技术有限公司 A kind of exchange method and device
CN109857321A (en) * 2019-01-23 2019-06-07 努比亚技术有限公司 Operating method, mobile terminal based on screen prjection, readable storage medium storing program for executing
CN110147199A (en) * 2019-05-23 2019-08-20 北京硬壳科技有限公司 Display on the same screen method, apparatus and touch control display

Also Published As

Publication number Publication date
CN110597474A (en) 2019-12-20

Similar Documents

Publication Publication Date Title
CN110597474B (en) Information processing method and electronic equipment
WO2021036594A1 (en) Control method applied to screen projection scenario and related device
CN110602805B (en) Information processing method, first electronic device and computer system
US10353661B2 (en) Method for sharing screen between devices and device using the same
US20150256957A1 (en) User terminal device, audio system, and method for controlling speaker thereof
US20130346858A1 (en) Remote Control of Audio Application and Associated Sub-Windows
CN108556740A (en) Multi-screen shares device and method, computer-readable medium, mobile unit
US20160004425A1 (en) Method of displaying graphic user interface and electronic device implementing same
KR20220158800A (en) Content Sharing Methods and Electronic Equipment
KR20150067521A (en) Apparatus and method for scrren sharing, scrren sharing service system
CN104866262A (en) Wearable Device
US10462243B2 (en) Method and device for interaction between terminals
CN105373534B (en) List display method and device and list display terminal
US11349976B2 (en) Information processing method, file transmission method, electronic apparatus, and computing apparatus
CN110168487A (en) A kind of method of toch control and device
CN108958629B (en) Split screen quitting method and device, storage medium and electronic equipment
EP3380915A1 (en) Touch heat map
KR20130032924A (en) Control method for application execution terminal based on android platform using smart-terminal, and computer-readable recording medium with controlling program of application execution terminal based on android platform using smart-terminal
WO2021128929A1 (en) Image rendering method for panorama application, and terminal device
CN110908757B (en) Method and related device for displaying media content
CN110837308B (en) Information processing method and device and electronic equipment
KR20190056523A (en) System and method for synchronizing display of virtual reality content
CN110941376A (en) Display control method and electronic equipment
EP2908272A1 (en) Method and apparatus for creating a communication group
CN103780858A (en) Method and device for processing information, and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant