CN112217872A - Control method, control device and computer readable storage medium - Google Patents
Control method, control device and computer readable storage medium Download PDFInfo
- Publication number
- CN112217872A CN112217872A CN202010967481.9A CN202010967481A CN112217872A CN 112217872 A CN112217872 A CN 112217872A CN 202010967481 A CN202010967481 A CN 202010967481A CN 112217872 A CN112217872 A CN 112217872A
- Authority
- CN
- China
- Prior art keywords
- control instruction
- electronic device
- operating system
- electronic equipment
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Selective Calling Equipment (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a control method, a control device and a computer readable storage medium, wherein the method is applied to first electronic equipment, the first electronic equipment is in communication connection with second electronic equipment, and the method comprises the following steps: sending a first control instruction to second electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment; generating content information corresponding to the designated information on a display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture; sending the second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the specified information; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
Description
Technical Field
The present invention relates to the field of data interaction technologies, and in particular, to a control method, an apparatus, and a computer-readable storage medium.
Background
A technique of remotely controlling one electronic apparatus by another electronic apparatus through a network is generally called remote control. When the general remote control is used, the master control end generally sends a signal to the controlled end to establish a remote service, and then various remote control functions are used to send a remote control command through the remote service to control the running of various application programs in the electronic equipment of the controlled end. However, in the existing remote control, the same operating system is usually required for the master control end and the controlled end, and the implementation conditions are harsh.
Disclosure of Invention
The embodiment of the invention provides a control method, a control device and a computer readable storage medium, which can realize control among electronic equipment provided with different operating systems.
One aspect of the present invention provides a control method, where the method is applied to a first electronic device, where the first electronic device is in communication connection with a second electronic device, and the method includes: sending a first control instruction to second electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment; generating content information corresponding to the designated information on a display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture; sending the second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the specified information; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
In an embodiment, before sending the first control instruction to the second electronic device, the method further includes: establishing communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system; wherein the control instruction comprises the first control instruction and the second control instruction.
In one embodiment, the content information includes virtual keys; correspondingly, the acquiring an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture includes: judging whether the virtual key is triggered or not to obtain a first judgment result; and when the first judgment result is that the virtual key is triggered, generating a second control instruction based on the virtual key.
In one embodiment, the content information includes display content; correspondingly, the method further comprises the following steps: generating a display adjusting key corresponding to the display content; judging whether the display adjusting key is triggered or not to obtain a second judgment result; and when the second judgment result is that the display adjusting key is triggered, generating an image quality adjusting instruction, wherein the image quality adjusting instruction is used for indicating image quality adjustment of the display content.
Another aspect of the present invention provides a control method, where the method is applied to a second electronic device, where the second electronic device is in communication connection with a first electronic device, and the method includes: obtaining a first control instruction from first electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment so as to enable the first electronic equipment to generate content information corresponding to the specified information on a display interface; obtaining a second control instruction from the first electronic device, wherein the second control instruction is associated with the specified information and is used for instructing the second electronic device to execute a preset operation corresponding to the specified information; executing preset operation corresponding to the second control instruction; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
In an embodiment, before the obtaining of the first control instruction from the first electronic device, the method further includes: establishing communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system; wherein the control instruction comprises a first control instruction and a second control instruction.
Another aspect of the present invention provides a control apparatus, which is applied to a first electronic device, where the first electronic device is communicatively connected to a second electronic device, and the apparatus includes: the sending module is used for sending a first control instruction to second electronic equipment, wherein the first control instruction is used for indicating the second electronic equipment to send specified information to the first electronic equipment; the generating module is used for generating content information corresponding to the designated information on a display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture; the sending module is further configured to send the second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the designated information; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
In one embodiment, the apparatus further comprises: the first connection module is used for establishing communication connection with the second electronic equipment through the cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system; wherein the control instruction comprises the first control instruction and the second control instruction.
In one embodiment, the content information includes virtual keys; correspondingly, the generating module includes: the judging submodule is used for judging whether the virtual key is triggered or not to obtain a first judging result; and the generation submodule is used for generating a second control instruction based on the virtual key when the first judgment result is that the virtual key is triggered.
In one embodiment, the content information includes display content; correspondingly, the generating module is further configured to generate a display adjustment key corresponding to the display content; the device further comprises: the judging module is used for judging whether the display adjusting key is triggered or not to obtain a second judging result; the generation module is further configured to generate an image quality adjustment instruction when the second determination result determines that the display adjustment key is triggered, where the image quality adjustment instruction is used to instruct to perform image quality adjustment on the display content.
Another aspect of the present invention provides a control apparatus, which is applied to a second electronic device, the second electronic device being communicatively connected to a first electronic device, the apparatus including: the obtaining module is used for obtaining a first control instruction from first electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment so that the first electronic equipment generates content information corresponding to the specified information on a display interface; the obtaining module is further configured to obtain a second control instruction from the first electronic device, where the second control instruction is associated with the specific information, and the second control instruction is used to instruct the second electronic device to perform a preset operation corresponding to the specific information; the execution module is further used for executing preset operation corresponding to the second control instruction; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
In one embodiment, the apparatus further comprises: the second connection module is used for establishing communication connection with the second electronic equipment through the cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system; wherein the control instruction comprises a first control instruction and a second control instruction.
Another aspect of the invention provides a computer-readable storage medium comprising a set of computer-executable instructions which, when executed, perform any of the control methods described above.
According to the control method, the control device and the computer readable storage medium provided by the embodiment of the invention, the first electronic device provided with the first operating system acquires the specified information from the second electronic device provided with the second operating system through the first control instruction, the content information corresponding to the specified information is generated through the first electronic device, and the first electronic device can generate the corresponding second control instruction according to the gesture operation and send the second control instruction to the second electronic device, so that the purpose of controlling the second electronic device through the first electronic device is realized, and the control method, the control device and the computer readable storage medium are particularly suitable for remote control among different systems. By the method, the control among a plurality of electronic devices with different operating systems can be realized.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
in the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Fig. 1 is a schematic flow chart illustrating an implementation of a control method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating an implementation of the control method for establishing the communication connection according to the embodiment of the present invention;
fig. 3 is a schematic flow chart illustrating an implementation process of triggering a virtual key by a control method according to an embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating an implementation process of triggering a display adjustment key by a control method according to an embodiment of the present invention;
FIG. 5 is a schematic flow chart illustrating an implementation of a control method according to another embodiment of the present invention;
fig. 6 is a schematic flow chart illustrating an implementation of the control method for establishing a communication connection according to another embodiment of the present invention;
FIG. 7 is a schematic diagram of an implementation module of a control apparatus according to an embodiment of the present invention;
fig. 8 is a schematic diagram of an implementation module of a control device according to another embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart illustrating an implementation process of a control method according to an embodiment of the present invention.
Referring to fig. 1, in an aspect, an embodiment of the present invention provides a control method, where the method is applied to a first electronic device, and the first electronic device is communicatively connected to a second electronic device, and the method includes: operation 101, sending a first control instruction to a second electronic device, where the first control instruction is used to instruct the second electronic device to send specified information to a first electronic device; operation 102, generating content information corresponding to the designated information on the display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture; operation 103, sending a second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the designated information; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic device is an electronic device provided with a second operating system, and the first operating system and the second operating system are different.
In the control method provided by the embodiment of the invention, the first electronic device provided with the first operating system acquires the specified information from the second electronic device provided with the second operating system through the first control instruction, the content information corresponding to the specified information is generated through the first electronic device, a user can perform gesture operation on the first electronic device based on the content information, and the first electronic device can generate the corresponding second control instruction according to the gesture operation of the user and send the second control instruction to the second electronic device, so that the purpose of controlling the second electronic device through the first electronic device is realized, and the control method is particularly suitable for remote control among different systems. By the method, the control among the plurality of electronic devices provided with different operating systems can be realized, so that the user experience is improved.
Specifically, the first electronic device of the method is an electronic device that performs data processing based on a first operating system. The first electronic device may be an electronic device having a data processing function, such as a mobile phone, a desktop computer, a notebook computer, and a tablet computer, and the first operating System may be selected from a Microsoft operating System (Microsoft System), a uinex operating System (UNIX), an apple operating System (Mac OS), a Linux operating System, a google operating System (Android), an apple mobile operating System (iOS), a Microsoft mobile operating System (windows phone), a nokia operating System (Symbian), a BlackBerry operating System (BlackBerry OS), and the like, as required, according to a specific type of the first electronic device.
The second electronic device of the method is an electronic device that performs data processing based on the second operating system. The second electronic device may also be an electronic device with a data processing function, such as a mobile phone, a desktop computer, a notebook computer, and a tablet computer, and the second operating System may be a Microsoft operating System (Microsoft System), a uinex operating System (UNIX), an apple operating System (Mac OS), a Linux operating System, a google operating System (Android), an apple mobile operating System (iOS), a Microsoft mobile operating System (windows phone), a nokia operating System (Symbian), a BlackBerry operating System (BlackBerry OS), or the like, as required, according to a specific type of the second electronic device. It should be noted that the first operating system is different from the second operating system. For example, when the first operating system is selected as the microsoft operating system, the second operating system is another operating system other than the microsoft operating system, such as the apple operating system, google operating system, apple mobile operating system, and so on. It should be added that the number of the second electronic devices may be one or more than one, and the first electronic device is communicatively connected with one or more than one second electronic devices, that is, the first electronic device may remotely control one or more than one second electronic devices.
The method first performs operation 101 when the first electronic device needs to control the second electronic device. The first electronic device sends a first control instruction to the second electronic device, and the first control instruction may be triggered based on a user operation or triggered by the first electronic device. For example, when the first control instruction is triggered based on a user operation, in one case, when the first electronic device acquires that the user triggers a control button for the second electronic device, the first electronic device obtains the first control instruction and sends the first control instruction to the second electronic device. When the first control instruction is triggered by the first electronic device, the first control instruction may be generated and transmitted to the second electronic device while establishing a communication connection with the second electronic device. The first control instruction is used for instructing the second electronic equipment to send the specified information to the first electronic equipment. When the number of the second electronic devices is multiple, the first electronic device may name each of the second electronic devices, so as to be able to send the designated first control instruction to the designated second electronic device. For example, in one case, when a user needs to control one of the second electronic devices, the first electronic device displays a device list corresponding to a plurality of names of the second electronic devices, and then the first electronic device determines a designated second electronic device in the device list and sends a control instruction to the second electronic device. The specific information includes, but is not limited to, screen display real-time or delayed time information, real-time or delayed time sound information of a microphone, real-time or delayed time capture information of a camera. For example, the screen of the second electronic device displays the content in real time, real-time sound information of a microphone of the second electronic device, and real-time shooting information of a camera of the second electronic device. Specifically, the second electronic device calls a bottom interface through the client, and transmits the content of each frame to the first electronic device through the network.
After the first electronic device obtains the designation information, operation 102 is performed. And analyzing the specified information to generate content information corresponding to the specified information on the display interface of the first electronic equipment. The content information is information identical to or associated with the specified information. For example, according to the screen display content of the second electronic device in the designated information, the same screen display content as the second electronic device is displayed on the display interface of the first electronic device; playing the same sound information collected by a microphone of the second electronic equipment on the first electronic equipment according to the sound information of the second electronic equipment in the designated information; and displaying the same acquisition content acquired by the camera of the second electronic equipment on a display interface of the first electronic equipment according to the acquisition content acquired by the camera of the second electronic equipment in the designated information. Through the operation, the first electronic device acquires the designated information of the second electronic device. After the first electronic device generates the content information corresponding to the designated information, the first electronic device determines the intention of the user by collecting the operation gesture of the user, and generates a second control instruction according to the intention of the user. For example, when the first electronic device is a microsoft operating system, the operation gesture collected may be to collect a click position of a mouse, collect a drag gesture of the mouse, collect input information of a keyboard, and the like. When the operation gesture is related to the content information displayed by the first electronic device, the user is considered to need to control the second electronic device. For example, when one piece of software in the content information is collected and clicked by a mouse, a second control instruction for opening the software is generated. And generating a second control instruction for indicating the second electronic equipment to display the content to turn pages when the mouse clicks to turn pages.
After the second control instruction is generated, the first electronic device sends the second control instruction to the second electronic device to instruct the second electronic device to execute the preset operation corresponding to the designated information. After the second control instruction is analyzed by the second electronic device, the second electronic device can execute corresponding preset operation according to the intention of the second control instruction, if the second control instruction indicates to open a certain software, the second electronic device opens the software, and if the second control instruction indicates to turn pages of the display page, the display page of the second electronic device turns pages, and the like, so that remote control among different system devices is realized.
Fig. 2 is a schematic flow chart illustrating an implementation process of establishing a communication connection by a control method according to an embodiment of the present invention.
Referring to fig. 2, in the embodiment of the present invention, before sending the first control instruction to the second electronic device in operation 101, the method further includes: operation 201, establishing a communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system; the control instruction comprises a first control instruction and a second control instruction.
In the method, the control instruction between the first electronic device and the second electronic device is forwarded and converted through the cloud server, the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system through the cloud server, and the control instruction does not need to be converted into the control instruction based on the second operating system when the first electronic device generates the control instruction, so that the resource consumption of the first electronic device is reduced, the user experience is improved, and the delay is reduced.
In operation 201, in a specific case, the first electronic device is connected to the cloud server by accessing the designated link, and the second electronic device is connected to the cloud server by using the application software, that is, the first electronic device accesses the cloud server by using the designated link to connect to the second electronic device in a communication manner. Further, when the number of the second electronic devices is more than one, the first electronic device accesses the cloud server through the designated link to obtain a plurality of second electronic device name lists, and the designated second electronic devices are determined in the name lists for control.
Fig. 3 is a schematic flow chart illustrating an implementation process of triggering a virtual key by a control method according to an embodiment of the present invention.
Referring to fig. 3, in the embodiment of the present invention, the content information includes a virtual key; correspondingly, in operation 102, an operation gesture associated with the content information is acquired, and a second control instruction is generated based on the operation gesture, including: operation 1021, determining whether the virtual key is triggered, and obtaining a first determination result; in operation 1022, when the first determination result determines that the virtual key is triggered, a second control instruction is generated based on the virtual key.
Based on the difference between the first operating system and the second operating system, the physical keys in the first electronic device cannot directly correspond to the physical keys in the second electronic device, for example, in the microsoft operating system, the physical keys are a mouse, a keyboard, and the like, and in the android operating system and the apple mobile operating system, the physical keys may be any of a power key, a volume key, a home key, a backspace key, and a switch key. Furthermore, the virtual key can also be a hardware control key for opening and closing a microphone and the like. Therefore, the user cannot control the physical keys in the second electronic device by only clicking the display content in the first electronic device. Through the setting of the virtual keys, the first electronic device can realize mapping between the virtual keys and the physical keys in the second electronic device, and the first electronic device can realize the purpose of controlling the physical keys in the second electronic device by controlling the virtual keys. In a specific case, the first operating system is a microsoft operating system, the second operating system is an android operating system, and the physical keys of the second electronic device include a power key, a volume key, a home key, a backspace key and a shift key. The method comprises the steps that a first electronic device virtualizes a power key, a volume key, a home key, a backspace key and a switching key into virtual keys to be displayed on a display screen of the first electronic device, whether the corresponding virtual keys are triggered or not is determined by collecting mouse activities, and when the virtual keys are triggered, corresponding control instructions are generated and sent to a second electronic device so that the second electronic device can respond to operation.
Fig. 4 is a schematic flow chart illustrating an implementation process of triggering a display adjustment key by a control method according to an embodiment of the present invention.
Referring to fig. 4, in the embodiment of the present invention, the content information includes display content; correspondingly, the method further comprises the following steps: operation 401, generating a display adjustment key corresponding to the display content; operation 402, judging whether the display adjusting key is triggered, and obtaining a second judgment result; in operation 403, when the second determination result determines that the display adjustment key is triggered, an image quality adjustment instruction is generated, where the image quality adjustment instruction is used to instruct image quality adjustment of the display content.
In the process of realizing remote control between the first electronic device and the second electronic device, the parameter of the first electronic device can influence the delay of control, generally, the better the performance of the first electronic device is, the lower the delay is, and in order to improve the experience of a user, the first electronic device can adjust the displayed content information based on the delay, so that the resource occupied by the content information is changed, the smoothness of control is improved, and the user experience is improved.
Specifically, when the first electronic device generates the content information, a display adjustment key corresponding to the display content is generated, the display adjustment key can be expressed in a virtual key form, and the display adjustment key is used for adjusting the fixed image quality of the real content, including but not limited to adjusting the size of a picture, adjusting the definition of the image quality, adjusting colors, adjusting the number of frames, and the like, so that the control of the user on the first electronic device can be more personalized, and the user experience is improved.
The first electronic device determines whether a user has a requirement for adjusting the display by judging whether the display adjusting key is triggered or not, and obtains a second judgment result. And when the second judgment result is that the display adjustment key is triggered, the user is considered to have the requirement of adjusting the display, and an image quality adjustment instruction is generated according to the selection of the user so as to instruct the first electronic equipment to adjust the image quality of the display content.
Fig. 5 is a schematic flow chart illustrating an implementation of a control method according to another embodiment of the present invention.
Referring to fig. 5, another aspect of the embodiments of the present invention provides a control method, where the method is applied to a second electronic device, and the second electronic device is in communication connection with a first electronic device, and the method includes: operation 501, obtaining a first control instruction from a first electronic device, where the first control instruction is used to instruct a second electronic device to send specified information to the first electronic device, so that the first electronic device generates content information corresponding to the specified information on a display interface; operation 502, obtaining a second control instruction from the first electronic device, where the second control instruction is associated with the specific information, and the second control instruction is used to instruct the second electronic device to perform a preset operation corresponding to the specific information; operation 503, executing a preset operation corresponding to the second control instruction; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic device is an electronic device provided with a second operating system, and the first operating system and the second operating system are different.
In the control method provided by the embodiment of the invention, the first electronic device provided with the first operating system acquires the specified information from the second electronic device provided with the second operating system through the first control instruction, the content information corresponding to the specified information is generated through the first electronic device, a user can perform gesture operation on the first electronic device based on the content information, and the first electronic device can generate the corresponding second control instruction according to the gesture operation of the user and send the second control instruction to the second electronic device, so that the purpose of controlling the second electronic device through the first electronic device is realized, and the control method is particularly suitable for remote control among different systems. By the method, the control among the plurality of electronic devices provided with different operating systems can be realized, so that the user experience is improved.
Specifically, the first electronic device of the method is an electronic device that performs data processing based on a first operating system. The first electronic device may be an electronic device having a data processing function, such as a mobile phone, a desktop computer, a notebook computer, and a tablet computer, and the first operating System may be selected from a Microsoft operating System (Microsoft System), a uinex operating System (UNIX), an apple operating System (Mac OS), a Linux operating System, a google operating System (Android), an apple mobile operating System (iOS), a Microsoft mobile operating System (windows phone), a nokia operating System (Symbian), a BlackBerry operating System (BlackBerry OS), and the like, as required, according to a specific type of the first electronic device.
The second electronic device of the method is an electronic device that performs data processing based on the second operating system. The second electronic device may also be an electronic device with a data processing function, such as a mobile phone, a desktop computer, a notebook computer, and a tablet computer, and the second operating System may be a Microsoft operating System (Microsoft System), a uinex operating System (UNIX), an apple operating System (Mac OS), a Linux operating System, a google operating System (Android), an apple mobile operating System (iOS), a Microsoft mobile operating System (windows phone), a nokia operating System (Symbian), a BlackBerry operating System (BlackBerry OS), or the like, as required, according to a specific type of the second electronic device. It should be noted that the first operating system is different from the second operating system. For example, when the first operating system is selected as the microsoft operating system, the second operating system is another operating system other than the microsoft operating system, such as the apple operating system, google operating system, apple mobile operating system, and so on. It should be added that the number of the second electronic devices may be one or more than one, and the first electronic device is communicatively connected with one or more than one second electronic devices, that is, a plurality of second electronic devices may receive remote control of the same first electronic device.
The method first performs operation 101 when the first electronic device needs to control the second electronic device. The first electronic device sends a first control instruction to the second electronic device, and the first control instruction may be triggered based on a user operation or triggered by the first electronic device. For example, when the first control instruction is triggered based on a user operation, in one case, when the first electronic device acquires that the user triggers a control button for the second electronic device, the first electronic device obtains the first control instruction and sends the first control instruction to the second electronic device. When the first control instruction is triggered by the first electronic device, the first control instruction may be generated and transmitted to the second electronic device while establishing a communication connection with the second electronic device. The first control instruction is used for instructing the second electronic equipment to send the specified information to the first electronic equipment. When the number of the second electronic devices is multiple, the first electronic device may name each of the second electronic devices, so as to be able to send the designated first control instruction to the designated second electronic device. For example, in one case, when a user needs to control one of the second electronic devices, the first electronic device displays a device list corresponding to a plurality of names of the second electronic devices, and then the first electronic device determines a designated second electronic device in the device list and sends a control instruction to the second electronic device. The specific information includes, but is not limited to, screen display real-time or delayed time information, real-time or delayed time sound information of a microphone, real-time or delayed time capture information of a camera. For example, the screen of the second electronic device displays the content in real time, real-time sound information of a microphone of the second electronic device, and real-time shooting information of a camera of the second electronic device. Specifically, the second electronic device calls a bottom interface through the client, and transmits the content of each frame to the first electronic device through the network.
After the first electronic device obtains the designation information, operation 501 is performed. The first electronic device sends the designated information to the first electronic device according to a first control instruction from the first electronic device. The designated information is used for generating content information corresponding to the designated information on a display interface of the first electronic equipment. The content information is information identical to or associated with the specified information. For example, according to the screen display content of the second electronic device in the designated information, the same screen display content as the second electronic device is displayed on the display interface of the first electronic device; playing the same sound information collected by a microphone of the second electronic equipment on the first electronic equipment according to the sound information of the second electronic equipment in the designated information; and displaying the same acquisition content acquired by the camera of the second electronic equipment on a display interface of the first electronic equipment according to the acquisition content acquired by the camera of the second electronic equipment in the designated information. Through the operation, the first electronic device acquires the designated information of the second electronic device.
The second electronic device receives a second control instruction associated with the specified information to execute a preset operation corresponding to the specified information. After the second control instruction is analyzed by the second electronic device, the second electronic device can execute corresponding preset operation according to the intention of the second control instruction, if the second control instruction indicates to open a certain software, the second electronic device opens the software, and if the second control instruction indicates to turn pages of the display page, the display page of the second electronic device turns pages, and the like, so that remote control among different system devices is realized.
Fig. 6 is a schematic flow chart illustrating an implementation of the control method for establishing the communication connection according to another embodiment of the present invention.
Referring to fig. 6, in the embodiment of the present invention, before obtaining the first control instruction from the first electronic device in operation 501, the method further includes: operation 601, establishing a communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system; the control instruction comprises a first control instruction and a second control instruction.
In the method, the control instruction between the first electronic device and the second electronic device is forwarded and converted through the cloud server, the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system through the cloud server, and the control instruction does not need to be converted into the control instruction based on the second operating system when the first electronic device generates the control instruction, so that the resource consumption of the first electronic device is reduced, the user experience is improved, and the delay is reduced.
In operation 201, in a specific case, the first electronic device is connected to the cloud server by accessing the designated link, and the second electronic device is connected to the cloud server by using the application software, that is, the first electronic device accesses the cloud server by using the designated link to connect to the second electronic device in a communication manner. Further, when the number of the second electronic devices is more than one, the first electronic device accesses the cloud server through the designated link to obtain a plurality of second electronic device name lists, and the designated second electronic devices are determined in the name lists for control. The specified information of the second electronic device can be converted and forwarded through the cloud server as well.
To facilitate understanding of the above embodiments, a specific implementation scenario is provided below for description.
In this scenario, the first electronic device is a computer using a microsoft os, and the plurality of second electronic devices are all mobile phones using an android os. Each mobile phone is provided with application software so as to realize the connection between each mobile phone and the cloud server.
The computer accesses the designated link to realize the link with the cloud server, obtains a name list corresponding to each mobile phone through the cloud server, determines the name of the designated mobile phone in the name list by collecting operation gestures of a user, such as mouse click, and establishes connection with the designated mobile phone through the name of the mobile phone. And sending a first control instruction to the appointed mobile phone, converting the first control instruction into a forwarding and receiving instruction through the cloud server, receiving the first control instruction by the appointed mobile phone, and transmitting the display content and other contents of each frame to the computer through the network by the appointed mobile phone according to the first control instruction.
And after receiving the display content and other contents of each frame from the mobile phone, the computer generates corresponding display content and other contents. Therefore, a user can operate the display content and other contents from the mobile phone on the computer, and the computer generates a corresponding control instruction to instruct the mobile phone to execute corresponding operation by acquiring the operation gesture of the user based on the display content and other contents. For example, when the computer acquires that a mouse clicks and opens a certain software, a corresponding control instruction is generated and forwarded to the specified mobile phone through the cloud server, and the specified mobile phone opens the corresponding software after receiving the control instruction; the computer acquires that the virtual key for adjusting the volume is clicked by the mouse, generates a corresponding control instruction, forwards the control instruction to the specified mobile phone through the cloud server, and adjusts the volume after the specified mobile phone receives the control instruction. When the computer acquires that the display adjusting key is triggered, the real content is adjusted based on the trigger information so as to configure the resolution or other display information.
Fig. 7 is a schematic diagram of an implementation module of a control device according to an embodiment of the present invention.
Referring to fig. 7, another aspect of the embodiments of the present invention provides a control apparatus, where the apparatus is applied to a first electronic device, and the first electronic device is communicatively connected to a second electronic device, and the apparatus includes: a sending module 701, configured to send a first control instruction to the second electronic device, where the first control instruction is used to instruct the second electronic device to send the specific information to the first electronic device; a generating module 702, configured to generate content information corresponding to the designated information on the display interface, collect an operation gesture associated with the content information, and generate a second control instruction based on the operation gesture; the sending module 701 is further configured to send a second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the designated information; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic device is an electronic device provided with a second operating system, and the first operating system and the second operating system are different.
In an embodiment of the present invention, the apparatus further comprises: the first connection module 703 is configured to establish a communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system; the control instruction comprises a first control instruction and a second control instruction.
In the embodiment of the invention, the content information comprises virtual keys; accordingly, the generating module 702 includes: a judging submodule 7021, configured to judge whether the virtual key is triggered, and obtain a first judgment result; and the generating sub-module 7022 is configured to generate a second control instruction based on the virtual key when the first determination result determines that the virtual key is triggered.
In an embodiment of the present invention, the content information includes display content; correspondingly, the generating module 702 is further configured to generate a display adjusting key corresponding to the display content; the device still includes: a judging module 704, configured to judge whether the display adjustment key is triggered, to obtain a second judgment result; the generating module 702 is further configured to generate an image quality adjusting instruction when the second determination result determines that the display adjusting key is triggered, where the image quality adjusting instruction is used to instruct to perform image quality adjustment on the display content.
Fig. 8 is a schematic diagram of an implementation module of a control device according to another embodiment of the present invention.
Referring to fig. 8, another aspect of the embodiments of the present invention provides a control apparatus, where the apparatus is applied to a second electronic device, and the second electronic device is connected to a first electronic device in a communication manner, where the apparatus includes: an obtaining module 801, configured to obtain a first control instruction from a first electronic device, where the first control instruction is used to instruct a second electronic device to send specified information to the first electronic device, so that the first electronic device generates content information corresponding to the specified information on a display interface; an obtaining module 801, configured to obtain a second control instruction from the first electronic device, where the second control instruction is associated with the specific information, and the second control instruction is used to instruct the second electronic device to perform a preset operation corresponding to the specific information; the execution module 802 is further configured to execute a preset operation corresponding to the second control instruction; the first electronic equipment is electronic equipment provided with a first operating system; the second electronic device is an electronic device provided with a second operating system, and the first operating system and the second operating system are different.
In an embodiment of the present invention, the apparatus further comprises: a second connection module 803, configured to establish a communication connection with a second electronic device through a cloud server; the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from the control instruction based on the first operating system to the control instruction based on the second operating system; the control instruction comprises a first control instruction and a second control instruction.
Another aspect of the embodiments of the present invention provides a computer-readable storage medium, which includes a set of computer-executable instructions, when executed, for performing any one of the control methods described above.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A control method is applied to a first electronic device which is in communication connection with a second electronic device, and comprises the following steps:
sending a first control instruction to second electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment;
generating content information corresponding to the designated information on a display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture;
sending the second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the specified information;
the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
2. The method of claim 1, wherein prior to sending the first control instruction to the second electronic device, the method further comprises:
establishing communication connection with a second electronic device through a cloud server;
the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system;
wherein the control instruction comprises the first control instruction and the second control instruction.
3. The method of claim 1, wherein the content information comprises virtual keys;
correspondingly, the acquiring an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture includes:
judging whether the virtual key is triggered or not to obtain a first judgment result;
and when the first judgment result is that the virtual key is triggered, generating a second control instruction based on the virtual key.
4. The method of claim 1, wherein the content information comprises display content;
correspondingly, the method further comprises the following steps:
generating a display adjusting key corresponding to the display content;
judging whether the display adjusting key is triggered or not to obtain a second judgment result;
and when the second judgment result is that the display adjusting key is triggered, generating an image quality adjusting instruction, wherein the image quality adjusting instruction is used for indicating image quality adjustment of the display content.
5. A control method is applied to a second electronic device which is in communication connection with a first electronic device, and comprises the following steps:
obtaining a first control instruction from first electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment so as to enable the first electronic equipment to generate content information corresponding to the specified information on a display interface;
obtaining a second control instruction from the first electronic device, wherein the second control instruction is associated with the specified information and is used for instructing the second electronic device to execute a preset operation corresponding to the specified information;
executing preset operation corresponding to the second control instruction;
the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
6. The method of claim 1, wherein prior to said obtaining the first control instruction from the first electronic device, the method further comprises:
establishing communication connection with a second electronic device through a cloud server;
the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system;
wherein the control instruction comprises a first control instruction and a second control instruction.
7. A control device, the device is applied to a first electronic device, the first electronic device is connected with a second electronic device in a communication mode, the device comprises:
the sending module is used for sending a first control instruction to second electronic equipment, wherein the first control instruction is used for indicating the second electronic equipment to send specified information to the first electronic equipment;
the generating module is used for generating content information corresponding to the designated information on a display interface, collecting an operation gesture associated with the content information, and generating a second control instruction based on the operation gesture;
the sending module is further configured to send the second control instruction to the second electronic device to instruct the second electronic device to execute a preset operation corresponding to the designated information;
the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
8. The apparatus of claim 7, further comprising:
the first connection module is used for establishing communication connection with the second electronic equipment through the cloud server;
the cloud server is used for receiving a control instruction from the first electronic device and forwarding the control instruction to the second electronic device so that the control instruction is converted from a control instruction based on a first operating system to a control instruction based on a second operating system;
wherein the control instruction comprises the first control instruction and the second control instruction.
9. A control device, the device is applied to a second electronic device, the second electronic device is connected with a first electronic device in a communication mode, and the device comprises:
the obtaining module is used for obtaining a first control instruction from first electronic equipment, wherein the first control instruction is used for instructing the second electronic equipment to send specified information to the first electronic equipment so that the first electronic equipment generates content information corresponding to the specified information on a display interface;
the obtaining module is further configured to obtain a second control instruction from the first electronic device, where the second control instruction is associated with the specific information, and the second control instruction is used to instruct the second electronic device to perform a preset operation corresponding to the specific information;
the execution module is used for executing preset operation corresponding to the second control instruction;
the first electronic equipment is electronic equipment provided with a first operating system; the second electronic equipment is the electronic equipment provided with a second operating system, and the first operating system and the second operating system are different.
10. A computer-readable storage medium comprising a set of computer-executable instructions which, when executed, perform a control method as claimed in any one of claims 1 to 4 or 5 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010967481.9A CN112217872A (en) | 2020-09-15 | 2020-09-15 | Control method, control device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010967481.9A CN112217872A (en) | 2020-09-15 | 2020-09-15 | Control method, control device and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112217872A true CN112217872A (en) | 2021-01-12 |
Family
ID=74050534
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010967481.9A Pending CN112217872A (en) | 2020-09-15 | 2020-09-15 | Control method, control device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112217872A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023020497A1 (en) * | 2021-08-17 | 2023-02-23 | 华为技术有限公司 | Device control method and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104836840A (en) * | 2015-03-30 | 2015-08-12 | 北京奇虎科技有限公司 | Control method of mobile terminal, server, device and system |
| CN104951676A (en) * | 2014-04-14 | 2015-09-30 | 腾讯科技（深圳）有限公司 | Mobile terminal control method, mobile terminal control device and mobile terminal control system |
| CN109799941A (en) * | 2019-01-07 | 2019-05-24 | 深圳中兴网信科技有限公司 | Control method, control equipment, system and computer readable storage medium |
| US20190335224A1 (en) * | 2011-06-20 | 2019-10-31 | Enseo, Inc. | Television and system and method for providing a remote control device |
-
2020
- 2020-09-15 CN CN202010967481.9A patent/CN112217872A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190335224A1 (en) * | 2011-06-20 | 2019-10-31 | Enseo, Inc. | Television and system and method for providing a remote control device |
| CN104951676A (en) * | 2014-04-14 | 2015-09-30 | 腾讯科技（深圳）有限公司 | Mobile terminal control method, mobile terminal control device and mobile terminal control system |
| CN104836840A (en) * | 2015-03-30 | 2015-08-12 | 北京奇虎科技有限公司 | Control method of mobile terminal, server, device and system |
| CN109799941A (en) * | 2019-01-07 | 2019-05-24 | 深圳中兴网信科技有限公司 | Control method, control equipment, system and computer readable storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023020497A1 (en) * | 2021-08-17 | 2023-02-23 | 华为技术有限公司 | Device control method and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111913628B (en) | Sharing method and device and electronic equipment | |
| RU2420797C2 (en) | Enabling application of instructions for changing graphic window to remotely generated graphic window | |
| US8707321B2 (en) | Resource sharing system and method thereof | |
| CN108804302B (en) | Remote testing method, system and related equipment | |
| US20090006977A1 (en) | Method and System of Computer Remote Control that Optimized for Low Bandwidth Network and Low Level Personal Communication Terminal Device | |
| CN115357178A (en) | Control method applied to screen projection scene and related equipment | |
| JP2007011531A (en) | Interface control program, interface control method, interface control device and plug-in program | |
| US9870754B2 (en) | Computer program product, information processing method, and information processing apparatus | |
| CN109491738B (en) | Terminal device control method and terminal device | |
| JP4316295B2 (en) | Thin client system, thin client terminal, relay device, server device, and thin client terminal screen display method | |
| CN107509051A (en) | Long-range control method, device, terminal and computer-readable recording medium | |
| CN112416223A (en) | Display method, electronic device and readable storage medium | |
| CN105094583B (en) | Shortcut operation method and device for touch screen digital terminal | |
| CN116635825A (en) | Display control method, display system, electronic device, and readable storage medium | |
| CN114489350B (en) | Input method calling method and related equipment | |
| CN111104380A (en) | Application file management method and device, mobile terminal and storage medium | |
| CN112217872A (en) | Control method, control device and computer readable storage medium | |
| CN110865870A (en) | Application calling method and device based on hook technology | |
| CN109086113A (en) | Screenshotss method, apparatus and mobile terminal | |
| US10979582B2 (en) | Extension of remote frame buffer (RFB) protocol | |
| JP6133460B1 (en) | Operation support system, operation support program, and operation support method | |
| JP5281324B2 (en) | Screen output converter, display device, and screen display method | |
| CN108829306B (en) | Information processing method and mobile terminal | |
| CN110620842A (en) | Application program control method and terminal | |
| US20150271431A1 (en) | Information Transmission Method and Wireless Display System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518066 room 1901, 19 / F, building 31 (Building B), Caihui center, No. 1 Cuiying street, Nansha District, Guangzhou, Guangdong Province (office only) Applicant after: Guangdong Lenovo understand Communication Co.,Ltd. Address before: Room 201, building a, No.1 Qianwan 1st Road, Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong Province (settled in Shenzhen Qianhai business secretary Co., Ltd.) Applicant before: SHENZHEN LENOVO CONNECT Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210112 |