WO2014090016A1 - Procédé de commande de dispositif et terminal de communication mobile - Google Patents

Procédé de commande de dispositif et terminal de communication mobile Download PDF

Info

Publication number
WO2014090016A1
WO2014090016A1 PCT/CN2013/084437 CN2013084437W WO2014090016A1 WO 2014090016 A1 WO2014090016 A1 WO 2014090016A1 CN 2013084437 W CN2013084437 W CN 2013084437W WO 2014090016 A1 WO2014090016 A1 WO 2014090016A1
Authority
WO
WIPO (PCT)
Prior art keywords
control
mobile communication
communication terminal
designated device
control operation
Prior art date
Application number
PCT/CN2013/084437
Other languages
English (en)
Chinese (zh)
Inventor
陈虞付
李超
刘晓健
吴军
Original Assignee
北京奇虎科技有限公司
奇智软件（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京奇虎科技有限公司, 奇智软件（北京）有限公司 filed Critical 北京奇虎科技有限公司
Publication of WO2014090016A1 publication Critical patent/WO2014090016A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a device control method and a mobile communication terminal. Background technique
  • the electric computer brain plays a role in the life and life of the people, playing the role of the more and more important role.
  • the living and living of people and the work and work are becoming more and more dependent on the computer brain.
  • the computer brains all have equipment for input and output, for example, one type of equipment is often used for input and input equipment.
  • the keyboard keyboard and the mouse mouse are used to operate the computer brain. Among them, the keyboard keyboard is usually used as the input and input of the information, and the mouse mouse is used.
  • the key keyboard and the mouse mouse are both physical physics.
  • Li Jie Jie.. Quality the space occupied by the space and the placement of the position of the placement is also required, and only can be close to the distance from the operation An electric computer brain;
  • the key keyboard and the touch panel are both internal
  • the built-in electric corroof is only able to work as a computer brain near a close distance, and it exists in the limitations of the work. .
  • the present invention has been proposed to provide an overcoming of the above.
  • a device control method that solves the above problems or at least partially solves the problem with a mobile communication terminal.
  • a device control method including: a mobile communication terminal The control operation instruction for controlling the operation of the specified device by the set HTML page, wherein the HTML page is used to provide an interface for the user to control the specified device through the mobile communication terminal, and receive the control operation generated by the user on the interface operation. And transmitting a control operation instruction; the mobile communication terminal sends the control operation instruction to the designated device through the HTML page, so that the designated device performs the control operation indicated by the control operation instruction.
  • a mobile communication terminal including: a receiving module configured to receive a control operation instruction for a user to perform a control operation on a specified device through a set HTML page, where the HTML page is used to provide a user Receiving, by the mobile communication terminal, an operation operation command for the designated device, receiving a control operation instruction generated by the user for the interface operation, and transmitting a control operation instruction; and the control module is configured to send the control operation instruction to the designated device through the HTML page, so as to specify The device performs the control operations indicated by the control operation instructions.
  • a computer readable recording medium having recorded thereon a program for executing the above device control method.
  • the mobile communication terminal receives the user's control operation on the designated device through the HTML page, and sends a control operation instruction to the designated device, so that the designated device performs the corresponding control operation according to the control operation instruction.
  • the HTML page is widely used and supported by almost all operating systems.
  • the HTML page is used to control the operation of the specified device by the mobile communication terminal. No special operation control software is required on the mobile communication terminal side and the designated device side, and the operation is convenient. Simple implementation, good compatibility, and low implementation cost.
  • the operation of a designated device such as a PC or an Internet of Things device can be controlled by a mobile communication terminal at a long distance.
  • the mobile communication terminal of the invention can replace the traditional input device, realizes convenient operation of the device away from the device, and monitors the device in real time, and comprehensively controls the device, thereby solving the problem that the existing input device cannot realize the user
  • Long-distance distance control of computers or IoT devices reduces the user's experience of operating the computer or IoT devices, achieves long-distance manipulation of the device, and enhances the user's operating experience.
  • FIG. 1 is a flow chart of steps of a device control method according to a first embodiment of the present invention
  • FIG. 2 is a flow chart of steps of a device control method according to a second embodiment of the present invention
  • FIG. 4 is a schematic diagram of an interface of a touch panel HTML page in the embodiment shown in FIG. 3
  • FIG. 5 is an interface of a shortcut operation HTML page in the embodiment shown in FIG.
  • FIG. 6 is a schematic diagram of an interface for selecting a terminal HTML page in the embodiment shown in FIG. 3.
  • FIG. 7 is a flow chart of steps of a device control method according to Embodiment 4 of the present invention
  • FIG. 8 is a flowchart according to the present invention.
  • FIG. 1 there is shown a flow chart of the steps of a device control method according to a first embodiment of the present invention.
  • Step S102 The mobile communication terminal receives a control operation instruction for the user to perform a control operation on the designated device through the set HTML page.
  • the HTML page is used to provide an interface for the user to perform control operations on the designated device through the mobile communication terminal, receive a control operation instruction generated by the user for the interface operation, and send a control operation instruction.
  • Step S104 The mobile communication terminal sends a control operation instruction to the designated device through the HTML page, so that the designated device performs the control operation indicated by the control operation instruction.
  • the mobile communication terminal receives the control operation of the designated device by the user through the HTML page, and sends a control operation instruction to the designated device, so that the designated device performs a corresponding control operation according to the control operation instruction.
  • the HTML page is widely used and supported by almost all operating systems.
  • the HTML page is used to control the operation of the specified device by the mobile communication terminal. No special operation control software is required on the mobile communication terminal side and the designated device side, and the operation is convenient. Simple implementation, good compatibility, and low implementation cost.
  • the operation of a designated device e.g., a PC or an Internet of Things device
  • a mobile communication terminal can be controlled by a mobile communication terminal at a long distance.
  • the mobile communication terminal of this embodiment can replace the traditional input device, realizes convenient operation of the device away from the device, and monitors the device in real time, and comprehensively controls the device, thereby solving the existing input device.
  • the user controls the electric rot or the Internet of Things device at a long distance, which reduces the user's operation experience on the computer or the Internet of Things device, and achieves the long-distance manipulation of the device and improves the user experience.
  • FIG. 2 there is shown a flow chart of the steps of a device control method in accordance with a second embodiment of the present invention.
  • a network control server is used to connect the mobile communication terminal with the designated device, and the WebSocket connection is established between the mobile communication terminal and the network control server, and between the network control server and the designated device.
  • the WebSocket protocol is HTML5, a new protocol that implements full-duplex communication between the browser and the server.
  • the WebSocket protocol is relatively simple.
  • the device and the normal browser use the port 80 or port 443 to perform a request handshake.
  • the server identifies whether it is a WebSocket request according to the HTTP HEADER. If yes, the request is upgraded to a WebSocket connection. After the handshake is successful. It enters the data transfer phase of the two-way long connection.
  • the specified device side can set NPAPI.
  • the NPAPK Netscape Plugin Application Programming Interface is a generic interface for executing external applications in a browser. Each plugin in the Netscape plugin declares itself Holding one or several content types, when the browser encounters this type of content, it looks for a plugin that can be decoded in the plugin library, and distributes the content to it, and in the corresponding position of the webpage. display.
  • the corresponding API Application Programming Interface
  • the system can be called to implement corresponding functions, such as shutting down, adjusting the volume, controlling the mouse operation and the like.
  • the browser provides SetCursorPos, Shutdown, Snapshot, MouseDown to the javascript script in the extension web page through the NPAPI mechanism (currently the mechanism has been applied to Chrome, browsers based on Chromium open source projects and browsers such as Firefox).
  • MouseUp, KeyDown, KeyUp and other interface functions javascript communicate with the server through websocket, after receiving the control command, call these javascript interface functions extended by NPAPI, realize the control cursor position, simulate mouse click and keyboard press, computer Snapshot, computer shutdown and other functions.
  • the device control method of this embodiment includes the following steps:
  • Step S202 The mobile communication terminal acquires information of at least one designated device to be controlled from the network control server.
  • the network control server may pre-store information of one or more designated devices to be controlled, and send information of the designated devices to be controlled to the mobile communication terminal upon receiving the request of the mobile communication terminal; the network control server may also be Upon receiving the request from the mobile communication terminal, the information is transmitted to the designated device to which it is connected, and information of one or more designated devices to be controlled is acquired, and then returned to the mobile communication terminal.
  • the mobile communication terminal sends a request to the network control server through the WebSocket connection, and acquires information of at least one designated device to be controlled from the network control server through the WebSocket connection. That is, the communication between the mobile communication terminal and the network control server follows the WebSocket protocol. Similarly, there is a WebSocket connection between the network control server and the specified device, and the two also follow the WebSocket protocol for communication.
  • the mobile communication terminal acquires information of the at least one designated device to be controlled from the network control server
  • the information of the specified device includes at least one of the following: a two-dimensional code of the specified device, an identifier of the designated device, and an IP address of the designated device
  • the mobile communication terminal recognizes and displays the designated device by specifying the information of the device.
  • the network control server knows according to the information of the designated device to be controlled
  • the device does not specify a device, and the information of the specified device includes at least one of the following: a two-dimensional code of the specified device, an identifier of the designated device, and an IP address of the designated device; the mobile communication terminal acquires the specified device identified by the network control server from the network control server.
  • Information is not specify a device, and the information of the specified device includes at least one of the following: a two-dimensional code of the specified device, an identifier of the designated device, and an IP address of the designated device
  • Step S204 The mobile communication terminal selects a designated device to be controlled according to the user input, and sends the authentication information to the network control server.
  • the authentication information is used to request authorization for the control operation of the selected designated device.
  • Step S206 The mobile communication terminal receives the confirmation authorization information returned by the network control server. By authorizing the authentication, it is possible to ensure the security of the operation control of the device by the mobile communication terminal.
  • Step S208 The mobile communication terminal acquires an HTML page of the selected designated device.
  • the mobile communication terminal can obtain the HTML page of the selected specified device in a variety of ways. For example, the mobile communication terminal sends a message acquisition command to the network control server by using a WebSocket connection, where the information acquisition command is used to obtain a control operation supported by the specified device; the network control server uses the WebSocket connection to send the information acquisition command to the designated device, so that the specified device Obtaining, by the NPAPI function, the control operation supported by the specified device and returning to the network control server, and forwarding the information to the mobile communication terminal by the network control server according to the information acquisition command; the mobile communication terminal according to the control operation information supported by the specified device returned by the network control server, The controls corresponding to the control operations supported by the specified device are displayed in the HTML page, and finally the HTML page corresponding to the specified device is generated.
  • the mobile communication terminal sends a message acquisition command to the network control server by using a WebSocket connection, where the information acquisition command is used to obtain a control operation supported by the specified device; the network control server sends the information acquisition command to the designated device by using a WebSocket connection, so that the specified The device obtains the control operation supported by the specified device through the NPAPI function and returns it to the network control server according to the information acquisition command.
  • the network control server generates a corresponding HTML page according to the information of the control operation supported by the specified device, and returns the corresponding HTML page to the mobile communication terminal.
  • the mobile communication terminal is pre-built with set HTML pages
  • the pre-built HTML pages include at least one of the following: a touchpad page, a shortcut operation page, and a selection terminal page, wherein the touchpad page is used to receive the user's touch
  • the information of the touch operation of the board page generates a control operation instruction according to the information of the touch operation to control the cursor operation of the designated device;
  • the page includes at least one of the following controls: a volume adjustment control, a device desktop display control, a device screen capture control, and a device shutdown control, and the shortcut operation page is configured to receive information about a user's operation on the control in the shortcut operation page, according to the operation of the control
  • the information generation control operation instruction controls the designated device to perform the control operation indicated by the control operation instruction;
  • the selection terminal page is used to display the information of the device to be controlled and the controlled state of the device to be controlled, so that the user selects the device to be controlled
  • the Select Terminal page also includes an authorization password input control for the user to
  • the mobile communication terminal After the mobile communication terminal obtains the authorization of the designated device, the mobile communication terminal displays all or part of the above-prepared HTML pages in advance for the user to operate. It should be noted that, in practical applications, a person skilled in the art may construct one or more of the above HTML pages according to actual needs, or integrate one or more of the above HTML pages into one HTML page, and use an HTML page. It can realize the operation function of the specified device, and it is flexible and easy to expand.
  • Step S210 The mobile communication terminal receives a control operation instruction for the user to perform a control operation on the designated device through the set HTML page.
  • the HTML page in the mobile communication terminal listens to the control operation performed by the user on the specified device through the HTML page, and obtains the information of the control operation through the DOM (Document Object Model) event of the HTML page, according to the control operation.
  • the information generates control operations instructions.
  • the DOM is the standard programming interface for W3C organizations that handles markup languages. It is a platform- and language-independent application interface that dynamically accesses programs and scripts, updating their content, structure, and style of www documents. Event processing is the most important part of the DOM.
  • the sophisticated event mechanism allows programs such as JavaScript programs to trigger different execution methods based on specific events, making the program more interactive and intelligent. For example, the mouse movement data on the HTML page can be obtained through the touchstart event, the touchmove event, and the touchend event.
  • Step S212 The mobile communication terminal uses a WebSocket connection to send a control operation instruction to the network control server through the HTML page.
  • the network control server can be built using Node.js.
  • Node.js is a set of JavaScript toolkits for writing high-performance web servers with single-threaded, non-blocking 10, event-driven, and many more.
  • the network control server can also use other suitable methods.
  • Build such as building an Apache (Apache) server.
  • the network control server establishes a connection between the mobile communication terminal and the designated device controlled by the mobile communication terminal through the WebSocket protocol.
  • Step S214 The network control server forwards the control operation instruction to the designated device by using a WebSocket connection.
  • Step S216 The designated device receives the control operation instruction, and according to the control operation instruction, invokes the system API of the specified device through the NPAPI to implement the control operation indicated by the control operation instruction.
  • a browser and a browser extension having an NPAPI mechanism are installed in the designated device of the embodiment.
  • the browser extension includes an NPAPI plug-in (ie, a DLL file), the browser extension is used to implement WebSocket communication between the specified device and the network control server, and the system API of the specified device is invoked through the NPAPI plug-in.
  • the specified device listens to and receives the control operation instruction sent by the network control server through the HTML page of the browser extension; further, the HTML page of the browser extension calls the NPAPI function corresponding to the control operation indicated by the control operation instruction, and passes the NPAPI function.
  • the corresponding system API function is called to implement the control operation indicated by the control operation instruction. For example, when the control operation indicated by the control operation instruction is a cursor movement operation, the NPAPI function called by the HTML page of the browser extension of the specified device is SetCursorPos, and the NPAPI function calls the mouse-event function of the system to realize the movement of the cursor.
  • the function of the mobile communication terminal as a remote controller is realized, such as a mobile phone remote controller, and the mobile communication terminal remote controller completes communication between the mobile communication terminal, such as a mobile phone and a designated device such as a computer, through a two-way communication mechanism of WebSocket, through NPAPI.
  • the plugin mechanism invokes the system's API to execute user commands, thereby enabling full control of the specified device in the event that the user is completely detached from the traditional input device.
  • FIG. 3 there is shown a flow chart of the steps of a device control method according to a third embodiment of the present invention.
  • the mobile communication terminal is a mobile phone
  • the designated device is a personal computer as an example.
  • the user controls the device control method of the present invention by performing a touch movement operation on the touch panel page of the mobile communication terminal to control the cursor operation of the designated device.
  • the device control method of this embodiment includes the following steps:
  • Step S302 Set up a network control server.
  • Node.js As an emerging back-end language, Node.js has many advantages, such as: RESTfol APL single-threaded, non-blocking 10, Google V8, event-driven, and more.
  • the construction of the network control server includes:
  • Step 1 Install Cygwin; then, download and install Node.js.
  • Step 2 Implement WebSocket communication with socket.io.js.
  • Socket.io.js is a js library file that uses the WebSocket specification in the HTML5 draft to implement two-way communication between the browser and the server. It provides functions such as sending a message (socket.emit ( )) and receiving information (socket.on ( ) ), broadcast information (socket.broadcast.emit ( )), etc.
  • APL a js library file that uses the WebSocket specification in the HTML5 draft to implement two-way communication between the browser and the server. It provides functions such as sending a message (socket.emit ( )) and receiving information (socket.on ( ) ), broadcast information (socket.broadcast.emit ( )), etc.
  • APL
  • the third step realize the authorization and authentication of the mobile communication terminal.
  • the designated device sends the controlled password to the network control server, and the network control server backs up the controlled password.
  • the control terminal that is, the mobile communication terminal wants to control a specified device, it needs to input the controlled password and send it to the network control server. Verify that if the password is entered correctly, control is obtained.
  • Step 4 The network control server acquires the command of the designated device, the control terminal, that is, the mobile communication terminal, and implements the transfer.
  • Step S304 Construct an HTML page in the mobile communication terminal, configured to perform a control operation on the designated device by the user, and send a control operation instruction generated according to the control operation.
  • the constructed HTML page includes a touch panel page, a shortcut operation page, and a selection terminal page.
  • the interface of the touchpad page is as shown in FIG. 4.
  • the touchpad page is used to receive information of a touch operation of the user on the touchpad page, and generates a control operation instruction according to the information of the touch operation to control the cursor operation of the device. Control the movement of the specified device cursor by dragging the touch point of the touchpad page (such as the white point in Figure 4) and calculating the distance it can be dragged (the unit can be a pixel).
  • the distance conversion method is Isometric conversion, that is, how much distance the touch point drags on the touch panel page of the mobile communication terminal such as the mobile phone, and how much distance the cursor on the computer moves.
  • the control terminal that is, the mobile communication terminal acquires the movement information or the click event of the touch point through the DOM event of the HTML page (including touchstart, touchmove, touchend, etc.), and then sends the corresponding data to the network control by using the socket.emit ( ) method.
  • the server listens to the control terminal, that is, the data sent by the mobile communication terminal through the socket.on ( ) and sends the data to the specified device by using the socket.broadcast.emit ( ) method, and the browser extension of the specified device passes the socket.on ( Listening to the data sent by the network control server, and calling the relevant system APIs (such as: mouse_ event , keybd_ event , OpenProcessToken , LookupPrivilege Value , AdjustTokenPrivileges , ExitWindowsEx ) through the NPAPI plugin (a DLL of the browser extension) Operational actions.
  • the distance conversion method can also be other suitable methods, such as proportional conversion.
  • the shortcut operation page is shown in FIG. 5, and is configured to receive information about the operation of the user on the shortcut operation page, and generate a control operation instruction according to the operation information of the control to control the device to perform the control operation indicated by the control operation instruction.
  • the shortcuts in the shortcut operation page are: a volume adjustment control, a device desktop display control, a device screen capture control, and a device shutdown control, that is, the shortcut operations performed on the device through the page include: adjusting the volume , display desktop, screen capture and shutdown.
  • control terminal that is, the shortcut operation of the mobile communication terminal
  • the type of data is invoked by the NPAPI plugin mechanism to call the corresponding system API.
  • the shortcut button of the embodiment is further provided with a selection terminal button control, and when the button is clicked, the selection terminal page is displayed, as shown in FIG. 6.
  • the interface of the terminal page is displayed as shown in FIG. 6 , and is used for displaying the information of the designated device to be controlled and the controlled state of the specified device to be controlled, so that the user selects the designated device to be controlled;
  • the authorization password input control is used for the user to input an authorization password for control operation authentication.
  • the Select Terminal page displays the specified device list obtained from the network control server and the controlled state of the specified device. After inputting the authorization password and verifying by the network control server, the user can obtain the control right of the selected designated device.
  • the specified device will have local information (for example, calculations) The machine name, IP address, controlled password, etc.
  • the network control server can send related information (in addition to the controlled password) to the control terminal, that is, the mobile communication terminal, and the control terminal, that is, the mobile communication terminal selects and specifies The device (such as according to the IP address or computer name) and input the controlled password and send it to the network control server for verification.
  • the network control server After the password is correct, the network control server returns the successful information, and the control terminal, that is, the mobile communication terminal obtains the control authority, and then the control terminal That is, the mobile communication terminal can control the designated device.
  • Step S306 Setting a specified device.
  • the browser extension program specifies that the device needs to rely on a browser extension (.crx, .xpi file).
  • the background page of the extension program is an HTML page for communication with the network control server.
  • the extension's NPAPI plugin is a DLL that completes the system API call.
  • the control terminal that is, the HTML page of the mobile communication terminal sends the control operation instruction to the network control server through the WebSocket
  • the network control server sends the control operation instruction to the designated device by using the WebSocket, so that the designated device accepts the instruction of the control terminal, that is, the mobile communication terminal.
  • the background page of the specified device browser extension parses the instruction and calls the related function of NPAPI, and then calls the system API (such as mouse_event, keybd_event, OpenProcessToken) by the NPAPI function. , LookupPrivilege Value, AdjustTokenPrivileges, ExitWindowsEx, etc.) Complete mouse clicks, move cursors, turn off events, and more.
  • the NPAPI plugin is a DLL that can directly call the system API, so that the specified device can receive the API through the NPAPI call system. The command.
  • the mobile communication terminal can start the operation control of the designated device, including:
  • Step S308 The mobile communication terminal acquires a list of designated devices (PCs).
  • the specified device sends the information of the machine (such as computer name, IP address, controlled password, etc.) to the network.
  • the network control server sends the related information of the specified device (in addition to the controlled password) to the control terminal, that is, the mobile communication terminal.
  • Step S310 The mobile communication terminal selects a designated device (PC) and performs authorization authentication.
  • the designated device sends the controlled password to the network control server, and the control terminal is the mobile communication terminal.
  • the authorization password input control of the HTML page such as the input control, enters a password and sends it to the network control server for verification. If the entered password is correct, it is authorized.
  • Step S312 The mobile communication terminal moves the cursor through the touch area of the touch panel page to generate a control operation instruction.
  • the DOM event of the touch panel page acquires the movement information and the click event of the touch point, thereby generating a control operation instruction.
  • the DOM event of the shortcut operation page acquires the button click information, thereby generating a control operation instruction.
  • Step S314 The mobile communication terminal communicates with the network control server by using a WebSocket connection, and sends a control operation instruction to the network control server through the touchpad page.
  • Step S316 The network control server communicates with the designated device by using a WebSocket connection, and sends a control operation instruction to the designated device.
  • Step S318 The specified device obtains a control operation instruction sent by the network control server through a background page of the browser extension program, and invokes a related NPAPI function.
  • the device calls the NPAPI function SetCursorPos.
  • Step S320 The designated device invokes the API function of the system through the NPAPI function, and performs a control operation indicated by the control operation instruction.
  • the API function mouse_ event corresponding to the NPAPI function in step S318 is called to implement the cursor operation of the specified device.
  • the device control method of the present invention is described by taking the cursor control operation of the designated device as an example.
  • the mobile communication terminal such as a mobile phone
  • a computer input device such as a traditional keyboard, touchpad, and mouse that conveniently operates the computer away from the computer and monitors the computer's functions in real time.
  • the new web standard and the characteristics of the mobile communication terminal, such as the mobile phone are adopted, and the mobile communication terminal such as the mobile phone is used as the input device of the computer, which greatly improves the user's access to the computer while maximizing the convenience of the computer input. Operating experience.
  • FIG. 7 there is shown a flow chart of the steps of a device control method according to a fourth embodiment of the present invention.
  • the device control method of this embodiment can be applied to the control of the IoT terminal device by the mobile communication terminal.
  • Step S402 The mobile communication terminal acquires information of at least one specified device within a certain range and displays it for the user to select the designated device.
  • the mobile communication terminal transmits a corresponding request to a designated device within a certain distance through a specific connection such as Bluetooth to obtain information of the surrounding designated device.
  • a specific connection such as Bluetooth
  • the mobile communication terminal can search for multiple IoT devices (such as smart TVs, smart refrigerators, etc.) in the same room through Bluetooth, obtain information of these devices, and then display them in the mobile communication terminal for the user to select and control. Specify the device.
  • Step S404 The mobile communication terminal receives the user's selection, determines the designated device, and sends a pairing request to the designated device, requesting to establish a pairing connection with the designated device.
  • the pairing request includes information of the mobile communication terminal.
  • the information of the mobile communication terminal comprises at least one of the following: a two-dimensional code of the mobile communication terminal, an identification of the mobile communication terminal, and an IP address of the mobile communication terminal.
  • Step S406 The mobile communication terminal receives the pairing response returned by the designated device and carries the information of the designated device, and establishes a pairing connection with the designated device according to the pairing response.
  • the information of the designated device comprises at least one of the following: a two-dimensional code of the specified device, an identifier of the designated device, and an IP address of the designated device.
  • Step S408 The mobile communication terminal acquires an HTML page corresponding to the designated device. For example, after establishing a pairing connection with the designated device, the mobile communication terminal sends an information acquisition command to the designated device through the pairing connection to request to acquire the control operation supported by the designated device; and further, according to the information of the supported control operations returned by the specified device. Generate an HTML page.
  • the mobile communication terminal stores the matching with one or more types of designated devices.
  • the HTML page after obtaining the information of the specified device, the mobile communication terminal determines the type of the specified device according to the information, and then selects the matching HTML page.
  • the mobile communication terminal sends the obtained information of the specified device to the server; the server determines the type of the specified device, and generates
  • the HTML page is sent to the mobile communication terminal, or the server returns an operation supported by the designated device of the type to the mobile communication terminal according to the type of the designated device, and the corresponding HTML page is generated by the mobile communication terminal.
  • the mobile communication terminal Taking a smart TV as an example, the mobile communication terminal generates a corresponding information according to the information returned by the smart TV.
  • the HTML page which can include a switch button control, a volume adjustment control, a channel adjustment control, a menu operation control, etc., through which the remote control of the smart TV can be realized.
  • Step S410 The mobile communication terminal receives a control operation instruction that the user performs a control operation on the designated device through the HTML page.
  • Step S412 The mobile communication terminal sends the control operation instruction to the designated device successfully paired by using the paired connection through the HTML page.
  • Step S414 The designated device receives a control operation instruction sent by the mobile communication terminal through the pairing connection, and performs a control operation indicated by the control operation instruction.
  • point-to-point device control is achieved. Only one mobile communication terminal can realize the control of a variety of designated devices, without special remote control or control software, which realizes compatible operation of multiple devices in the case of far away from the device, and improves the user experience.
  • the apparatus for performing device control is provided in the mobile communication terminal of the embodiment, and includes: a receiving module 502 configured to receive a control operation of the specified device by the user through the set HTML page. Controlling an operation instruction, wherein the HTML page is configured to provide an interface for the user to perform a control operation on the designated device through the mobile communication terminal, receive a control operation instruction generated by the user for the interface operation, and send a control operation instruction; the control module 504 is configured to pass The HTML page sends a control operation instruction to the designated device, causing the designated device to perform the control operation indicated by the control operation instruction.
  • control module 504 is configured to use a WebSocket connection to send a control operation instruction to the network control server through the HTML page, and the network control server uses the WebSocket connection to forward the control operation instruction to the designated device, so that the designated device according to the control operation instruction.
  • the control function indicated by the control operation instruction is implemented by calling the system API of the specified device through the NPAPI.
  • the designated device is installed with a browser and a browser extension with NPAPI, wherein the browser extension includes an NPAPI plug-in, the browser extension is used to implement WebSocket communication between the specified device and the network control server, and is invoked through the NPAPI plug-in. Specifies the system API of the device.
  • control module 504 causes the designated device to monitor and receive the network control through the HTML page of the browser extension program when the specified device performs the control operation indicated by the control operation instruction by using the system API of the specified device according to the control operation instruction.
  • the control operation instruction sent by the server; the HTML page of the browser extension program invokes an NPAPI function corresponding to the control operation indicated by the control operation instruction, and invokes the corresponding system API function through the NPAPI function to implement the control operation indicated by the control operation instruction .
  • the mobile communication terminal of this embodiment further includes: a selection module 506 configured to acquire at least one from the network control server before the receiving module 504 receives a control operation instruction that the user controls the specified device through the set HTML page.
  • a selection module 506 configured to acquire at least one from the network control server before the receiving module 504 receives a control operation instruction that the user controls the specified device through the set HTML page.
  • Information of the designated device to be controlled selecting a designated device to be controlled, and transmitting authentication information to the network control server, the authentication information is used to request authorization for the control operation of the selected designated device; and receiving the confirmation authorization information returned by the network control server.
  • the selecting module 506 is further configured to: after receiving the confirmation authorization information returned by the network control server, send a message acquisition command to the network control server by using a WebSocket connection, where the information acquisition command is used to obtain a control operation supported by the designated device;
  • the control server sends a message acquisition command to the specified device by using a WebSocket connection, so that the specified device obtains the information according to the information.
  • the command obtains the control operation supported by the specified device through the NPAPI function and returns it to the network control server, which is forwarded to the selection module by the network control server; the selection module displays the information in the HTML page according to the information of the control operation supported by the specified device returned by the network control server.
  • a control that corresponds to the control operations supported by the specified device.
  • the selecting module 506 acquires information of at least one designated device to be controlled from the network control server when acquiring information of the at least one specified device to be controlled from the network control server, where the information of the specified device includes at least one of the following: Specifying the QR code of the device, the identifier of the specified device, and the IP address of the specified device; the mobile communication terminal identifies and displays the designated device by specifying the information of the device; or the network control server identifies the designated device according to the information of the designated device to be controlled; The mobile communication terminal acquires information of the designated device identified by the network control server from the network control server.
  • the network control server is built using Node.js.
  • control module 504 is configured to send a control operation instruction to the designated device successfully paired with the mobile communication terminal through the HTML page, so that the designated device performs the control operation indicated by the control operation instruction.
  • the mobile communication terminal of this embodiment further includes: a pairing module 508, configured to send a pairing request to the designated device before the receiving module 502 receives a control operation instruction that the user controls the specified device through the set HTML page, And requesting to establish a pairing connection with the specified device, where the pairing request includes information of the mobile communication terminal; receiving a pairing response returned by the specified device and carrying the information of the designated device, and establishing a pairing connection with the designated device according to the pairing response.
  • a pairing module 508 configured to send a pairing request to the designated device before the receiving module 502 receives a control operation instruction that the user controls the specified device through the set HTML page, And requesting to establish a pairing connection with the specified device, where the pairing request includes information of the mobile communication terminal; receiving a pairing response returned by the specified device and carrying the information of the designated device, and establishing a pairing connection with the designated device according to the pairing response.
  • the information of the mobile communication terminal comprises at least one of: a two-dimensional code of the mobile communication terminal, an identifier of the mobile communication terminal, an IP address of the mobile communication terminal; the information of the designated device includes at least one of the following: Code, the identifier of the specified device, and the IP address of the specified device.
  • the mobile communication terminal of this embodiment further includes: a building module 510 configured to construct a set HTML page before the receiving module 502 receives a control operation instruction that the user controls the specified device through the set HTML page.
  • the HTML page includes at least one of the following: a touchpad page, a shortcut operation page, and a selection terminal page, wherein the touchpad page is configured to receive information of a touch operation of the user on the touchpad page, and generate a control operation finger according to the information of the touch operation.
  • the shortcut operation page includes at least one of the following controls: a volume adjustment control, a device desktop display control, a device screen capture control, and a device shutdown control, and the shortcut operation page is used to receive the user in the shortcut operation page.
  • the information of the operation of the control generates a control operation instruction according to the information of the operation of the control to control the control operation indicated by the specified operation instruction by the designated device;
  • the terminal page is configured to display the information of the device to be controlled and the device to be controlled Control state, for the user to select the device to be controlled, the selection terminal page also includes an authorization password input control for the user to input an authorization password for control operation authentication.
  • the receiving module 502 is configured to monitor, by the set HTML page, a control operation performed by the user on the specified device through the HTML page, obtain information of the control operation through the DOM event of the HTML page, and generate a control operation instruction according to the information of the control operation.
  • the mobile communication terminal in this embodiment is used to implement the corresponding device control method in the foregoing method embodiments, and has the beneficial effects of the corresponding method embodiments, and details are not described herein again.
  • the present invention also provides a computer readable recording medium having recorded thereon a program for executing the control method of any of the foregoing embodiments 1 to 4.
  • the computer readable recording medium includes any mechanism for storing or transmitting information in a computer readable form.
  • a machine-readable medium includes a read only memory (ROM), a random access memory (RAM), a magnetic disk storage medium, an optical storage medium, a flash storage medium, an electrical, optical, acoustic, or other form of propagated signal (eg, a carrier wave) , infrared signals, digital signals, etc.).
  • ROM read only memory
  • RAM random access memory
  • magnetic disk storage medium an optical storage medium
  • flash storage medium an electrical, optical, acoustic, or other form of propagated signal (eg, a carrier wave) , infrared signals, digital signals, etc.).
  • Various general purpose systems can also be used with the teaching based on the teachings herein. From the above description, it is apparent that the structure required to construct the system having the solution of the present invention is apparent. Moreover, the invention is not directed to any particular programming language. It will be appreciated that the teachings of the invention described herein may be implemented in a variety of programming languages, and that the description of the specific language above is for the purpose of
  • modules in the devices of the embodiments can be adaptively changed and placed in one or more devices different from the embodiment.
  • the modules or units or components of the embodiments may be combined into one module or unit or component, and further, they may be divided into a plurality of sub-modules or sub-units or sub-assemblies.
  • any combination of the features disclosed in the specification, including the accompanying claims, the abstract and the drawings, and any methods so disclosed may be employed. Or combine all the processes or units of the device.
  • Each feature disclosed in the specification (including the accompanying claims, the abstract, and the drawings) may be replaced by alternative features that provide the same, equivalent, or similar purpose, unless stated otherwise.
  • the various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof.
  • a microprocessor or digital signal processor may be used in practice to implement some or all of the functionality of some or all of the components of the device control scheme in accordance with embodiments of the present invention.
  • the invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein.
  • the program can be stored on a computer readable medium or can be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)

Abstract

La présente invention concerne un procédé de commande de dispositif et un terminal de communication mobile. Selon la présente invention, le procédé de commande de dispositif fait appel : à la réception, par le terminal de communication mobile, d'une instruction d'opération de commande d'un utilisateur servant à exécuter une opération de commande sur un dispositif désigné par le biais d'une page HTML déterminée, la page HTML étant prévue pour une utilisation dans l'établissement d'une interface permettant à l'utilisateur d'exécuter l'opération de commande sur le dispositif désigné par le biais du terminal de communication mobile, à la réception de l'instruction d'opération de commande générée par l'utilisateur en utilisant l'interface et à la transmission de l'instruction d'opération de commande; puis à la transmission, par le dispositif de communication mobile, de l'instruction d'opération de commande au dispositif désigné par le biais de la page HTML, en permettant ainsi au dispositif désigné d'exécuter l'opération de commande indiquée par l'instruction d'opération de commande. La présente invention permet d'obtenir les effets d'une commande à distance d'un dispositif et d'une expérience d'exploitation améliorée pour l'utilisateur.
PCT/CN2013/084437 2012-12-12 2013-09-27 Procédé de commande de dispositif et terminal de communication mobile WO2014090016A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210537144.1 2012-12-12
CN201210537144.1A CN103051693B (zh) 2012-12-12 2012-12-12 设备控制方法与移动通信终端

Publications (1)

Publication Number Publication Date
WO2014090016A1 true WO2014090016A1 (fr) 2014-06-19

Family

ID=48064187

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/084437 WO2014090016A1 (fr) 2012-12-12 2013-09-27 Procédé de commande de dispositif et terminal de communication mobile

Country Status (2)

Country Link
CN (1) CN103051693B (fr)
WO (1) WO2014090016A1 (fr)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051693B (zh) * 2012-12-12 2016-12-21 北京奇虎科技有限公司 设备控制方法与移动通信终端
CN103401738B (zh) * 2013-07-31 2017-03-01 小米科技有限责任公司 一种连接终端的方法及装置
CN104424002B (zh) * 2013-09-10 2017-12-12 中国科学院声学研究所 一种基于插件机制的动态加载组件方法和系统
CN104461413B (zh) * 2013-09-17 2017-11-28 哈尔滨安天科技股份有限公司 一种基于web技术的LED显示控制系统及方法
CN103631556A (zh) * 2013-11-06 2014-03-12 天脉聚源(北京)传媒科技有限公司 一种远程控制显示设备的方法、移动终端及系统
CN103605491A (zh) * 2013-11-08 2014-02-26 天脉聚源(北京)传媒科技有限公司 一种远程控制显示设备的方法、移动终端及系统
CN104796565B (zh) * 2014-01-16 2018-12-07 华为终端有限公司 控制移动终端音量的方法、终端以及移动终端
CN103746906A (zh) * 2014-01-22 2014-04-23 北京奇虎科技有限公司 推送移动终端控制pc操作相关消息的方法及装置和系统
WO2016017978A1 (fr) * 2014-07-31 2016-02-04 Samsung Electronics Co., Ltd. Dispositif et procédé pour exécuter des fonctions
CN104394237B (zh) * 2014-12-19 2018-07-13 北京奇虎科技有限公司 浏览器与移动终端之间进行通信的方法及浏览器装置
CN104966015B (zh) * 2015-07-30 2018-01-19 成都中科创达软件有限公司 一种智能设备之间的控制方法及系统
CN105630376A (zh) * 2015-12-18 2016-06-01 小米科技有限责任公司 终端控制方法和装置
CN105898893B (zh) * 2016-05-31 2020-09-22 北京乐美无限科技有限公司 一种移动终端与物联网设备全双工通信的方法
CN106341489A (zh) * 2016-10-09 2017-01-18 珠海我爱拍科技有限公司 一种通过网页对智能物联网设备进行远程交互的控制系统
CN108810054A (zh) * 2017-05-04 2018-11-13 宏碁股份有限公司 云端管理系统及其装置配置方法
CN108038129A (zh) * 2017-11-11 2018-05-15 南京邮电大学 一种基于chromium内核的物联网浏览器方案
CN113433831A (zh) * 2021-06-29 2021-09-24 青岛海尔科技有限公司 智能家居设备的控制方法、模块及存储介质
CN113452588A (zh) * 2021-06-29 2021-09-28 青岛海尔科技有限公司 设备绑定列表的显示方法及装置、存储介质及电子装置
CN114095555A (zh) * 2021-12-08 2022-02-25 金蝶医疗软件科技有限公司 信息采集方法及相关设备

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101132335A (zh) * 2007-07-24 2008-02-27 南昌大学 Web方式下的远程设备控制
US20100241254A1 (en) * 2007-09-05 2010-09-23 Savant Systems Llc Web browser based remote control for programmable multimedia controller
CN102594997A (zh) * 2012-04-05 2012-07-18 何乙诚 一种手机远程控制电脑的方法
CN102611753A (zh) * 2012-03-21 2012-07-25 张雷 一种移动终端基于云平台控制受控设备的系统和方法
CN102692881A (zh) * 2012-05-16 2012-09-26 中国海洋大学 一种基于二维码的家电控制方法及控制系统
CN102739800A (zh) * 2012-07-05 2012-10-17 合一网络技术(北京)有限公司 基于互联网对浏览器Web页面进行遥控的系统和方法
CN103049190A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 一种移动通信终端及控制设备操作的方法
CN103051694A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 移动通信终端控制设备的方法与移动通信终端
CN103051693A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 设备控制方法与移动通信终端
CN103067448A (zh) * 2012-12-12 2013-04-24 北京奇虎科技有限公司 设备控制方法与移动通信终端

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638716A (zh) * 2012-03-21 2012-08-15 华为技术有限公司 实现移动终端遥控电视的方法、装置和系统

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101132335A (zh) * 2007-07-24 2008-02-27 南昌大学 Web方式下的远程设备控制
US20100241254A1 (en) * 2007-09-05 2010-09-23 Savant Systems Llc Web browser based remote control for programmable multimedia controller
CN102611753A (zh) * 2012-03-21 2012-07-25 张雷 一种移动终端基于云平台控制受控设备的系统和方法
CN102594997A (zh) * 2012-04-05 2012-07-18 何乙诚 一种手机远程控制电脑的方法
CN102692881A (zh) * 2012-05-16 2012-09-26 中国海洋大学 一种基于二维码的家电控制方法及控制系统
CN102739800A (zh) * 2012-07-05 2012-10-17 合一网络技术(北京)有限公司 基于互联网对浏览器Web页面进行遥控的系统和方法
CN103049190A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 一种移动通信终端及控制设备操作的方法
CN103051694A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 移动通信终端控制设备的方法与移动通信终端
CN103051693A (zh) * 2012-12-12 2013-04-17 北京奇虎科技有限公司 设备控制方法与移动通信终端
CN103067448A (zh) * 2012-12-12 2013-04-24 北京奇虎科技有限公司 设备控制方法与移动通信终端

Also Published As

Publication number Publication date
CN103051693A (zh) 2013-04-17
CN103051693B (zh) 2016-12-21

Similar Documents

Publication Publication Date Title
WO2014090016A1 (fr) Procédé de commande de dispositif et terminal de communication mobile
CN103049190B (zh) 一种移动通信终端及控制设备操作的方法
US10552518B2 (en) Administration of web page
CN103051694B (zh) 移动通信终端控制设备的方法与移动通信终端
CN103067448B (zh) 设备控制方法与移动通信终端
US9553953B2 (en) Method and apparatus for extending capabilities of a virtualization domain to support features available in a normal desktop application
US8863237B2 (en) Remote-session-to-go method and apparatus
WO2015161786A1 (fr) Procédé de commande à distance, serveur, dispositif de commande et système
US9578113B2 (en) Method and apparatus for transferring remote session data
US20130041938A1 (en) Dynamic Mobile Interaction Using Customized Interfaces
US20140298188A1 (en) Remote operation method and system
CN104270662A (zh) 一种终端设备通过浏览器对智能电视进行控制的系统
JP7359234B2 (ja) 情報処理装置、情報処理システム、情報処理方法及びプログラム
US20190011997A1 (en) Command relay device, system and method for providing remote assistance/remote control
AU2011352057A1 (en) Methods and systems for displaying content on multiple networked devices with a simple command
JP2015191505A (ja) 情報処理端末、表示端末、表示方法、及びプログラム
WO2017193678A1 (fr) Procédé et appareil de commande de dispositif, et système de commande de dispositif
WO2017096813A1 (fr) Procédé d'affichage de page web, terminal mobile, terminal intelligent, programme et support d'informations
WO2018000623A1 (fr) Procédé et appareil de fonctionnement de page web
WO2017096812A1 (fr) Procédé d'affichage de page web, terminal mobile, terminal intelligent, programme informatique, et support de stockage
WO2015081716A1 (fr) Procédé, système, et dispositif associé destinés à la fourniture de service d'application
KR101896135B1 (ko) 정보 처리 장치, 정보 처리 시스템, 및 프로그램
KR101514535B1 (ko) 퍼스널 컴퓨터를 통한 모바일 디바이스 입력 방법 및 장치
CN103269360A (zh) 一种对电器设备进行控制的方法及装置
KR20160093877A (ko) 가상 클라이언트와 클라우드 스트리밍 서버, 그를 포함하는 클라우드 스트리밍 서버 테스트 시스템, 그 제어 방법 및 컴퓨터 프로그램이 기록된 기록매체

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13861577

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13861577

Country of ref document: EP

Kind code of ref document: A1