WO2018201695A1 - 设备的控制方法、装置、系统及虚拟现实vr设备 - Google Patents

设备的控制方法、装置、系统及虚拟现实vr设备 Download PDF

Info

Publication number
WO2018201695A1
WO2018201695A1 PCT/CN2017/111858 CN2017111858W WO2018201695A1 WO 2018201695 A1 WO2018201695 A1 WO 2018201695A1 CN 2017111858 W CN2017111858 W CN 2017111858W WO 2018201695 A1 WO2018201695 A1 WO 2018201695A1
Authority
WO
WIPO (PCT)
Prior art keywords
controlled
terminal
display interface
control
virtual display
Prior art date
Application number
PCT/CN2017/111858
Other languages
English (en)
French (fr)
Inventor
张百胜
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018201695A1 publication Critical patent/WO2018201695A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the present invention relates to the field of communications, and in particular, to a device control method, device, system, and virtual reality (VR) device method and device.
  • VR virtual reality
  • IOT Internet Of Things
  • VR devices and other products have become more and more popular in recent years and can be visually operated simply and intuitively, VR technology has not been applied to the field of Internet of Things.
  • Existing IoT technology solutions cannot implement IoT devices, especially The IoT device with the display function performs virtual display and intuitively controls the IoT device remotely by capturing operation events, which greatly reduces the user experience.
  • the embodiment of the invention provides a device control method, device, system and VR device, so as to at least solve the virtual image that cannot directly display the device in the related art, and can not remotely control the device through the capture operation event, thereby greatly reducing The problem of the user's experience.
  • a method for controlling a device including: a terminal establishes a communication connection with a device to be controlled; and after establishing a connection, the terminal acquires device information of the device to be controlled, and generates the to-be-processed a virtual display interface of the control device, wherein the virtual display interface is at least used to display a control function component of the device to be controlled; and the terminal according to the captured operation event and the control function component displayed by the virtual display interface, Generated for the waiting
  • the control device performs an operation instruction of the control and sends the operation instruction to the device to be controlled.
  • the virtual display interface includes a virtual 3D image of the device to be controlled.
  • the terminal generates an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed by the virtual display interface, and sends the operation instruction to the device to be controlled, including: The terminal captures the operation event; the terminal determines control information according to a matching result of the operation event and the control function component; the terminal converts the control information into the operation instruction, and sends the operation instruction to the The device to be controlled.
  • the terminal acquires the device information of the device to be controlled, and generates a virtual display interface of the device to be controlled, including: determining, by the terminal, the type and device to which the device to be controlled belongs according to the device information. Determining a list of functions that the control device can support; the terminal generating the virtual display interface corresponding to the type according to the type and the function list.
  • the method further includes: receiving, by the terminal, feedback information sent by the device to be controlled, where the feedback information is used to feed back the a result of the control to be controlled by the device; the terminal updating the virtual display interface according to the feedback information.
  • the method further includes: the terminal scanning the device to be controlled within a specified range, where the specified range is that the terminal and the device to be controlled reside together Wireless network.
  • the terminal is a VR device.
  • a device control device configured to establish a communication connection with the device to be controlled; and the first processing module is configured to establish a connection, Acquiring the device information of the device to be controlled, and generating a virtual display interface of the device to be controlled, wherein the virtual display interface is at least used to display a control function component of the device to be controlled; and the second processing module is configured to And generating, according to the captured operation event and the control function component displayed by the virtual display interface, an operation instruction for controlling the device to be controlled, and sending the operation instruction to the device to be controlled.
  • the second processing module is configured to capture the operation event; according to the operation The matching result of the event and the control function component determines control information; and converts the control information into the operation instruction and sends the control information to the device to be controlled.
  • a VR device including: a scanner configured to scan a device to be controlled within a specified range; a processor configured to establish a communication connection with the device to be controlled; Obtaining the device information of the device to be controlled, and generating a virtual display interface of the device to be controlled, wherein the virtual display interface is used to display at least a control function component of the device to be controlled; and an operation event according to the captured operation And the control function component displayed by the virtual display interface generates an operation instruction for controlling the device to be controlled, and sends the operation instruction to the device to be controlled.
  • the processor is further configured to: capture the operation event; determine control information according to a matching result of the operation event and the control function component; and convert the control information into the operation instruction, and send To the device to be controlled.
  • a control system for a device comprising: a VR device and a device to be controlled, wherein the VR device is configured to establish a communication connection with the device to be controlled; Determining device information of the device to be controlled, and generating a virtual display interface of the device to be controlled, wherein the virtual display interface is at least used to display a control function component of the device to be controlled; and according to the captured operation event and the The control function component displayed by the virtual display interface generates an operation instruction for controlling the device to be controlled, and sends the operation instruction to the device to be controlled; the device to be controlled is configured to receive the operation instruction; The operation instruction controls the device to be controlled.
  • the VR device is configured to capture the operation event; determine control information according to a matching result of the operation event and the control function component; and convert the control information into the operation instruction, and send to the operation instruction The device to be controlled.
  • a storage medium is also provided.
  • the storage medium is configured to store a program code for performing the following steps: the terminal establishes a communication connection with the device to be controlled; after the connection is established, the terminal acquires device information of the device to be controlled, and generates a virtual a display interface, wherein the virtual display interface is at least used to display the to-be-controlled a control function component of the device; the terminal generates an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed by the virtual display interface, and sends the operation instruction to the device to be controlled .
  • the storage medium is further configured to store program code for performing: the terminal capturing the operation event; the terminal determining control information according to a matching result of the operation event and the control function component; The terminal converts the control information into the operation instruction and sends the control information to the device to be controlled.
  • the storage medium is further configured to store program code for performing: the terminal determining, according to the device information, a type to which the device to be controlled belongs and a function list that the device to be controlled can support; The terminal generates the virtual display interface corresponding to the type according to the type and the function list.
  • the storage medium is further configured to store program code for performing: the terminal receiving feedback information sent by the device to be controlled, wherein the feedback information is used for feedback to control the device to be controlled The result is that the terminal updates the virtual display interface according to the feedback information.
  • the storage medium is further configured to store program code for performing: the terminal scanning the device to be controlled within a specified range, wherein the specified range is that the terminal is common to the device to be controlled Resident wireless network.
  • the terminal can generate a virtual display interface of the device after establishing a communication connection with the device, and generates an operation instruction for controlling the device according to the captured operation event and the control function component displayed by the virtual display interface, the device and the device are implemented.
  • the visual virtual display of the information solves the problem that the virtual display of the device, especially the device without the display function, can be realized in the prior art, and the device is remotely controlled by the capture operation event, thereby greatly reducing the user experience.
  • the problem is to achieve a virtual image of the visual display device, which reduces the difficulty of remote device control and improves the user experience.
  • FIG. 1 is a network structure diagram of device control according to an embodiment of the present invention.
  • FIG. 2 is a flow chart of a method of controlling a device according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a VR device according to an embodiment of the present invention.
  • FIG. 4 is a flow chart of a method of controlling a device in accordance with an alternative embodiment of the present invention.
  • Fig. 5 is a block diagram showing the structure of a control device of a device according to an embodiment of the present invention.
  • the network architecture includes: a terminal 12 and a device to be controlled 14, wherein the terminal 12 is configured to scan a device to be controlled within a specified range. And establishing a communication connection with the device to be controlled 14; generating a virtual display interface according to the device information of the device 14 to be controlled, and displaying the virtual display interface to the user, and performing a specified operation according to the content of the virtual display interface, such as nodding
  • the operation terminal or the like is called, the terminal 12 captures the operation event, and generates an operation instruction according to the operation event; the terminal 12 sends the operation instruction to the device to be controlled 14 to implement remote control of the device to be controlled 14, the terminal 12 receives the feedback information sent by the device 14 to be controlled and updates the virtual display interface according to the feedback information.
  • FIG. 2 is a flowchart of a method for controlling a device according to an embodiment of the present invention. Including the following steps:
  • Step S202 the terminal establishes a communication connection with the device to be controlled
  • Step S204 After the connection is established, the terminal acquires device information of the device to be controlled, and generates a virtual display interface of the device to be controlled, where the virtual display interface is used to display at least a control function component of the device to be controlled;
  • Step S206 the terminal generates an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed on the virtual display interface, and sends the operation instruction to the device to be controlled.
  • the operation event may be an action event, such as a nod, a wave, or the like, or a voice event, such as an operation instruction such as “start” or “close” spoken by the user, or may be an action event and a voice event.
  • the control function component is used to indicate the correspondence between the operation event and the function of the device to be controlled.
  • the control function component may be defined as shaking the head to represent the closing of the light, or shaking the head to confirm the current selection function.
  • the communication between the terminal and the device to be controlled is implemented by establishing a communication connection with the device to be controlled.
  • the device to be controlled may be multiple, and the terminal may simultaneously display virtual images of multiple devices, and the user may freely select the virtual display interface to display.
  • the actions that can be performed can be various, such as: turning the head to the left and right to cancel the operation, nodding to indicate the confirmation operation, and waving the hand to indicate the selection operation.
  • the terminal can generate a virtual display interface of the device after establishing a communication connection with the device, and generate an operation instruction for controlling the device according to the operation event captured by the virtual display interface, thereby realizing an intuitive virtualization of the device and its information.
  • the display solves the problem that the virtual display of the device, especially the device without the display function, can be realized in the prior art, and the device is remotely controlled by the capture operation event, thereby greatly reducing the user experience and intuitively Displaying the virtual image of the device reduces the difficulty of remote device control and improves the user experience.
  • the virtual display interface includes a virtual 3D image of the device to be controlled. Through the virtual 3D image, the user can visually observe the appearance of the device to be controlled.
  • the virtual display interface may further include a visual menu, wherein the visual menu may be used to display a control function component.
  • the visual menu may display: 1. shaking the head to turn off the electric light; Nod to turn on the light, or, 1. Raise the light Brightness; 2. Reduce the brightness of the lamp; 3. Turn off the light; 4. Turn on the light, and prompt the user to select one of the items 1-4 by waving the hand, nodding to confirm. In this way, the user can not only see the 3D image of the device to be controlled but also perform corresponding actions according to the control function component displayed by the visual menu, thereby realizing control of the device.
  • the foregoing step S206 can be implemented by: the terminal capturing an operation event; the terminal determining the control information according to the matching result of the operation event and the control function component; the terminal converting the control information into the operation instruction, and sending the The device to be controlled.
  • the terminal determines the actual meaning of the operation event and the control information corresponding thereto by comparing the operation event and the control function component of the user, for example, when the user When nodding, it is determined that the control information input by the user is confirmation. Moreover, since the control information cannot directly control the device, it is necessary to convert the control information into an operation instruction, and the remote control of the device to be controlled can be effectively realized by the operation performed by the terminal.
  • the control function component may be preset in the terminal according to the type and function of the device, or may generate a control function component corresponding to the function of the device to be controlled in real time according to the information of the device to be controlled, but is not limited thereto.
  • step S204 is performed in the following manner: the terminal determines, according to the device information, a type to which the device to be controlled belongs and a function list that the device to be controlled can support; the terminal generates a virtual display corresponding to the type according to the type and the function list. interface.
  • the corresponding display interface can be displayed according to the type of the device to be controlled, and the type can be divided according to the function of the device to be controlled, such as: audio device, lighting device, heating device. Wait.
  • the terminal may further perform the following operations: the terminal receives feedback information sent by the device to be controlled, where the feedback information is used to feed back a result of controlling the device to be controlled; and the terminal updates according to the feedback information.
  • Virtual display interface the terminal receives feedback information sent by the device to be controlled, where the feedback information is used to feed back a result of controlling the device to be controlled; and the terminal updates according to the feedback information.
  • the virtual display interface may be updated, so that the user can obtain the device information of the device to be controlled in time, and then determine whether the device to be controlled is successfully implemented.
  • Control optionally, the virtual 3D map The image can be updated according to the real-time status of the device to be controlled. In this way, the user can visually see the state of the device to be controlled.
  • the terminal scans the device to be controlled within a specified range, where the specified range is a wireless network where the terminal and the device to be controlled reside together.
  • the wireless network where the terminal and the device to be controlled reside together may be WiFi or Bluetooth.
  • the terminal is a VR device.
  • the VR device can perform the visual operation simply and intuitively, and the VR device can recognize the action of the user, and send different control commands to the device to be controlled according to different actions of the user, for example, when the VR device is a helmet, The rotation of the helmet can perform a selection operation on the device to be controlled that is scanned and enumerated, and the determination operation is performed by the up and down movement of the helmet, and the corresponding selection and determination operations are performed by recognizing the gesture of the user.
  • some specific conditions can also be set on the VR device, and when the condition is met, a specific control instruction is sent to the device to be controlled, for example, when the camera of the VR recognizes a device to be controlled, it is directly to be controlled.
  • the device sends a control command to start or shut down the device.
  • the VR device can also recognize the voice of the user. When the user says “start”, the VR device recognizes the voice event, scans the device to be controlled within the specified range, and then displays the 3D image of the device to be controlled on the VR device, such as At the same time, the 3D image of the desk lamp, air conditioner and water heater is displayed. When the VR device recognizes that the new voice event is "turning on the light", the lamp is turned on.
  • the VR device may include a module as shown in FIG. 3: a device scan discovery module 32, a device control module 34, a visual menu display module 36, a visual menu control module 38, and an interoperation module 310.
  • a device scan discovery module 32 a device control module 34, a visual menu display module 36, a visual menu control module 38, and an interoperation module 310.
  • the functions of the above modules are as follows:
  • the device scan discovery module 32 is configured to scan and discover devices connected to the network, and indicate the type of the device and a list of supported functions.
  • the device type of the wireless speaker is an audio device
  • the supported functions include volume adjustment and equalization. Adjustment, bass effect adjustment, scene adjustment, etc.;
  • Device control module 34 is set to command control and results between the VR device and the IOT device Feedback, for example, adjust the volume of the wireless speaker.
  • the VR device sends an instruction to increase the volume through the network, the volume is turned up after the speaker is received, and then the feedback execution result is fed back;
  • the visual menu display module 36 is configured to display a function list, interaction behavior, feedback information, and the like on the screen of the VR device;
  • the visual menu control module 38 is configured to respond to the user's operation of the visual menu. After the user controls the visual menu through the interactive operation module 310, the visual menu control module 38 converts the user's control information into a control command and sends the control command to the device control module 34. The device control module 34 then performs an operation process on the device, and the visual menu control module 38 notifies the visualized menu display module 36 of the received processing result;
  • the interoperation module 310 is configured to receive input operations by a user.
  • FIG. 4 is a flowchart of a method for controlling a device according to an alternative embodiment of the present invention.
  • the execution body of the process is the VR device shown in FIG. 3.
  • the process includes the following steps:
  • Step S402 The device scan discovery module 32 scans the device supporting the interconnection function in the network where it resides, and determines the type of the scanned device;
  • Step S404 The device scan discovery module 32 sends the determined device information of the device to the visual menu display module 36.
  • the visual menu module 36 parses the device information, and generates different executable actions for displaying the user and waiting for different types of devices. Controlling a display interface of the virtual 3D image of the device, and displaying the above display interface on the screen of the VR device;
  • Step S406 The interaction operation module 310 captures the user action and acquires the control information corresponding to the user action, converts the control information into standard control information for operations such as selection and confirmation, and sends the standard control information to the visual menu control module 38. ;
  • Step S408 The visual menu control module 38 converts the above standard control information into an operation command and sends it to the device control module 34;
  • Step S410 The device control module 34 parses the operation instruction and sends the parsed operation instruction to the device to be controlled;
  • Step S412 The device control module 34 receives the feedback information sent by the device to be controlled. And sending the feedback information to the visual menu control module 38;
  • Step S414 After receiving the feedback information, the visual menu control module 38 notifies the visual menu display module 36 to update the information of the display interface.
  • the display and remote control of the information of the device to be controlled are realized by the mutual cooperation between the modules of the VR device, and the device that cannot be implemented in the prior art, particularly the device without the display function, is solved.
  • the VR device After the user connects the relevant IOT device to the wireless network, the VR device is connected to the same wireless network.
  • the IOT device initiates a state that can be scanned and found, and the VR device initiates a scan discovery function.
  • the 3D on the screen of the VR device displays all the peripheral devices enumerated.
  • the user selects the device through interactive operations (such as rotating the VR helmet), the screen will display all the information of the device and its support. Operation.
  • the user realizes remote control of the selected device by making simple actions such as nodding, waving, etc., such as adjusting the sound volume, adjusting the brightness of the smart light bulb, and the like.
  • the display content on the screen of the VR device is updated according to the received feedback information sent by the selected device.
  • the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware, but in many cases, the former is A better implementation.
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk,
  • the optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present invention.
  • module may implement a combination of software and/or hardware of a predetermined function.
  • apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.
  • the device includes an establishing module 52 configured to establish a communication connection with a device to be controlled. After the connection is established, the device information of the device to be controlled is obtained, and the virtual display interface of the device to be controlled is generated, where the virtual display interface is used to display at least the control function component of the device to be controlled; the second processing module 56 is configured. In order to generate an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed by the virtual display interface, and send it to the device to be controlled.
  • the second processing module 56 is configured to capture an operation event; determine control information according to a matching result of the operation event and the control function component; and convert the control information into an operation instruction, and send the information to the device to be controlled .
  • the foregoing establishing module 52 is equivalent to the device scan discovery module 32 shown in FIG. 3 or a module having more or less functions than the scan discovery module 32;
  • the first processing module 54 corresponds to the visual menu display module 36 shown in FIG. 3 or a module having more or less functions than the visual menu display module 36;
  • the second processing module 56 corresponds to the device shown in FIG.
  • each of the above modules may be implemented by software or hardware.
  • the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are in any combination.
  • the forms are located in different processors.
  • a VR device is further provided, which is used to implement the foregoing embodiment and Preferred embodiments, which have already been described, are not described again.
  • the VR device includes a scanner configured to scan a device to be controlled within a specified range; the processor is configured to establish a communication connection with the device to be controlled; after establishing the connection, acquiring device information of the device to be controlled, and generating a virtual device to be controlled a display interface, wherein the virtual display interface is configured to display at least a control function component of the device to be controlled; and generate an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed by the virtual display interface, and send the operation instruction to the control device The device to be controlled.
  • the processor is configured to capture an operation event; determine control information according to a matching result of the operation event and the control function component; and convert the control information into an operation instruction and send the control information to the device to be controlled.
  • a control system of the device is also provided in the embodiment, and the system is used to implement the foregoing embodiments and preferred embodiments, and details are not described herein.
  • the control system includes: a virtual reality VR device and a device to be controlled, wherein the VR device is configured to establish a communication connection with the device to be controlled; after establishing the connection, acquiring device information of the device to be controlled, and generating a virtual display of the device to be controlled An interface, wherein the virtual display interface is configured to display at least a control function component of the device to be controlled; and generate an operation instruction for controlling the device to be controlled according to the captured operation event and the control function component displayed by the virtual display interface, and send the operation instruction to be controlled
  • the device to be controlled is configured to receive an operation instruction; and control the device to be controlled according to the operation instruction.
  • the VR device is configured to capture an operation event; determine control information according to a matching result of the operation event and the control function component; and convert the control information into an operation instruction and send the message to the device to be controlled.
  • Embodiments of the present invention also provide a storage medium.
  • the foregoing storage medium may be configured to store program code for performing the following steps: S1, the terminal establishes a communication connection with the device to be controlled; S2, after establishing the connection, the terminal acquires the device to be controlled. Device information, and generating a virtual display interface of the device to be controlled, wherein the virtual display interface is at least used to display a control function component of the device to be controlled; S3, the terminal generates a treat according to the captured operation event and the control function component displayed on the virtual display interface The control device controls the operation instructions and sends them to the device to be controlled.
  • the storage medium is further configured to store program code for performing the following steps: S1, the terminal captures an operation event; S2, the terminal determines control information according to a matching result of the operation event and the control function component; S3, the terminal controls the information Converted to an operation command and sent to the device to be controlled.
  • the storage medium is further configured to store program code for performing the following steps: S1, the terminal determines, according to the device information, a type to which the device to be controlled belongs and a function list that the device to be controlled can support; S2, the terminal according to the type and function The list generates a virtual display interface corresponding to the type.
  • the storage medium is further configured to store program code for performing the following steps: S1, the terminal receives feedback information sent by the device to be controlled, wherein the feedback information is used to feed back a result of controlling the device to be controlled; S2, The terminal updates the virtual display interface according to the feedback information.
  • the storage medium is further arranged to store program code for performing the steps of: the terminal scanning for the device to be controlled within the specified range.
  • the foregoing storage medium may include, but is not limited to, a USB flash drive, a Read-Only Memory (ROM), and a Random Access Memory (RAM).
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • the device control method, device, system, and virtual reality VR device provided by the embodiments of the present invention have the following beneficial effects: realizing an intuitive virtual display of the device and its information, and solving the problem that cannot be realized in the prior art.
  • Virtual display of devices, especially devices without display functions, and remote control of devices through capture operation events which greatly reduces the user experience, achieves virtual images of visual display devices, and reduces remote devices
  • the difficulty of manipulation increases the effect of the user's experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明实施例提供了一种设备的控制方法、装置、系统及虚拟现实VR设备，其中该方法包括：终端与待控制设备建立通讯连接；建立连接后，该终端获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，该虚拟显示界面至少用于显示待控制设备的控制功能组件；终端依据捕获的操作事件和和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备。本发明实施例的技术方案解决了现有技术中无法实现对设备，特别是不具备显示功能的设备的虚拟显示以及通过捕获操作事件直观地对设备进行远程控制，继而大大降低了用户的体验度的问题，达到降低远程设备的操控难度，提高用户的体验度的效果。

Description

设备的控制方法、装置、系统及虚拟现实VR设备 技术领域
本发明涉及通信领域，具体而言，涉及一种设备的控制方法、装置、系统、及虚拟现实(Virtual Reality，简称为VR)设备方法及装置。
背景技术
在相关技术中，物联网(Internet Of Things，简称为IOT)设备已经被应用到生活中的各个场景，比如智能家庭，智能教育，智能交通等。但是，由于现实中的很多设备均不具备显示功能，如果想要对其进行控制，往往都要采用web形式进行操作，即，通过路由器将设备与网络连接，通过电脑或手机等终端对于设备进行控制。
尽管近年来VR设备等产品越来越普及且可以简单直观地进行可视化操作，但是VR技术并未应用到物联网领域中，现有的物联网技术方案无法实现对物联网设备，特别是不具备显示功能的物联网设备进行虚拟显示并通过捕获操作事件直观地对物联网设备进行远程控制，大大降低了用户的体验度。
针对上述问题，相关技术中尚未提出有效的解决方案。
发明内容
本发明实施例提供了一种设备的控制方法、装置、系统及VR设备，以至少解决相关技术中无法直接显示设备的虚拟图像，且无法通过捕获操作事件直观地对设备进行远程控制，大大降低了用户的体验度的问题。
根据本发明的一个实施例，提供了一种设备的控制方法，包括：终端与待控制设备建立通讯连接；建立连接后，所述终端获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；所述终端依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待 控制设备进行控制的操作指令，并发送至所述待控制设备。
可选地，所述虚拟显示界面包括所述待控制设备的虚拟3D图像。
可选地，所述终端依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备，包括：所述终端捕获所述操作事件；所述终端根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；所述终端将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
可选地，所述终端获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，包括：所述终端依据所述设备信息确定所述待控制设备所属的类型以及所述待控制设备可支持的功能列表；所述终端依据所述类型和所述功能列表生成与所述类型对应的所述虚拟显示界面。
可选地，所述终端将所述操作指令发送至所述待控制设备之后，还包括：所述终端接收所述待控制设备发送的反馈信息，其中，所述反馈信息用于反馈对所述待控制设备进行控制的结果；所述终端根据所述反馈信息更新所述虚拟显示界面。
可选地，终端与待控制设备建立通讯连接之前，还包括：所述终端扫描指定范围内的所述待控制设备，其中，所述指定范围为所述终端与所述待控制设备共同驻留的无线网络。
可选地，所述终端为VR设备。
根据本发明的另一个实施例，提供了一种设备的控制装置，该装置应用于终端，包括：建立模块，设置为与待控制设备建立通讯连接；第一处理模块，设置为建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；第二处理模块，设置为依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
可选地，所述第二处理模块设置为捕获所述操作事件；根据所述操作 事件与所述控制功能组件的匹配结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
根据本发明的另一个实施例，提供了一种VR设备，包括：扫描器，设置为扫描指定范围内的待控制设备；处理器，设置为与所述待控制设备建立通讯连接；建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；以及依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
可选地，所述处理器还设置为捕获所述操作事件；根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
根据本发明的另一个实施例，提供了一种设备的控制系统，包括：VR设备和待控制设备，其中，所述VR设备，设置为与待控制设备建立通讯连接；建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；以及依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备；所述待控制设备，设置为接收所述操作指令；以及根据所述操作指令控制所述待控制设备。
可选地，所述VR设备设置为捕获所述操作事件；根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
根据本发明的又一个实施例，还提供了一种存储介质。该存储介质设置为存储用于执行以下步骤的程序代码：终端与待控制设备建立通讯连接；建立连接后，所述终端获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控 制设备的控制功能组件；所述终端依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
可选地，存储介质还设置为存储用于执行以下步骤的程序代码：所述终端捕获所述操作事件；所述终端根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；所述终端将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
可选地，存储介质还设置为存储用于执行以下步骤的程序代码：所述终端依据所述设备信息确定所述待控制设备所属的类型以及所述待控制设备可支持的功能列表；所述终端依据所述类型和所述功能列表生成与所述类型对应的所述虚拟显示界面。
可选地，存储介质还设置为存储用于执行以下步骤的程序代码：所述终端接收所述待控制设备发送的反馈信息，其中，所述反馈信息用于反馈对所述待控制设备进行控制的结果；所述终端根据所述反馈信息更新所述虚拟显示界面。
可选地，存储介质还设置为存储用于执行以下步骤的程序代码：所述终端扫描指定范围内的所述待控制设备，其中，所述指定范围为所述终端与所述待控制设备共同驻留的无线网络。
通过本发明，由于终端能够在与设备建立通讯连接后生成设备的虚拟显示界面，并且依据捕获的操作事件和虚拟显示界面显示的控制功能组件生成对设备进行控制的操作指令，实现了对于设备及其信息的直观虚拟显示，解决了现有技术中无法实现对设备，特别是不具备显示功能的设备的虚拟显示以及通过捕获操作事件直观地对设备进行远程控制，继而大大降低了用户的体验度的问题，达到直观显示设备的虚拟图像，降低了远程设备的操控难度，提高了用户的体验度的效果。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一 部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1是根据本发明实施例的设备控制的网络结构图；
图2是根据本发明实施例的设备的控制方法的流程图；
图3是根据本发明实施例的VR设备的结构示意图；
图4是根据本发明可选实施例的设备的控制方法的流程图；
图5是根据本发明实施例的设备的控制装置的结构框图。
具体实施方式
下文中将参考附图并结合实施例来详细说明本发明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。
实施例1
图1是根据本发明实施例的设备控制的网络结构图，如图1所示，该网络架构包括：终端12和待控制设备14，其中，上述终端12设置为扫描指定范围内的待控制设备14，并与该待控制设备14建立通讯连接；依据上述待控制设备14的设备信息生成虚拟显示界面并将该虚拟显示界面显示给用户，用户根据该虚拟显示界面的内容执行指定操作，如点头，说出操作指令等，上述终端12捕获上述操作事件，并依据该操作事件生成操作指令；上述终端12将上述操作指令发送至待控制设备14，实现对于待控制设备14的远程控制，上述终端12接收待控制设备14发送的反馈信息并根据该反馈信息更新虚拟显示界面。
在本实施例中提供了一种运行于如图1所示的网络架构的设备的控制方法，图2是根据本发明实施例的设备的控制方法的流程图，如图2所示，该流程包括如下步骤：
步骤S202，终端与待控制设备建立通讯连接；
步骤S204，建立连接后，上述终端获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，该虚拟显示界面至少用于显示待控制设备的控制功能组件；
步骤S206，上述终端依据捕获的操作事件和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备。
在本实施例中，该操作事件可以为动作事件，如点头，挥手等，或者为语音事件，如用户说出的“启动”，“关闭”等操作指令，也可以是动作事件与语音事件的结合，但是并不限于此。该控制功能组件用于表示操作事件与待控制设备功能之间的对应关系，如该控制功能组件可以定义为摇头代表关闭电灯，或者摇头表示确认当前选择功能。通过与待控制设备建立通讯连接，实现了终端与待控制设备的数据的交互，上述待控制设备可以为多个，终端可以同时显示多个设备的虚拟图像，用户可以自由选择虚拟显示界面显示的设备中的一个或多个。可执行的动作可以为多种，如：左右转动头部表示取消操作，点头表示确认操作；摆手表示选择操作等。
通过上述步骤，由于终端能够在与设备建立通讯连接后生成设备的虚拟显示界面，并且依据该虚拟显示界面捕获的操作事件生成对设备进行控制的操作指令，实现了对于设备及其信息的直观虚拟显示，解决了现有技术中无法实现对设备，特别是不具备显示功能的设备的虚拟显示以及通过捕获操作事件直观地对设备进行远程控制，继而大大降低了用户的体验度的问题，达到直观显示设备的虚拟图像，降低了远程设备的操控难度，提高了用户的体验度的效果。
在一个可选的实施例中，上述虚拟显示界面包括待控制设备的虚拟3D图像。通过该虚拟3D图像，用户可以直观地观察到待控制设备的外观。
可选地，上述虚拟显示界面还可以包括可视化菜单，其中，上述可视化菜单可以用于显示控制功能组件，如，当待控制设备为电灯时，可视化菜单可以显示：1.摇头关闭电灯；2.点头开启电灯，或者，1.提高电灯 亮度；2.降低电灯亮度；3.关闭电灯；4.打开电灯，并且提示用户通过摆手选择条目1-4中的一种，点头表示确认。这样，用户不仅可以看到待控制设备的3D图像还可以根据可视化菜单显示的控制功能组件做出对应的动作，实现对于设备的控制。
在一个可选的实施例中，上述步骤S206可以通过如下方式实现：终端捕获操作事件；终端根据操作事件与控制功能组件的匹配结果确定控制信息；终端将控制信息转换为操作指令，并发送至待控制设备。
在本实施例中，由于终端捕获的操作事件并不能直接生成操作指令，因此，终端通过比较用户的操作事件和控制功能组件确定该操作事件的实际含义及与其对应的控制信息，如，当用户点头时，确定用户输入的控制信息为确认。且由于控制信息并不能直接控制设备，因此需要将控制信息转换为操作指令，通过上述终端所执行的操作可以有效地实现对于待控制设备的远程控制。上述控制功能组件可以根据设备的种类和功能预先设置在终端中，也可以根据待控制设备的信息实时生成与待控制设备功能对应的控制功能组件，但是并不限于此。
在一个可选的实施例中，采用以下方式执行步骤S204：终端依据设备信息确定待控制设备所属的类型以及待控制设备可支持的功能列表；终端依据类型和功能列表生成与类型对应的虚拟显示界面。
在本实施例中，终端与待控制设备建立通讯后可以根据待控制设备所属的类型显示相应的显示界面，该类型可以根据待控制设备的功能进行划分，如：音频设备，照明设备，加热设备等。
在一个可选的实施例中，执行步骤S206后还可以执行下述操作：终端接收待控制设备发送的反馈信息，其中，反馈信息用于反馈对待控制设备进行控制的结果；终端根据反馈信息更新虚拟显示界面。
在本实施例中，当终端接收到待控制设备的反馈信息后可以对于虚拟显示界面进行更新，这样，用户可以及时地获得待控制设备的设备信息，继而确定是否成功地实现对于待控制设备的控制，可选地，该虚拟3D图 像可以根据待控制设备的实时状态进行更新。这样，用户可以直观地看到待控制设备所处的状态。
在一个可选的实施例中，在执行步骤S202之前，还可以执行如下操作：终端扫描指定范围内的待控制设备，其中，该指定范围为终端与待控制设备共同驻留的无线网络。
在本实施例中，终端与待控制设备共同驻留的无线网络可以为WiFi或蓝牙等。
在一个可选的实施例中，上述终端为VR设备。在本实施例中，VR设备可以简单直观地进行可视化操作，VR设备可以识别用户的动作，并且根据用户的不同动作向待控制设备发送不同的控制指令，如，当VR设备为头盔时，通过头盔的转动，可以对扫描枚举出来的待控制设备进行选择操作，通过头盔的上下运动表示确定操作，通过识别用户的手势执行相应的选择和确定操作。除此之外，也可以在VR设备上设置一些特定的条件，当满足该条件时向待控制设备发送特定的控制指令，如，当VR的摄像头识别到某个待控制设备时直接向待控制设备发送启动或者关闭设备的控制指令。VR设备还可以识别用户的语音，当用户说“启动”后，VR设备识别到该语音事件，扫面指定范围内的待控制设备，然后在VR设备上显示出待控制设备的3D图像，如，同时显示台灯，空调以及热水器的3D图像，当VR设备识别出新的语音事件为“开灯”时，打开该台灯。
在一个可选的实施例中，上述VR设备可以包括如图3所示的模块：设备扫描发现模块32、设备控制模块34、可视化菜单显示模块36、可视化菜单控制模块38和交互操作模块310。上述模块的功能如下：
设备扫描发现模块32设置为对接入到网络中的设备进行扫描发现，标示出该设备的类型和支持的功能列表，如，无线音箱的设备类型是音频设备，支持的功能包括音量调节，均衡器调节，低音效果调节，场景调节等；
设备控制模块34设置为VR设备和IOT设备之间的指令控制和结果 反馈，如，调节无线音箱的音量，当VR设备通过网络发出增大音量的指令后，音箱收到后进行音量调高，然后反馈指令执行结果；
可视化菜单显示模块36设置为在VR设备的屏幕上显示功能列表、交互行为和反馈信息等；
可视化菜单控制模块38设置为响应用户对可视化菜单的操作，当用户通过交互操作模块310对可视化菜单进行控制后，可视化菜单控制模块38将用户的控制信息转换为控制指令发送给设备控制模块34，然后设备控制模块34对设备进行操作处理，同时可视化菜单控制模块38将接收到的处理结果通知可视化菜单显示模块36；
交互操作模块310设置为接收用户的输入操作。
图4是根据本发明可选实施例的设备的控制方法的流程图，该流程的执行主体为图3所示的VR设备，如图4所示，该流程包括如下步骤：
步骤S402：，设备扫描发现模块32在其驻留的网络中扫描周边支持互联功能的设备，并确定扫描后的设备的类型；
步骤S404：设备扫描发现模块32将确定的设备的设备信息发送到可视化菜单显示模块36，可视化菜单模块36解析上述设备信息，针对不同设备的类型生成不同的用于显示用户的可执行动作以及待控制设备的虚拟3D图像的显示界面，并在VR设备的屏幕上显示上述显示界面；
步骤S406：交互操作模块310捕获用户动作以及获取该用户动作所对应的控制信息，将上述控制信息转换为选择和确认等操作的标准控制信息，并将上述标准控制信息发送到可视化菜单控制模块38；
步骤S408：可视化菜单控制模块38将上述标准控制信息转换为操作指令后发送给设备控制模块34；
步骤S410：设备控制模块34解析上述操作指令并将解析后的操作指令发送到待控制设备；
步骤S412：设备控制模块34接收上述待控制设备发送的反馈信息， 并将该反馈信息发送到可视化菜单控制模块38；
步骤S414：可视化菜单控制模块38接收到上述反馈信息后通知可视化菜单显示模块36更新显示界面的信息。
在本实施例中，通过VR设备的上述模块之间的相互配合实现了对于待控制设备的信息的显示和远程操控，解决了现有技术中无法实现对设备，特别是不具备显示功能的设备的3D显示以及通过捕捉用户的动作直观地对设备进行远程控制，继而大大降低了用户的体验度的问题。上述方法步骤可以应用于下述场景中：
用户将相关的IOT设备接入到无线网络中后将VR设备接入到同一个无线网络中。IOT设备启动进入可被扫描发现的状态，VR设备启动扫描发现功能。扫描结束后，VR设备的屏幕上面3D显示枚举出的所有周边的设备，当用户通过交互操作(如转动VR头盔)选定设备后，屏幕将会显示出该设备的所有的信息以及其支持的操作。用户根据VR设备的屏幕上显示的信息，通过做出简单的动作，如点头、挥手等实现对于上述选定的设备的远程控制，如调节音响音量，调整智能灯泡的亮度等。随后，根据接收到的选定设备发送的反馈信息更新VR设备屏幕上的显示内容。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，或者网络设备等)执行本发明各个实施例所述的方法。
实施例2
在本实施例中还提供了一种设备的控制装置，该装置用于实现上述实 施例及优选实施方式，已经进行过说明的不再赘述。如以下所使用的，术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现，但是硬件，或者软件和硬件的组合的实现也是可能并被构想的。
图5是根据本发明实施例的设备的控制装置的结构框图，该装置应用于终端，如图5所示，该装置包括建立模块52，设置为与待控制设备建立通讯连接；第一处理模块54，设置为建立连接后，获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，虚拟显示界面至少用于显示待控制设备的控制功能组件；第二处理模块56，设置为依据捕获的操作事件和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备。
在一个可选的实施例中，上述第二处理模块56设置为捕获操作事件；根据操作事件与控制功能组件的匹配结果确定控制信息；以及将控制信息转换为操作指令，并发送至待控制设备。
需要说明的是，在本实施例中的终端为VR设备时，上述建立模块52相当于图3所示的设备扫描发现模块32或者具有比扫描发现模块32较多或较少的功能的模块；上述第一处理模块54相当于图3所示的可视化菜单显示模块36或者具有比可视化菜单显示模块36较多或较少的功能的模块；上述第二处理模块56相当于图3所示的设备控制模块34、可视化菜单控制模块38和交互操作模块310或者具有比设备控制模块34、可视化菜单控制模块38和交互操作模块310较多或较少的功能的模块。
需要说明的是，上述各个模块是可以通过软件或硬件来实现的，对于后者，可以通过以下方式实现，但不限于此：上述模块均位于同一处理器中；或者，上述各个模块以任意组合的形式分别位于不同的处理器中。
实施例3
在本实施例中还提供了一种VR设备，该设备用于实现上述实施例及 优选实施方式，已经进行过说明的不再赘述。
上述VR设备包括扫描器，设置为扫描指定范围内的待控制设备；处理器，设置为与待控制设备建立通讯连接；建立连接后，获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，该虚拟显示界面至少用于显示待控制设备的控制功能组件；以及依据捕获的操作事件和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备。
在一个可选的实施例中，上述处理器设置为捕获操作事件；根据操作事件与控制功能组件的匹配结果确定控制信息；以及将控制信息转换为操作指令，并发送至待控制设备。
实施例4
在本实施例中还提供了一种设备的控制系统，该系统用于实现上述实施例及优选实施方式，已经进行过说明的不再赘述。
上述控制系统包括：虚拟现实VR设备和待控制设备，其中，上述VR设备，设置为与待控制设备建立通讯连接；建立连接后，获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，虚拟显示界面至少用于显示待控制设备的控制功能组件；以及依据捕获的操作事件和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备；上述待控制设备，设置为接收操作指令；以及根据操作指令控制待控制设备。
在一个可选的实施例中，上述VR设备设置为捕获操作事件；根据操作事件与控制功能组件的匹配结果确定控制信息；以及将控制信息转换为操作指令，并发送至待控制设备。
实施例5
本发明的实施例还提供了一种存储介质。可选地，在本实施例中，上述存储介质可以被设置为存储用于执行以下步骤的程序代码：S1，终端与待控制设备建立通讯连接；S2，建立连接后，终端获取待控制设备的设备信息，并生成待控制设备的虚拟显示界面，其中，虚拟显示界面至少用于显示待控制设备的控制功能组件；S3，终端依据捕获的操作事件和虚拟显示界面显示的控制功能组件，生成对待控制设备进行控制的操作指令，并发送至待控制设备。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：S1，终端捕获操作事件；S2，终端根据操作事件与控制功能组件的匹配结果确定控制信息；S3，终端将控制信息转换为操作指令，并发送至待控制设备。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：S1，终端依据设备信息确定待控制设备所属的类型以及待控制设备可支持的功能列表；S2，终端依据类型和功能列表生成与类型对应的虚拟显示界面。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：S1，终端接收待控制设备发送的反馈信息，其中，上述反馈信息用于反馈对待控制设备进行控制的结果；S2，该终端根据反馈信息更新虚拟显示界面。
可选地，存储介质还被设置为存储用于执行以下步骤的程序代码：终端扫描指定范围内的待控制设备。
可选地，在本实施例中，上述存储介质可以包括但不限于：U盘、只读存储器(Read-Only Memory，简称为ROM)、随机存取存储器(Random Access Memory，简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
可选地，本实施例中的具体示例可以参考上述实施例及可选实施方式中所描述的示例，本实施例在此不再赘述。
显然，本领域的技术人员应该明白，上述的本发明的各模块或各步骤可以用通用的计算装置来实现，它们可以集中在单个的计算装置上，或者分布在多个计算装置所组成的网络上，可选地，它们可以用计算装置可执 行的程序代码来实现，从而，可以将它们存储在存储装置中由计算装置来执行，并且在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤，或者将它们分别制作成各个集成电路模块，或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样，本发明不限制于任何特定的硬件和软件结合。
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。
工业实用性
如上所述，本发明实施例提供的一种设备的控制方法、装置、系统及虚拟现实VR设备具有以下有益效果：实现了对于设备及其信息的直观虚拟显示，解决了现有技术中无法实现对设备，特别是不具备显示功能的设备的虚拟显示以及通过捕获操作事件直观地对设备进行远程控制，继而大大降低了用户的体验度的问题，达到直观显示设备的虚拟图像，降低了远程设备的操控难度，提高了用户的体验度的效果。

Claims (14)

  1. 一种设备的控制方法，包括：
    终端与待控制设备建立通讯连接；
    建立连接后，所述终端获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；
    所述终端依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
  2. 根据权利要求1所述的方法，其中，所述虚拟显示界面包括所述待控制设备的虚拟3D图像。
  3. 根据权利要求1所述的方法，其中，所述终端依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备，包括：
    所述终端捕获所述操作事件；
    所述终端根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；
    所述终端将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
  4. 根据权利要求1所述的方法，其中，所述终端获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，包括：
    所述终端依据所述设备信息确定所述待控制设备所属的类型以及所述待控制设备可支持的功能列表；
    所述终端依据所述类型和所述功能列表生成与所述类型对应的所述虚拟显示界面。
  5. 根据权利要求1所述的方法，其中，所述终端将所述操作指令发送至所述待控制设备之后，还包括：
    所述终端接收所述待控制设备发送的反馈信息，其中，所述反馈信息用于反馈对所述待控制设备进行控制的结果；
    所述终端根据所述反馈信息更新所述虚拟显示界面。
  6. 根据权利要求1至5任一项所述的方法，其中，终端与待控制设备建立通讯连接之前，还包括：所述终端扫描指定范围内的所述待控制设备，其中，所述指定范围为所述终端与所述待控制设备共同驻留的无线网络。
  7. 根据权利要求1至5任一项所述的方法，其中，所述终端为虚拟现实VR设备。
  8. 一种设备的控制装置，该装置应用于终端，包括：
    建立模块，设置为与待控制设备建立通讯连接；
    第一处理模块，设置为建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；
    第二处理模块，设置为依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
  9. 根据权利要求8所述的装置，其中，所述第二处理模块设置为捕获所述操作事件；根据所述操作事件与所述控制功能组件的匹配 结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
  10. 一种虚拟现实VR设备，包括：
    扫描器，设置为扫描指定范围内的待控制设备；
    处理器，设置为与所述待控制设备建立通讯连接；建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；以及依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备。
  11. 根据权利要求10所述的设备，其中，所述处理器设置为捕获所述操作事件；根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
  12. 一种设备的控制系统，包括：虚拟现实VR设备和待控制设备，其中，
    所述VR设备，设置为与待控制设备建立通讯连接；建立连接后，获取所述待控制设备的设备信息，并生成所述待控制设备的虚拟显示界面，其中，所述虚拟显示界面至少用于显示所述待控制设备的控制功能组件；以及依据捕获的操作事件和所述虚拟显示界面显示的所述控制功能组件，生成对所述待控制设备进行控制的操作指令，并发送至所述待控制设备；
    所述待控制设备，设置为接收所述操作指令；以及根据所述操作指令控制所述待控制设备。
  13. 根据权利要求12所述的系统，其中，所述VR设备设置为捕获所述操作事件；根据所述操作事件与所述控制功能组件的匹配结果确定控制信息；以及将所述控制信息转换为所述操作指令，并发送至所述待控制设备。
  14. 一种存储介质，所述存储介质包括存储的程序，其中，所述程序运行时执行权利要求1至7中任一项所述的方法。
PCT/CN2017/111858 2017-05-03 2017-11-20 设备的控制方法、装置、系统及虚拟现实vr设备 WO2018201695A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710304682.9 2017-05-03
CN201710304682.9A CN108810049A (zh) 2017-05-03 2017-05-03 设备的控制方法、装置、系统及虚拟现实vr设备

Publications (1)

Publication Number Publication Date
WO2018201695A1 true WO2018201695A1 (zh) 2018-11-08

Family

ID=64015785

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/111858 WO2018201695A1 (zh) 2017-05-03 2017-11-20 设备的控制方法、装置、系统及虚拟现实vr设备

Country Status (2)

Country Link
CN (1) CN108810049A (zh)
WO (1) WO2018201695A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110308661A (zh) * 2019-06-06 2019-10-08 美的集团股份有限公司 基于机器学习的智能设备控制方法及装置
CN110308660A (zh) * 2019-06-06 2019-10-08 美的集团股份有限公司 智能设备控制方法及装置
CN110377150A (zh) * 2019-06-11 2019-10-25 中新软件（上海）有限公司 虚拟场景中操作实体部件的方法、装置及计算机设备

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109272791A (zh) * 2018-12-04 2019-01-25 深圳市诺信连接科技有限责任公司 基于vr的在线教育的实现方法及vr头显
CN110448902A (zh) * 2019-07-02 2019-11-15 重庆爱奇艺智能科技有限公司 对外部设备进行虚拟化映射与控制的方法、装置与系统
CN111476904A (zh) * 2020-03-09 2020-07-31 珠海格力电器股份有限公司 一种设备控制方法、装置、系统、电子设备及存储介质
CN114125481A (zh) * 2021-11-17 2022-03-01 建信金融科技有限责任公司 Vr直播答题的实现方法、装置、系统、设备和介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106249607A (zh) * 2016-07-28 2016-12-21 桂林电子科技大学 虚拟智能家居仿真系统及方法
CN106506688A (zh) * 2016-11-29 2017-03-15 维沃移动通信有限公司 数据交互的方法和虚拟现实终端、智能家居设备
CN106648297A (zh) * 2016-10-09 2017-05-10 广州艾想电子科技有限公司 一种基于vr设备的智能设备控制方法及装置
US20170168486A1 (en) * 2015-12-11 2017-06-15 Tata Consultancy Services Limited HYBRID REALITY BASED i-BOT NAVIGATION AND CONTROL

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI526878B (zh) * 2013-10-04 2016-03-21 大同股份有限公司 控制電子裝置的方法、手持電子裝置與監控系統
CN105807624A (zh) * 2016-05-03 2016-07-27 惠州Tcl移动通信有限公司 一种通过vr设备控制智能家居设备的方法及vr设备
CN105974808A (zh) * 2016-06-30 2016-09-28 宇龙计算机通信科技(深圳)有限公司 基于虚拟现实设备的控制方法、控制装置及虚拟现实设备
CN106445156A (zh) * 2016-09-29 2017-02-22 宇龙计算机通信科技(深圳)有限公司 一种基于虚拟现实的智能家居控制的方法、装置以及终端
CN108073269A (zh) * 2016-11-17 2018-05-25 四川赞星科技有限公司 一种虚拟现实场景和实体设备控制方法及系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170168486A1 (en) * 2015-12-11 2017-06-15 Tata Consultancy Services Limited HYBRID REALITY BASED i-BOT NAVIGATION AND CONTROL
CN106249607A (zh) * 2016-07-28 2016-12-21 桂林电子科技大学 虚拟智能家居仿真系统及方法
CN106648297A (zh) * 2016-10-09 2017-05-10 广州艾想电子科技有限公司 一种基于vr设备的智能设备控制方法及装置
CN106506688A (zh) * 2016-11-29 2017-03-15 维沃移动通信有限公司 数据交互的方法和虚拟现实终端、智能家居设备

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110308661A (zh) * 2019-06-06 2019-10-08 美的集团股份有限公司 基于机器学习的智能设备控制方法及装置
CN110308660A (zh) * 2019-06-06 2019-10-08 美的集团股份有限公司 智能设备控制方法及装置
CN110377150A (zh) * 2019-06-11 2019-10-25 中新软件（上海）有限公司 虚拟场景中操作实体部件的方法、装置及计算机设备
CN110377150B (zh) * 2019-06-11 2023-01-24 中新软件（上海）有限公司 虚拟场景中操作实体部件的方法、装置及计算机设备

Also Published As

Publication number Publication date
CN108810049A (zh) 2018-11-13

Similar Documents

Publication Publication Date Title
WO2018201695A1 (zh) 设备的控制方法、装置、系统及虚拟现实vr设备
US20190361408A1 (en) Information processing apparatus and non-transitory computer readable medium
WO2020168569A1 (zh) 智能设备配网方法、装置、电子设备及存储介质
US11283641B2 (en) Method, apparatus, device, system and storage medium for controlling smart home
US10848339B2 (en) Implementation system and method for internet of things based on artificial intelligence
WO2017193612A1 (zh) 使用移动终端对电器设备进行操控的设备、系统和方法
EP3312730B1 (en) Control terminal device, audio system, and audio system control method
WO2020168571A1 (zh) 设备控制方法、装置、系统、电子设备以及云服务器
WO2020223854A1 (zh) 设备配网方法、装置、电子设备及存储介质
WO2018040063A1 (zh) 设备控制方法及装置
WO2013189357A2 (zh) 一种实现电视分屏观看的方法、机顶盒及电视系统
US11365890B2 (en) Cooker hood, and method and system for controlling same
WO2020248627A1 (zh) 一种视频通话方法和显示设备
CN112135280A (zh) 一种蓝牙设备播放控制方法及显示设备
WO2023155529A1 (zh) 显示设备、智能家居系统及用于显示设备的多屏控制方法
US10043381B2 (en) Employing AR element on preview screen to control lamp or curtain
CN113872782A (zh) 一种设备组网方法、控制设备和物联网系统
CN115842724A (zh) 一种智能设备初始配置方法、智能设备及终端设备
US20190364114A1 (en) Information processing apparatus, information processing system, and non-transitory computer readable medium
CN110875040B (zh) 一种基于产品技能的家电控制方法和系统
CN113497744B (zh) 控制智能家居的方法、系统、可穿戴设备及可读存储介质
JP6668519B1 (ja) リモコン機能設定プログラム、リモコンサーバ、リモコン機能設定方法、携帯端末
KR102599783B1 (ko) 회의 기기를 통합 제어하기 위한 방법, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체
CN114489532B (zh) 终端设备以及终端设备与显示设备联动的方法
US20240146996A1 (en) Display device and control method therefor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17908586

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17908586

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17908586

Country of ref document: EP

Kind code of ref document: A1