WO2017177766A1 - 虚拟现实设备的控制方法、装置及虚拟现实设备、系统 - Google Patents

虚拟现实设备的控制方法、装置及虚拟现实设备、系统 Download PDF

Info

Publication number
WO2017177766A1
WO2017177766A1 PCT/CN2017/074334 CN2017074334W WO2017177766A1 WO 2017177766 A1 WO2017177766 A1 WO 2017177766A1 CN 2017074334 W CN2017074334 W CN 2017074334W WO 2017177766 A1 WO2017177766 A1 WO 2017177766A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound signal
virtual reality
operation instruction
reality device
management server
Prior art date
Application number
PCT/CN2017/074334
Other languages
English (en)
French (fr)
Inventor
邹建财
蒋建华
蒋德明
Original Assignee
深圳市京华信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市京华信息技术有限公司 filed Critical 深圳市京华信息技术有限公司
Priority to US16/075,901 priority Critical patent/US20210191690A1/en
Publication of WO2017177766A1 publication Critical patent/WO2017177766A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/34—Adaptation of a single recogniser for parallel processing, e.g. by use of multiple processors or cloud computing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/131—Protocols for games, networked simulations or virtual reality

Definitions

  • the present disclosure relates to the field of Internet application technologies, for example, to a method and device for controlling a virtual reality device, and a virtual reality device and system.
  • Virtual reality technology is a computer simulation system that can create and experience virtual world. It uses computer to generate a simulation environment. It is a multi-source information fusion interactive 3D dynamic vision and system simulation of entity behavior, enabling users. Immerse yourself in the environment.
  • the virtual reality device in the related art usually uses manual operation, which is very inconvenient to operate, and the resources that can be used are very limited.
  • the present disclosure provides a method, a device, and a virtual reality device and system for controlling a virtual reality device, which solves the technical problem that the virtual reality device is inconvenient to operate manually and has very limited use resources, and the simplified operation, convenient use, and greatly expanded Use resources.
  • the present disclosure provides a method for controlling a virtual reality device, including:
  • the voice signal that the local speech recognition library can recognize includes opening a video, playing a next video, playing a previous video, fast forwarding, rewinding, increasing a volume, decreasing a volume, pausing playback, continuing to play, and shutting down. At least one of them.
  • the receiving, by the cloud management server, the operation instruction obtained by identifying the sound signal, executing the operation instruction, and acquiring the resource matched by the operation instruction from the Internet further comprising:
  • the resources are presented in a manner that is displayed in a voice, image, vibration, scent, and/or graphic.
  • the receiving, by the cloud management server, the operation instruction obtained by identifying the sound signal, executing the operation instruction, and acquiring the resource matched by the operation instruction from the Internet may be:
  • the voice recognition capability of the cloud management server performs adaptive learning through voice recognition resources in the cloud.
  • control device for a virtual reality device including:
  • a sound signal acquiring unit configured to acquire a sound signal
  • a local speech recognition unit configured to perform local speech recognition on the sound signal
  • the sound signal sending unit is configured to send the sound signal to the cloud management server for voice recognition if the local voice recognition library cannot recognize the sound signal;
  • the operation instruction execution unit is configured to receive an operation instruction obtained by the cloud management server and identify the sound signal, execute the operation instruction, and acquire a resource matched by the operation instruction from the Internet.
  • the voice signal that the local speech recognition library can recognize includes opening a video, playing a next video, playing a previous video, fast forwarding, rewinding, increasing a volume, decreasing a volume, pausing playback, continuing to play, and shutting down. At least one of them.
  • it also includes:
  • the result display unit is configured to display the resource in a manner of voice, image, vibration, scent or graphic display.
  • the present disclosure provides a virtual reality device, including a controller, a wireless network circuit, a voice recognition circuit, and a microphone, where the controller is configured with a control device of the virtual reality device as described above, the wireless network circuit and a voice recognition circuit is respectively connected to the controller, the microphone is connected to the voice recognition circuit, the wireless network circuit is configured to connect to the Internet, and the voice recognition circuit is configured to convert the sound signal into an operation command, the microphone Set to collect sound signals.
  • the present disclosure provides a virtual reality system including the virtual reality device and the cloud management server as described above.
  • the present disclosure provides a non-transitory computer readable storage medium storing computer executable instructions for performing the control method of the virtual reality device according to any of the above.
  • the technical solution provided by the present disclosure first identifies the sound signal by the local speech recognition library, when local When the voice recognition library cannot recognize the voice signal, the voice signal is sent to the cloud management server for identification, and the recognized operation instruction is sent to the virtual reality device, and the virtual reality device executes the operation instruction to obtain the operation instruction from the Internet.
  • the local speech recognition library only saves simple and direct operation instructions, saves the memory of the virtual reality device, and combines the cloud management server for speech recognition, enhances the ability of speech recognition, and solves the technical problem that the virtual reality device is inconvenient to operate, and improves User experience.
  • FIG. 1 is a flowchart of a method of a first embodiment of a method for controlling a virtual reality device according to the present disclosure.
  • FIG. 2 is a flowchart of a method of a second embodiment of a method for controlling a virtual reality device according to the present disclosure.
  • FIG. 3 is a block diagram showing the structure of a first embodiment of a control apparatus for a virtual reality device provided by the present disclosure.
  • FIG. 4 is a block diagram showing the structure of a second embodiment of a control apparatus for a virtual reality device provided by the present disclosure.
  • FIG. 5 is a structural block diagram of a virtual reality device provided by the present disclosure.
  • FIG. 6 is a structural block diagram of a virtual reality system provided by the present disclosure.
  • FIG. 7 is a structural block diagram of an electronic device according to an embodiment of the present disclosure.
  • the virtual reality device mentioned in the present disclosure is a master control device in a plurality of application systems, and mainly includes an immersive virtual reality system, a computer-based virtual reality system, and an integrated head-mounted virtual reality system, wherein the immersive virtual reality system is A relatively complex system in which a user is in a special device and must have a sensor tracking device such as a helmet or a data glove to interact with the virtual world; a computer-based virtual reality system is used by a personal computer.
  • the host of the data processing and program running the user wears the virtual reality helmet, interacts with the virtual environment through the handle, etc.;
  • the integrated head-mounted virtual reality system can be divided into three forms, the three forms are virtual reality glasses plus the host, the one machine virtual Realistic headsets and virtual reality shells are used with smartphones.
  • FIG. 1 is a flowchart of a method of a first embodiment of a method for controlling a virtual reality device according to the present disclosure.
  • the control method of the virtual reality device includes:
  • step S110 the user's voice signal is acquired.
  • the user's voice signal is acquired through the microphone and the sound signal is converted into an electrical signal.
  • step S120 local speech recognition is performed on the sound signal.
  • the speech recognition method is mainly a pattern matching method.
  • the key words or instructions of the instruction have been preset in the device software, such as "play --, "shutdown", without any operation by the user.
  • step S130 if the local speech recognition library cannot recognize the sound signal, the sound signal is sent to the cloud management server for speech recognition.
  • the local speech recognition library can recognize the voice signal including opening the video, playing the next video, playing the last video, fast forward, fast rewind, increasing the volume, decreasing the volume, pausing the playback, continuing to play and shutting down, etc., local speech recognition library What is saved is the feature vector of each vocabulary.
  • the vocabulary listed here is only an example. The vocabulary used is different according to the application scenario of the virtual reality device. In short, the local speech recognition library only includes simple vocabulary related to device operation. If the local speech recognition library can recognize the sound signal, the operation instruction corresponding to the sound signal is directly executed.
  • the Cloud Management Server is set up to help handle speech recognition and is also the server for user network operations management.
  • the cloud management server obtains voice recognition resources from the Internet and has adaptive learning capabilities.
  • the voice signals that can be recognized are rich, enriching the services provided by the virtual reality devices and providing more abundant resources for customers.
  • the cloud management server After receiving the sound signal sent by the virtual reality device, the cloud management server uses the voice recognition resource of the Internet to perform voice recognition on the voice signal, and obtains an operation instruction corresponding to the voice signal.
  • the voice recognition capability of the cloud management server is adaptively learned through the voice recognition resources in the cloud.
  • step S140 an operation instruction obtained by identifying the sound signal sent by the cloud management server is received, and the operation instruction is executed, and the resource matched by the operation instruction is acquired from the Internet.
  • the virtual reality device has a network access function, and after receiving an operation instruction sent by the cloud management server, acquires a resource matched by the operation instruction to the Internet.
  • the resource is displayed to the user in a manner of voice, image, vibration, smell, or graphic display.
  • the presentation mode is determined by the scenario of the virtual reality device application, and there is no limitation here. For example: 720 degrees without a dead end movie view Look, plus touch and smell, give the user an immersive feeling; for example, when the user plays the game, the player is completely immersed in the game and becomes one of them, can feel the slam, the car shakes, The wind blows and rains.
  • the control method of the virtual reality device first identifies the user's voice signal by the local voice recognition library.
  • the voice signal is sent to the cloud management server for identification.
  • the virtual reality device executes the operation instruction, and acquires a resource matching the operation instruction from the Internet, and the local speech recognition library saves only the simple and direct operation instruction, thereby saving the memory of the virtual reality device.
  • the cloud management server for voice recognition enhance the ability of voice recognition, solve the technical problem of inconvenient operation of the virtual reality device, and improve the user experience.
  • FIG. 2 is a flowchart of a method of a second embodiment of a method for controlling a virtual reality device according to the present disclosure.
  • the control method of the virtual reality device includes:
  • step S201 the user's voice signal is acquired.
  • the user's voice signal is acquired through the microphone and the sound signal is converted into an electrical signal.
  • step S202 local speech recognition is performed on the sound signal.
  • the speech recognition method is mainly a pattern matching method.
  • the key words or instructions of the instruction have been preset in the device software, such as "play --, "shutdown", without any operation by the user.
  • step S203 if the local speech recognition library cannot recognize the sound signal, the sound signal is sent to the cloud management server for speech recognition.
  • the local speech recognition library can recognize the voice signal including opening the video, playing the next video, playing the last video, fast forward, fast rewind, increasing the volume, decreasing the volume, pausing the playback, continuing to play and shutting down, etc., local speech recognition library What is saved is the feature vector of each vocabulary.
  • the vocabulary listed here is only an example. The vocabulary used is different according to the application scenario of the virtual reality device. In short, the local speech recognition library only includes simple vocabulary related to device operation.
  • the Cloud Management Server is set up to help handle speech recognition and is also the server for user network operations management.
  • the cloud management server obtains voice recognition resources from the Internet and has adaptive learning capabilities.
  • the voice signals that can be recognized are rich, enriching the services provided by the virtual reality devices and providing more abundant resources for customers.
  • the cloud management server After receiving the sound signal sent by the virtual reality device, the cloud management server uses the voice recognition resource of the Internet to perform voice recognition on the voice signal, and obtains an operation instruction corresponding to the voice signal.
  • step S204 receiving the voice signal sent by the cloud management server to identify the sound signal An operation instruction, which is a brand of clothing, acquires a virtual store of the clothing brand from the Internet.
  • the virtual store is displayed to the user, and the user can select the clothes that he likes in the virtual store, which is convenient and quick.
  • the control method of the virtual reality device is applied in the commercial field, where the local voice recognition library first recognizes the user's voice signal, and when the local voice recognition library cannot recognize the sound signal, the sound signal is sent to the cloud.
  • the management server recognizes that the recognized operation instruction is a clothing brand, and the virtual reality device acquires the virtual store of the clothing brand from the Internet, and the local speech recognition library only saves simple and direct operation instructions, thereby saving the memory of the virtual reality device, and Combining the cloud management server for voice recognition, enhancing the ability of voice recognition, and fully utilizing network resources, solving the technical problem that the virtual reality device is inconvenient to operate, and improving the user experience.
  • control device of the virtual reality device includes:
  • the sound signal acquisition unit 100 the local voice recognition unit 101, the sound signal transmission unit 102, and the operation instruction execution unit 103.
  • the sound signal acquiring unit 100 is configured to acquire a sound signal of the user
  • the local speech recognition unit 101 is configured to perform local speech recognition on the sound signal
  • the sound signal sending unit 102 is configured to send the sound signal to the cloud management server for voice recognition if the local voice recognition library cannot recognize the sound signal; the voice signal that the local voice recognition library can recognize may include opening Video, play next video, play previous video, fast forward, rewind, increase volume, decrease volume, pause playback, resume playback, and power off.
  • the operation instruction execution unit 103 is configured to receive an operation instruction obtained by the cloud management server after identifying the sound signal, execute the operation instruction, acquire a resource matched by the operation instruction from the Internet, and set to receive the cloud management server.
  • the sent operation that is obtained by recognizing the sound signal As an instruction, the operation instruction is a clothing brand, and a virtual store of the clothing brand is obtained from the Internet.
  • the control device of the virtual reality device first identifies the user's voice signal by the local voice recognition library.
  • the voice signal is sent to the cloud management server for identification.
  • the virtual reality device executes the operation instruction, and acquires a resource matching the operation instruction from the Internet, and the local speech recognition library saves only the simple and direct operation instruction, thereby saving the memory of the virtual reality device.
  • the cloud management server for voice recognition enhance the ability of voice recognition, solve the technical problem of inconvenient operation of the virtual reality device, and improve the user experience.
  • FIG. 4 is a block diagram showing the structure of a second embodiment of a control apparatus for a virtual reality device provided by the present disclosure.
  • the control device of the virtual reality device is different from the device shown in FIG. 3 in that it further includes:
  • the result display unit 104 is configured to display the resource to the user in at least one of a voice, an image, a vibration, an odor, and a graphic display.
  • the resources obtained from the Internet are displayed to the user, so that the user has an immersive feeling, expands the use resources of the virtual reality device, and combines the cloud management server for voice recognition and enhances the ability of voice recognition, and solves the problem.
  • the technical problem that the virtual reality device is inconvenient to operate improves the user experience.
  • FIG. 5 is a structural block diagram of a virtual reality device provided by the present disclosure.
  • the virtual reality device 1 includes a controller 11, a wireless network circuit 12, a voice recognition circuit 13, and a microphone 14.
  • the controller 12 is configured with the control device 10 of the virtual reality device described above,
  • the wireless network circuit 12 and the voice recognition circuit 13 are respectively connected to the controller 11,
  • the microphone 14 is connected to the voice recognition circuit 13
  • the wireless network circuit 12 is arranged to connect to the Internet
  • the voice recognition circuit 13 is set to The sound signal input by the user is converted into an operation command, and the microphone 14 is used to collect a sound signal input by the user.
  • the wireless network circuit may be one or more of a wireless network card, a wireless network card, and Bluetooth.
  • the virtual reality device will also include other functional circuits, which are not listed here.
  • the local speech recognition library of the virtual reality device only saves simple and direct operation instructions, saves the memory of the virtual reality device, and combines the cloud management server for voice recognition, enhances the capability of voice recognition, and solves the inconvenience of the virtual reality device.
  • the technical problems of operation have improved the user experience.
  • FIG. 6 is a structural block diagram of a virtual reality system provided by the present disclosure.
  • the virtual reality system includes the virtual reality device 1 and the cloud management server 2 described above.
  • the local voice recognition library of the virtual reality device of the virtual reality system only saves simple and direct operation instructions, saves the memory of the virtual reality device, and combines the cloud management server for voice recognition, enhances the capability of voice recognition, and solves the virtual
  • the technical problem that the actual device is inconvenient to operate improves the user experience.
  • the embodiment provides a non-transitory computer readable storage medium storing computer executable instructions for executing the control method of the virtual reality device according to any of the above embodiments.
  • FIG. 7 is a structural block diagram of an electronic device according to an embodiment of the present disclosure.
  • the electronic device provided by the embodiment of the present disclosure may include a processor 71, a sound signal acquisition circuit 72, a sound signal transmission circuit 73, and a memory 74, and may further include a bus 75.
  • the processor 71, the sound signal acquisition circuit 72, the sound signal transmission circuit 73, and the memory 74 can complete communication with each other via the bus 75.
  • the sound signal acquisition circuit 72 is for acquiring a sound signal of the user.
  • the sound signal transmitting circuit 73 is configured to send the sound signal to the cloud management server for voice recognition if the local voice recognition library cannot recognize the sound signal.
  • the processor 71 can call the logic instructions in the memory 74 to execute the control method of the virtual reality device of the above embodiment.
  • the logic instructions in the memory 74 described above may be implemented in the form of a software functional unit and sold or used as a stand-alone product, and may be stored in a computer readable storage medium.
  • the technical solution of the present disclosure may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a computer device (which may be a personal computer, a server, or a network) The device or the like) performs all or part of the steps of the method described in the above embodiments.
  • the foregoing storage medium may be a non-transitory storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • a medium that can store program code, or a transitory storage medium including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • the local voice recognition library first recognizes the voice signal of the user, and when the local voice recognition library cannot recognize the sound signal, the sound signal is sent.
  • Sending to the cloud management server for identification, and transmitting the identified operation instruction to the virtual reality device the virtual reality device executes an operation instruction, and acquires a resource matching the operation instruction from the Internet, and the local speech recognition library only saves the simple and direct operation instruction
  • the utility model saves the memory of the virtual reality device, and combines the cloud management server for voice recognition, enhances the capability of voice recognition, solves the technical problem that the virtual reality device is inconvenient to operate, and improves the user experience effect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

一种虚拟现实设备的控制方法、装置及虚拟现实设备、系统，其中该方法包括：获取声音信号（S110）；对该声音信号进行本地语音识别（S120）；如果本地语音识别库不能识别出该声音信号，将该声音信号发送至云端管理服务器进行语音识别（S130）；接收云端管理服务器发送的将该声音信号识别后得到的操作指令，执行该操作指令，从互联网获取该操作指令匹配的资源（S140）。

Description

虚拟现实设备的控制方法、装置及虚拟现实设备、系统 技术领域
本公开涉及互联网应用技术领域，例如涉及一种虚拟现实设备的控制方法、装置及虚拟现实设备、系统。
背景技术
虚拟现实技术是一种可以创建和体验虚拟世界的计算机仿真系统，它利用计算机生成一种模拟环境，是一种多源信息融合的交互式的三维动态视景和实体行为的系统仿真，使用户沉浸到该环境中。相关技术中的虚拟现实设备通常使用手动操作，操作十分不方便，而且可以使用的资源十分有限。
发明内容
本公开提供一种虚拟现实设备的控制方法、装置及虚拟现实设备、系统，解决了相关技术中虚拟现实设备手动操作不方便、使用资源十分有限的技术问题，简化的操作，使用方便，大大扩展了使用资源。
本公开采用以下技术方案：
第一方面，本公开提供一种虚拟现实设备的控制方法，包括：
获取声音信号；
对所述声音信号进行本地语音识别；
如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别；
接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源。
可选地，所述本地语音识别库可以识别的语音信号包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机中的至少一个。
可选地，所述接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源之后还包括：
将所述资源以语音、影像、震动、气味和/或图文显示的方式展示。
可选地，所述接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源，可以是：
接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，所述操作指令为衣服的品牌，从互联网获取所述衣服品牌的虚拟商店。
可选地，所述云端管理服务器的语音识别能力通过云端的语音识别资源进行自适应学习。
第二方面，本公开提供一种虚拟现实设备的控制装置，包括：
声音信号获取单元，设置为获取声音信号；
本地语音识别单元，设置为对所述声音信号进行本地语音识别；
声音信号发送单元，设置为如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别；
操作指令执行单元，设置为接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源。
可选地，所述本地语音识别库可以识别的语音信号包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机中的至少一个。
可选地，还包括：
结果展示单元，设置为将所述资源以语音、影像、震动、气味或图文显示的方式展示。
第三方面，本公开提供一种虚拟现实设备，包括控制器、无线网络电路、语音识别电路和麦克风，所述控制器配置有如上述所述的虚拟现实设备的控制装置，所述无线网络电路及语音识别电路分别与所述控制器连接，所述麦克风与所述语音识别电路连接，所述无线网络电路设置为连接互联网，所述语音识别电路设置为将声音信号转换为操作指令，所述麦克风设置为收集声音信号。
第四方面，本公开提供一种虚拟现实系统，包括如上述所述的虚拟现实设备和云端管理服务器。
第五方面，本公开提供一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述任一项所述的虚拟现实设备的控制方法。
本公开提供的技术方案先由本地语音识别库对声音信号进行识别，当本地 语音识别库不能识别出声音信号时，将声音信号发送至云端管理服务器进行识别，并将识别出的操作指令发送至虚拟现实设备，虚拟现实设备执行操作指令，从互联网获取与操作指令相匹配的资源，本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
附图概述
下面将对本公开实施例描述中所需要使用的附图作简单的介绍，下面描述中的附图仅仅是本公开的一些实施例。
图1是本公开提供的虚拟现实设备的控制方法第一个实施例的方法流程图。
图2是本公开提供的虚拟现实设备的控制方法第二个实施例的方法流程图。
图3是本公开提供的虚拟现实设备的控制装置第一个实施例的结构方框图。
图4是本公开提供的虚拟现实设备的控制装置第二个实施例的结构方框图。
图5是本公开提供的虚拟现实设备的结构方框图。
图6是本公开提供的虚拟现实系统的结构方框图。
图7为本实施例提供的电子设备的结构框图。
具体实施方式
下面将结合附图对本公开实施例的技术方案作详细描述，所描述的实施例仅仅是本公开一部分实施例，而不是全部的实施例。在不冲突的情况下，下述实施例和实施例中的特征可以相互组合。本公开提到的虚拟现实设备为多种应用系统中的主控设备，主要包括沉浸型虚拟现实系统、电脑式的虚拟现实系统及一体式头戴虚拟现实系统，其中，沉浸型虚拟现实系统是一套比较复杂的系统，用户身处一特殊的设备内，同时必须头戴头盔、手戴数据手套等传感跟踪装置才能与虚拟世界进行交互；电脑式的虚拟现实系统由一台个人电脑作为数据处理和程序运行的主机，用户佩戴虚拟现实头盔，通过手柄等与虚拟环境进行交互；一体式头戴虚拟现实系统可以分成三种形态，该三种形态为虚拟现实眼镜加主机、一体机虚拟现实头戴设备及虚拟现实外壳配智能手机使用。
随着仿真技术、感知技术和传感技术的发展，虚拟现实设备的应用领域逐渐丰富，主要包括虚拟实训基地、教育应用、工程应用、商业应用、游戏娱乐、 影视及直播等领域，具有较大的商用价值。
图1是本公开提供的虚拟现实设备的控制方法第一个实施例的方法流程图。参考图1所示，该虚拟现实设备的控制方法包括：
在步骤S110中，获取用户的声音信号。
可选地，通过麦克风获取用户的声音信号，并将声音信号转换成电信号。
在步骤S120中，对所述声音信号进行本地语音识别。
本实施例中，语音识别方法主要是模式匹配法。设备软件中已经预置了指令的关键词语或者指令，例如“播放……”、“关机”，无需用户做任何操作。
在步骤S130中，如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别。
本地语音识别库可以识别的语音信号包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机等，本地语音识别库中保存的是每个词汇的特征矢量。此处列举的词汇仅为举例说明，根据虚拟现实设备的应用场景不同，使用的词汇也不相同，总之，本地语音识别库只包括简单的与设备操作相关的词汇。如果本地语音识别库能识别出所述声音信号，则直接执行所述声音信号对应的操作指令。
云端管理服务器设置为帮助处理语音识别，同时也是用户网络运营管理的服务器。云端管理服务器从互联网上获取语音识别资源，具有自适应学习能力，能够识别的语音信号比较丰富，丰富了虚拟现实设备提供的服务以及为客户提供更加丰富的资源。
云端管理服务器收到虚拟现实设备发送的声音信号后，利用互联网的语音识别资源对声音信号进行语音识别，得到声音信号对应的操作指令。云端管理服务器的语音识别能力通过云端的语音识别资源进行自适应学习。
在步骤S140中，接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源。
随着虚拟现实技术的发展，互联网上共享的虚拟现实资源越来越多，而且互联网上的虚拟现实资源涉及多个领域。虚拟现实设备具有上网功能，当接收到云端管理服务器发送的操作指令后，向互联网获取操作指令匹配的资源。
可选地，在虚拟现实设备获取从互联网获取到操作指令匹配的资源后，将所述资源以语音、影像、震动、气味或图文显示的方式展示给用户。展示方式由虚拟现实设备应用的场景决定，此处不做限制。比如：720度无死角地电影观 看，加上触感和气味等，给用户身临其境的感觉；再比如用户进行游戏时，游戏者完全沉浸在游戏中，成为其中的一员，可以感受到被抢击中，汽车抖动、大风吹过及下雨等感受。
综上，本公开提供的虚拟现实设备的控制方法先由本地语音识别库对用户的声音信号进行识别，当本地语音识别库不能识别出声音信号时，将声音信号发送至云端管理服务器进行识别，并将识别出的操作指令发送至虚拟现实设备，虚拟现实设备执行操作指令，从互联网获取与操作指令相匹配的资源，本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
图2是本公开提供的虚拟现实设备的控制方法第二个实施例的方法流程图。参考图2所示，该虚拟现实设备的控制方法包括：
在步骤S201中，获取用户的声音信号。
可选地，通过麦克风获取用户的声音信号，并将声音信号转换成电信号。
在步骤S202中，对所述声音信号进行本地语音识别。
本实施例中，语音识别方法主要是模式匹配法。设备软件中已经预置了指令的关键词语或者指令，例如“播放……”、“关机”，无需用户做任何操作。
在步骤S203中，如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别。
本地语音识别库可以识别的语音信号包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机等，本地语音识别库中保存的是每个词汇的特征矢量。此处列举的词汇仅为举例说明，根据虚拟现实设备的应用场景不同，使用的词汇也不相同，总之，本地语音识别库只包括简单的与设备操作相关的词汇。
云端管理服务器设置为帮助处理语音识别，同时也是用户网络运营管理的服务器。云端管理服务器从互联网上获取语音识别资源，具有自适应学习能力，能够识别的语音信号比较丰富，丰富了虚拟现实设备提供的服务以及为客户提供更加丰富的资源。
云端管理服务器收到虚拟现实设备发送的声音信号后，利用互联网的语音识别资源对声音信号进行语音识别，得到声音信号对应的操作指令。
在步骤S204中，接收云端管理服务器发送的将所述声音信号识别后得到的 操作指令，所述操作指令为衣服的品牌，从互联网获取所述衣服品牌的虚拟商店。
随着电子商务的日益普及，互联网对很多大公司和商家具有特别的吸引力。建立虚拟的三维购物场景可能大幅度改善顾客购买商品的经历。顾客可以“逛”虚拟世界中的商店，挑选商品，然后通过互联网办理付款手续，商店则及时把商品送到顾客手中。在不动产、移动不便大型贵重产品的业务推广与销售中，可使客户在购买前先看产品的外貌与内在，甚至在虚拟世界中使用这款产品，对房屋、土地、锅炉、大型机具、家具、医疗器材及健身器材等方面的销售具有很大帮助。
可选地，向用户展示所述虚拟商店，用户可以在虚拟商店里挑选自己喜欢的衣服，方便快捷。
综上，本公开提供的虚拟现实设备的控制方法应用在商业领域，先由本地语音识别库对用户的声音信号进行识别，当本地语音识别库不能识别出声音信号时，将声音信号发送至云端管理服务器进行识别，识别出的操作指令为衣服品牌，虚拟现实设备则从互联网获取所述衣服品牌的虚拟商店，本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，充分利用网络资源，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
图3是本公开提供的虚拟现实设备的控制装置第一个实施例的结构方框图。参考图3所示，该虚拟现实设备的控制装置包括：
声音信号获取单元100、本地语音识别单元101、声音信号发送单元102以及操作指令执行单元103。
其中，声音信号获取单元100，设置为获取用户的声音信号；
本地语音识别单元101，设置为对所述声音信号进行本地语音识别；
声音信号发送单元102，设置为如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别；所述本地语音识别库可以识别的语音信号可以是包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机等。
操作指令执行单元103，设置为接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源；是设置为接收云端管理服务器发送的将所述声音信号识别后得到的操 作指令，所述操作指令为衣服品牌，从互联网获取所述衣服品牌的虚拟商店。
装置的详细内容此处不再赘述，请参考图1所示的方法。
综上，本公开提供的虚拟现实设备的控制装置先由本地语音识别库对用户的声音信号进行识别，当本地语音识别库不能识别出声音信号时，将声音信号发送至云端管理服务器进行识别，并将识别出的操作指令发送至虚拟现实设备，虚拟现实设备执行操作指令，从互联网获取与操作指令相匹配的资源，本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
图4是本公开提供的虚拟现实设备的控制装置第二个实施例的结构方框图。参考图4所示，该虚拟现实设备的控制装置与图3所示的装置不同之处在于，还包括：
结果展示单元104，设置为将所述资源以语音、影像、震动、气味和图文显示等方式中的至少一种展示给用户。
将从互联网上获取的资源展示给用户，让用户具有一种身临其境的感觉，扩展了虚拟现实设备的使用资源，而且，结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
图5是本公开提供的虚拟现实设备的结构方框图。参考图5所示，该虚拟现实设备1包括控制器11、无线网络电路12、语音识别电路13和麦克风14，所述控制器12配置有上述所述的虚拟现实设备的控制装置10，所述无线网络电路12及语音识别电路13分别与所述控制器11连接，所述麦克风14与所述语音识别电路13连接，所述无线网络电路12设置为连接互联网，所述语音识别电路13设置为将用户输入的声音信号转换为操作指令，所述麦克风14用于收集用户输入的声音信号。可选地，无线网络电路可以为无线网卡、无线上网卡和蓝牙的一种或多种。针对虚拟现实设备应用的领域不同，虚拟现实设备还会包括其他的功能电路，此处不一一列举。
本公开提供的虚拟现实设备的本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
图6是本公开提供的虚拟现实系统的结构方框图。参考图6所示，该虚拟现实系统包括上述所述的虚拟现实设备1和云端管理服务器2。
本公开提供的虚拟现实系统的虚拟现实设备的本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。
本实施例提供一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行上述任一实施例所述的虚拟现实设备的控制方法。
图7为本实施例提供的电子设备的结构框图。本公开实施例提供的电子设备可以是包括：处理器(processor)71、声音信号获取电路72、声音信号发送电路73、和存储器(memory)74，还可以包括总线75。其中，处理器71、声音信号获取电路72、声音信号发送电路73、存储器74可以通过总线75完成相互间的通信。声音信号获取电路72用于获取用户的声音信号。声音信号发送电路73用于如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别。处理器71可以调用存储器74中的逻辑指令，以执行上述实施例的虚拟现实设备的控制方法。
此外，上述的存储器74中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本公开的技术方案可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行上述实施例所述方法的全部或部分步骤。而前述的存储介质可以是非暂态存储介质，包括：U盘、移动硬盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质，也可以是暂态存储介质。
以上内容仅为本公开的可选实施例。
工业实用性
本实施例提供的虚拟现实设备的控制方法，先由本地语音识别库对用户的声音信号进行识别，当本地语音识别库不能识别出声音信号时，将声音信号发 送至云端管理服务器进行识别，并将识别出的操作指令发送至虚拟现实设备，虚拟现实设备执行操作指令，从互联网获取与操作指令相匹配的资源，本地语音识别库仅保存简单直接的操作指令，节省了虚拟现实设备的内存，而且结合云端管理服务器进行语音识别，增强语音识别的能力，解决了虚拟现实设备不方便操作的技术问题，提升了用户体验效果。

Claims (11)

  1. 一种虚拟现实设备的控制方法，包括：
    获取声音信号；
    对所述声音信号进行本地语音识别；
    如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别；以及
    接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源。
  2. 根据权利要求1所述的方法，其中，所述本地语音识别库能够识别的语音信号包括打开视频、播放下个视频、播放上个视频、快进、快退、增大音量、减小音量、暂停播放、继续播放和关机中的至少一个。
  3. 根据权利要求1所述的方法，其中，所述接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源之后还包括：
    将所述资源以语音、影像、震动、气味和图文显示中的至少一种方式展示。
  4. 根据权利要求1所述的方法，其中，所述接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源，包括：
    接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，所述操作指令为衣服品牌，从互联网获取所述衣服品牌的虚拟商店。
  5. 根据权利要求1所述的方法，其中，所述云端管理服务器的语音识别能力通过云端的语音识别资源进行自适应学习。
  6. 一种虚拟现实设备的控制装置，包括：
    声音信号获取单元，设置为获取声音信号；
    本地语音识别单元，设置为对所述声音信号进行本地语音识别；
    声音信号发送单元，设置为如果本地语音识别库不能识别出所述声音信号，将所述声音信号发送至云端管理服务器进行语音识别；以及
    操作指令执行单元，设置为接收云端管理服务器发送的将所述声音信号识别后得到的操作指令，执行所述操作指令，从互联网获取所述操作指令匹配的资源。
  7. 根据权利要求6所述的虚拟现实设备的控制装置，其中，所述本地语音识别库可以识别的语音信号包括打开视频、播放下个视频、播放上个视频、快 进、快退、增大音量、减小音量、暂停播放、继续播放和关机。
  8. 根据权利要求6所述的虚拟现实设备的控制装置，还包括：
    结果展示单元，设置为将所述资源以语音、影像、震动、气味或图文显示的方式展示。
  9. 一种虚拟现实设备，包括控制器、无线网络电路、语音识别电路和麦克风，所述控制器配置有如权利要求6所述的虚拟现实设备的控制装置，所述无线网络电路及语音识别电路分别与所述控制器连接，所述麦克风与所述语音识别电路连接，所述无线网络电路设置为连接互联网，所述语音识别电路设置为将声音信号转换为操作指令，所述麦克风设置为收集声音信号。
  10. 一种虚拟现实系统，包括如权利要求9所述的虚拟现实设备和云端管理服务器。
  11. 一种非暂态计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行权利要求1-5任一项所述的方法。
PCT/CN2017/074334 2016-04-12 2017-02-22 虚拟现实设备的控制方法、装置及虚拟现实设备、系统 WO2017177766A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/075,901 US20210191690A1 (en) 2016-04-12 2017-02-22 Virtual Reality Device Control Method And Apparatus, And Virtual Reality Device And System

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610223153.1 2016-04-12
CN201610223153.1A CN105931645A (zh) 2016-04-12 2016-04-12 虚拟现实设备的控制方法、装置及虚拟现实设备、系统

Publications (1)

Publication Number Publication Date
WO2017177766A1 true WO2017177766A1 (zh) 2017-10-19

Family

ID=56838001

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/074334 WO2017177766A1 (zh) 2016-04-12 2017-02-22 虚拟现实设备的控制方法、装置及虚拟现实设备、系统

Country Status (3)

Country Link
US (1) US20210191690A1 (zh)
CN (1) CN105931645A (zh)
WO (1) WO2017177766A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116386644A (zh) * 2023-06-07 2023-07-04 百融至信(北京)科技有限公司 一种asr资源方的路由控制方法及装置

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105931645A (zh) * 2016-04-12 2016-09-07 深圳市京华信息技术有限公司 虚拟现实设备的控制方法、装置及虚拟现实设备、系统
CN111611575A (zh) 2016-10-13 2020-09-01 创新先进技术有限公司 基于虚拟现实场景的业务实现方法及装置
CN106558310B (zh) 2016-10-14 2020-09-25 北京百度网讯科技有限公司 虚拟现实语音控制方法及装置
CN106548666A (zh) * 2016-12-23 2017-03-29 李雪 一种移动基站运行与维护的学习方法及系统
CN106992004B (zh) * 2017-03-06 2020-06-26 华为技术有限公司 一种调整视频的方法及终端
CN106992009B (zh) * 2017-05-03 2020-04-24 深圳车盒子科技有限公司 车载语音交互方法、系统及计算机可读存储介质
CN107315942A (zh) * 2017-07-14 2017-11-03 歌尔科技有限公司 用于虚拟现实系统的管理方法和虚拟现实系统
CN110120229A (zh) * 2018-02-05 2019-08-13 北京三星通信技术研究有限公司 虚拟现实vr音频信号的处理方法及相应设备
CN108389579A (zh) * 2018-02-09 2018-08-10 北京北行科技有限公司 一种在vr虚拟世界语音控制系统以及控制方法
CN108704310B (zh) * 2018-05-17 2021-05-14 长沙神漫文化科技有限公司 一种双vr设备参与虚拟游戏时的虚拟场景同步切换方法
CN109119071A (zh) * 2018-09-26 2019-01-01 珠海格力电器股份有限公司 一种语音识别模型的训练方法及装置
CN109558523B (zh) * 2018-11-06 2021-09-21 广东美的制冷设备有限公司 搜索处理方法、装置及终端设备
CN109284505A (zh) * 2018-11-07 2019-01-29 江苏中润普达信息技术有限公司 一种用于车载的自然语言语义分析方法
CN110299138A (zh) * 2019-06-28 2019-10-01 北京机械设备研究所 一种增强现实装配工艺指导系统及方法
CN111312240A (zh) * 2020-02-10 2020-06-19 北京达佳互联信息技术有限公司 数据控制方法、装置、电子设备及存储介质
CN114237386A (zh) * 2021-11-29 2022-03-25 歌尔光学科技有限公司 虚拟现实设备的控制方法、虚拟现实设备以及存储介质
CN117275470A (zh) * 2022-06-13 2023-12-22 华为技术有限公司 一种人机对话方法、设备及系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6154723A (en) * 1996-12-06 2000-11-28 The Board Of Trustees Of The University Of Illinois Virtual reality 3D interface system for data creation, viewing and editing
KR20120101604A (ko) * 2011-02-17 2012-09-14 타임디지탈 주식회사 음성엔진과 인터렉티브 3차원 어플리케이션을 실시간으로 연동시키는 3차원 가상현실 컨트롤 미들웨어 시스템 및 이를 이용하는 3차원 가상현실 컨텐츠의 실시간 제어방법.
CN103366743A (zh) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 操作语音命令的方法和装置
CN103793063A (zh) * 2014-03-11 2014-05-14 哈尔滨工业大学 多通道增强现实系统
CN104461006A (zh) * 2014-12-17 2015-03-25 卢晨华 一种基于自然用户界面的互联网智能镜
CN105159447A (zh) * 2015-08-19 2015-12-16 天津先驱领域科技有限公司 一种用于灾难逃生教学的虚拟现实装置
CN105392032A (zh) * 2015-11-04 2016-03-09 深圳维爱特科技有限公司 控制多媒体播放的方法和装置
CN105931645A (zh) * 2016-04-12 2016-09-07 深圳市京华信息技术有限公司 虚拟现实设备的控制方法、装置及虚拟现实设备、系统

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609871A (zh) * 2012-02-18 2012-07-25 扬州市前景电子技术研究所有限公司 网络自助商店及其购物方法
CN102708865A (zh) * 2012-04-25 2012-10-03 北京车音网科技有限公司 语音识别方法、装置及系统
CN103902613A (zh) * 2012-12-30 2014-07-02 青岛海尔软件有限公司 基于语音识别和云搜索技术的人机交互系统及方法
CN103761667A (zh) * 2014-01-09 2014-04-30 贵州宝森科技有限公司 虚拟现实电子商务平台系统及其应用方法
CN104615243A (zh) * 2015-01-15 2015-05-13 深圳市掌网立体时代视讯技术有限公司 一种头戴式多通道交互系统及多通道交互方法
CN104882143A (zh) * 2015-05-31 2015-09-02 深圳市启明创新科技开发有限公司 一种云智能学习机器人
CN105227807B (zh) * 2015-09-28 2018-04-10 北京方瑞博石数字技术有限公司 沉浸式虚拟现实演播平台

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6154723A (en) * 1996-12-06 2000-11-28 The Board Of Trustees Of The University Of Illinois Virtual reality 3D interface system for data creation, viewing and editing
KR20120101604A (ko) * 2011-02-17 2012-09-14 타임디지탈 주식회사 음성엔진과 인터렉티브 3차원 어플리케이션을 실시간으로 연동시키는 3차원 가상현실 컨트롤 미들웨어 시스템 및 이를 이용하는 3차원 가상현실 컨텐츠의 실시간 제어방법.
CN103366743A (zh) * 2012-03-30 2013-10-23 北京千橡网景科技发展有限公司 操作语音命令的方法和装置
CN103793063A (zh) * 2014-03-11 2014-05-14 哈尔滨工业大学 多通道增强现实系统
CN104461006A (zh) * 2014-12-17 2015-03-25 卢晨华 一种基于自然用户界面的互联网智能镜
CN105159447A (zh) * 2015-08-19 2015-12-16 天津先驱领域科技有限公司 一种用于灾难逃生教学的虚拟现实装置
CN105392032A (zh) * 2015-11-04 2016-03-09 深圳维爱特科技有限公司 控制多媒体播放的方法和装置
CN105931645A (zh) * 2016-04-12 2016-09-07 深圳市京华信息技术有限公司 虚拟现实设备的控制方法、装置及虚拟现实设备、系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116386644A (zh) * 2023-06-07 2023-07-04 百融至信(北京)科技有限公司 一种asr资源方的路由控制方法及装置
CN116386644B (zh) * 2023-06-07 2024-03-22 百融至信(北京)科技有限公司 一种asr资源方的路由控制方法及装置

Also Published As

Publication number Publication date
CN105931645A (zh) 2016-09-07
US20210191690A1 (en) 2021-06-24

Similar Documents

Publication Publication Date Title
WO2017177766A1 (zh) 虚拟现实设备的控制方法、装置及虚拟现实设备、系统
US10210002B2 (en) Method and apparatus of processing expression information in instant communication
WO2019052451A1 (zh) 虚拟互动方法和终端
KR102488530B1 (ko) 동영상을 생성하기 위한 방법 및 장치
US11748950B2 (en) Display method and virtual reality device
US10096165B2 (en) Technologies for virtual camera scene generation using physical object sensing
WO2019114328A1 (zh) 一种基于增强现实的视频处理方法及其装置
TW201117114A (en) System, apparatus and method for message simulation
KR101624454B1 (ko) 홀로그램 영상 기반 메시지 서비스 제공 방법 및 사용자 단말, 그리고 홀로그램 영상 표시 장치
CN112516589A (zh) 直播中游戏商品互动方法、装置、计算机设备及存储介质
US9952668B2 (en) Method and apparatus for processing virtual world
TW202008143A (zh) 人機互動方法和裝置
TW202109246A (zh) 互動方法、裝置、設備以及記錄媒體
CN113923462A (zh) 视频生成、直播处理方法、设备和可读介质
CN114245099B (zh) 视频生成方法、装置、电子设备以及存储介质
CN107817701A (zh) 设备控制方法、装置、计算机可读存储介质及终端
CN109324515A (zh) 一种控制智能电器的方法及控制终端
CN108537149B (zh) 图像处理方法、装置、存储介质及电子设备
CN114237540A (zh) 一种智慧课堂在线教学互动方法、装置、存储介质及终端
CN109445573A (zh) 一种用于虚拟化身形象互动的方法与装置
CN112637692B (zh) 互动方法、装置、设备
Priya et al. Augmented reality and speech control from automobile showcasing
US20170169572A1 (en) Method and electronic device for panoramic video-based region identification
CN110600021A (zh) 室外智能语音交互方法、装置和系统
CN113327311B (zh) 基于虚拟角色的显示方法、装置、设备、存储介质

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17781742

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS (EPO FORM 1205A DATED 11.03.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17781742

Country of ref document: EP

Kind code of ref document: A1