WO2018094852A1 - 一种虚拟现实设备及虚拟现实设备的输入控制方法 - Google Patents

一种虚拟现实设备及虚拟现实设备的输入控制方法 Download PDF

Info

Publication number
WO2018094852A1
WO2018094852A1 PCT/CN2016/114048 CN2016114048W WO2018094852A1 WO 2018094852 A1 WO2018094852 A1 WO 2018094852A1 CN 2016114048 W CN2016114048 W CN 2016114048W WO 2018094852 A1 WO2018094852 A1 WO 2018094852A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
virtual reality
command
application
reality device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/114048
Other languages
English (en)
French (fr)
Inventor
赵艳丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to KR1020187025305A priority Critical patent/KR20180102200A/ko
Priority to US16/081,278 priority patent/US20190034162A1/en
Priority to JP2019502014A priority patent/JP6588673B2/ja
Publication of WO2018094852A1 publication Critical patent/WO2018094852A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0237—Character input methods using prediction or retrieval techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1815—Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04892—Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L2015/088—Word spotting
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the present invention relates to the field of virtual reality technologies, and in particular, to an input control method for a virtual reality device and a virtual reality device.
  • the present invention provides an input control method for a virtual reality device and a virtual reality device, so as to solve the problem that the existing virtual reality device cannot be friendly and convenient for the user to input content.
  • the present invention provides a virtual reality device including: a microprocessor, and a display screen, a microphone, and a memory connected to the microprocessor,
  • the microphone is configured to collect voice information
  • the memory is configured to store a keyword, where the keyword includes: an operation command, an application name, and a file name, where the operation command includes: a command to perform a visual interface operation and a command corresponding to opening an application or a file;
  • the microprocessor is configured to identify the semantics of the voice information collected by the microphone and convert the text information into text information; and detect whether the display screen has a cursor, and if there is a cursor, input the converted text information to the The position of the cursor on the display, if there is no cursor,
  • microprocessor is further configured to perform real-time statistics on the number of times the keyword in the memory is detected, reorder the keywords from high to low according to the detected number of times, and install new Update the application name or file name in the memory when the application is deleted or the original application is deleted, or when a new file is deleted or the original file is deleted.
  • the present invention also provides an input control method for a virtual reality device, where the virtual reality device includes a display screen and a microphone;
  • the keyword includes: an operation command, an application name, and a file name, where the operation command includes: a command to perform a visual interface operation and a command corresponding to opening an application or a file;
  • Detecting whether there is an operation command in the text information and when detecting an operation command and executing a command of the visual interface operation, performing a corresponding visual interface operation; when detecting the operation command and opening a command corresponding to the application or the file, detecting Whether the application name or the file name exists in the remaining text information, and when it is detected that the application name or the file name exists, the corresponding application or file is opened, otherwise the prompt information executable without the command is given through the display screen.
  • the method further includes: real-time counting the number of times the keyword is detected, reordering the keywords from high to low according to the detected number of times, and pre-storing the text information and next time When the keywords are compared, the keywords are compared in order from high to low;
  • the keyword is updated.
  • the invention provides an input control method for a virtual reality device and a virtual reality device.
  • the virtual reality device realizes inputting text, performing a visual interface operation on the device, or opening an application and a file by means of voice control, and can automatically recognize
  • the user's voice information intelligently judge whether the user attempts to input text, or perform a visual interface operation, or open an application or a file, and further perform corresponding operations, thereby improving the convenience of the user operating the virtual reality device, optimizing human-computer interaction, and further Enhanced the virtual reality experience.
  • the virtual reality device of the embodiment of the present invention is also capable of real-time counting the number of times the keyword in the memory is detected, reordering the keyword from high to low according to the detected number, and pre-storing the text information and the memory next time.
  • compare keywords compare keywords in order from high to low to improve comparison efficiency.
  • FIG. 1 is a schematic diagram of a virtual reality device according to an embodiment of the present invention.
  • FIG. 2 is a logic flow diagram of the operation of a virtual reality device according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a virtual reality device input control method according to an embodiment of the present invention.
  • the design concept of the present invention is that the virtual reality device collects voice information through a microphone, and semantically recognizes and converts the voice information into text information.
  • the text information is input to the cursor position, and when the display screen is not detected
  • the cursor it is detected whether the text information is an operation command. If it is an operation command, it is further determined that the operation command is a command to perform a visual interface operation, or a command corresponding to an application or a file is opened, and converted into a system instruction execution corresponding operation.
  • the convenience of the user to operate the virtual reality device is improved, the human-computer interaction is optimized, and the virtual reality experience is further enhanced.
  • the embodiment of the present invention provides a virtual reality device.
  • the virtual reality device includes: a microprocessor 110, and a display screen 120, a microphone 130, and a memory 140 connected to the microprocessor 110.
  • a microphone 130 configured to collect voice information
  • the storage unit 140 is configured to store a keyword, where the keyword includes: an operation command, an application name, and a file name, where the operation command includes: a command to perform a visual interface operation and a command corresponding to opening an application or a file;
  • the microprocessor 110 is configured to recognize the semantics of the voice information collected by the microphone 130 and convert it into text information. Specifically, the microprocessor 110 encodes the voice information into a digital signal, and then performs voice recognition through the voice recognition algorithm (ASR), extracts the semantics of the user, and converts the text into text information. This is prior art and will not be described again.
  • ASR voice recognition algorithm
  • the microprocessor 110 is further configured to detect whether there is a cursor on the display screen 120, and if there is a cursor, input the converted text information to a cursor position on the display screen 120; if there is no cursor, the text information is in the memory 140 Keyword comparison, detecting whether there is an operation command in the text information.
  • the operation command is detected and the command for performing the visual interface operation is executed, the operation command is converted into a corresponding system instruction, and the corresponding visual interface operation is performed; when the operation is detected; If the command corresponding to the application or the file is opened, the application name or the file name is detected in the remaining text information.
  • the display 120 is A prompt message that no command can be executed.
  • the virtual reality device of the embodiment of the present invention implements a visual interface operation, performs a visual interface operation on a device, or opens an application or a file by means of voice control, and can automatically recognize a user's voice information, and intelligently determine that the user attempts to input.
  • Text, or perform visual interface operations, or open applications or files, and further perform the corresponding operations improve the convenience of user operations, optimize human-computer interaction, and further enhance the virtual reality experience.
  • the password recognized by the voice can be directly written to the location of the cursor through the background service, which can solve the problem that the existing virtual reality device is not easy to pass through the keyboard.
  • the problem of entering characters when the virtual reality device needs to be connected to the wireless network, when the password is input, the password recognized by the voice can be directly written to the location of the cursor through the background service, which can solve the problem that the existing virtual reality device is not easy to pass through the keyboard. The problem of entering characters.
  • the virtual reality device further includes: a touch screen or a keyboard (not shown);
  • the microprocessor 110 when determining the command to perform the visual interface operation, performs a corresponding visual interface operation through the background service process; when it is determined that the application or file command is opened, the corresponding system is opened by the system broadcast. Application or file.
  • the logic flow of the virtual reality device in the embodiment of the present invention is as follows:
  • the microphone collects voice information, and the microprocessor recognizes the semantics of the voice information and converts it into text information, and detects whether there is a cursor on the display screen.
  • the prompt information that no command can be executed is given through the display screen. If there is an operation command, it is judged whether the operation command is detected and whether the command for performing the visual interface operation or the command corresponding to the application or the file is opened. If it is determined that the command to perform the visual interface operation is performed, the corresponding visual interface operation is performed through the background service process. If it is determined that the command corresponding to the application or the file is opened, it is detected whether the application name or the file name exists in the remaining text information. If an application name or file name exists, the corresponding application or file is opened by system broadcast. If the application name or file name does not exist, a message indicating that there is no command executable can be given through the display screen.
  • the command to perform the visual interface operation includes: turning the page, pausing the video, continuing to play the video, etc., for example, the operation command is “page turning”, and the microprocessor switches the system interface from the current interface to the next interface.
  • the command corresponding to opening an application or a file may be, for example, "start", "open", or the like.
  • the microphone 130 includes a main microphone and one or more auxiliary microphones
  • the microprocessor 110 is further configured to filter out noise in the voice information according to the voice information collected by the one or more auxiliary microphones, thereby improving the accuracy of the voice recognition.
  • the voice denoising algorithm is stored in the microprocessor 110, which is a prior art and will not be described again.
  • the microprocessor 110 is further configured to update the application name or file name in the memory 140 when installing a new application or deleting an original application, or writing a new file or deleting an original file.
  • the microprocessor 110 is also used to calculate the number of times the keyword in the memory 140 is detected in real time, and to re-key the keyword from high to low according to the detected number of times. Sorting, that is, sorting according to the frequency at which the keywords are used, from high to low, the next time the text information is compared with the pre-stored keywords, the keywords are sequentially compared in descending order.
  • the keywords will be reordered from high to low according to the detected number of times, and the microprocessor will display the text next time.
  • the keywords with higher frequency are preferentially compared to improve the keyword comparison efficiency and quickly find the keywords.
  • the embodiment of the present invention further provides an input control method for a virtual reality device, where the virtual reality device includes a display screen and a microphone; as shown in FIG. 3, the method includes:
  • Step S310 pre-storing the keyword, the keyword includes: an operation command, an application name, and a file name, where the operation command includes: a command to perform a visual interface operation and a command corresponding to opening an application or a file;
  • Step S320 collecting voice information by using the microphone
  • Step S330 Perform semantic recognition on the voice information collected by the microphone and convert the voice information into text information.
  • Step S340 detecting whether there is a cursor on the display screen, if there is a cursor, inputting the converted text information to a cursor position on the display screen, if there is no cursor, the text information and the pre-stored key Word contrast,
  • Step S350 detecting whether there is an operation command in the text information, and when detecting the operation command and executing the command of the visual interface operation, performing a corresponding visual interface operation; when detecting the operation command and opening the command corresponding to the application or the file And detecting whether the application name or the file name exists in the remaining text information.
  • the corresponding application or file is opened, otherwise the prompt information executable without the command is given through the display screen.
  • the microphone includes a primary microphone and one or more secondary microphones
  • the method further includes: filtering out noise in the voice information collected by the primary microphone according to the voice information collected by the one or more secondary microphones. Improve the accuracy of speech recognition.
  • the method further includes: when the text information of the input cursor position is incorrect, moving the text information through the touch screen or the keyboard of the virtual reality device to modify or re-enter the text.
  • the performing the corresponding visual interface operation comprises: performing a corresponding visual interface operation by the background service process; and the opening the corresponding application or file comprises: opening the corresponding application or file by the system broadcast.
  • the method further includes: updating the keyword when installing a new application or deleting an original application, or writing a new file or deleting an original file.
  • the method further includes: real-time counting the number of times the keyword is detected, reordering the keywords according to the detected times from high to low, and next time
  • the keywords are compared in order from high to low, thereby improving the comparison efficiency.
  • the virtual reality device and the virtual reality device input control method provided by the embodiment of the present invention are virtual.
  • the realistic device realizes inputting text, performing visual interface operation on the device or opening an application or file by means of voice control, can automatically recognize the user's voice information, intelligently judge whether the user attempts to input text, or perform a visual interface operation, or open an application or a file. And further implement the corresponding operation, improve the convenience of the user to operate the virtual reality device, optimize the human-computer interaction, and further enhance the virtual reality experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种虚拟现实设备及虚拟现实设备的输入控制方法，所述虚拟现实设备包括：微处理器（110），及与微处理器连接的显示屏（120）、麦克风（130）和存储器（140），所述微处理器（110）识别麦克风（130）采集的语音信息的语义并转换为文字信息；以及检测显示屏（120）是否存在光标，如果存在光标，则将文字信息输入至显示屏（120）上的光标位置，否则将文字信息与存储器（140）中的关键字对比，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到时，则打开相应的应用或文件。所述虚拟现实设备及其输入控制方法，提高了用户操作虚拟现实设备的便捷性，优化了人机交互，增强了虚拟现实体验。

Description

一种虚拟现实设备及虚拟现实设备的输入控制方法 技术领域
本发明涉及虚拟现实技术领域，特别涉及一种虚拟现实设备及虚拟现实设备的输入控制方法。
发明背景
虚拟现实技术未来将会发展成一种改变我们生活方式的新突破。但是从现在来看，虚拟现实技术想要真正进入消费级市场，还有一段很长的路要走。开发者如何为用户提供一个真正身临其境的游戏或应用体验还存在比较大的技术局限性，而一些问题到现在仍然还没有很好的解决办法。
当前已有的各种虚拟现实装备依然阻挡着用户和虚拟世界之间的交流。虚拟现实最大的挑战也许是如何在虚拟世界中与目标进行互动。虚拟现实如何实现输入控制是头戴式设备开发者和硬件制造商目前非常大的困扰。即使已经存在的触摸屏和3D输入法也无法友好的方便用户输入内容。
发明内容
鉴于上述问题，本发明提供了一种虚拟现实设备及虚拟现实设备的输入控制方法，以解决现有虚拟现实设备无法友好的方便用户输入内容的问题。
为达到上述目的，本发明的技术方案是这样实现的：
一方面，本发明提供一种虚拟现实设备，包括：微处理器，及与所述微处理器连接的显示屏、麦克风和存储器，
所述麦克风，用于采集语音信息；
所述存储器，用于存储关键字，所述关键字包括：操作命令、应用名称和文件名称，所述操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
所述微处理器，用于识别所述麦克风采集的语音信息的语义并转换为文字信息；以及检测所述显示屏是否存在光标，如果存在光标，则将所述转换的文字信息输入至所述显示屏上的光标位置，如果不存在光标，
则将所述文字信息与所述存储器中的关键字对比，检测所述文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过所述显 示屏给出无命令可执行的提示信息。
进一步，所述微处理器，还用于实时统计所述存储器中的关键字被检测到的次数，按照所述被检测到的次数将所述关键字由高到低重新排序；以及在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新所述存储器中的应用名称或文件名称。
另一方面，本发明还提供一种虚拟现实设备的输入控制方法，所述虚拟现实设备包括显示屏和麦克风；
对关键字进行预先存储，所述关键字包括：操作命令、应用名称和文件名称，所述操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
利用所述麦克风采集语音信息；
对所述麦克风采集的语音信息进行语义识别并转换为文字信息；
检测所述显示屏是否存在光标，如果存在光标，则将所述转换的文字信息输入至所述显示屏上的光标位置，如果不存在光标，则将所述文字信息与预存的关键字对比，
检测所述文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过所述显示屏给出无命令可执行的提示信息。
进一步，所述方法还包括：实时统计所述关键字被检测到的次数，按照所述被检测到的次数将所述关键字由高到低重新排序，并在下一次将所述文字信息与预存的关键字对比时，按照由高到低的顺序依次对比所述关键字；
以及，在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新所述关键字。
本发明的有益效果是：本发明提供一种虚拟现实设备及虚拟现实设备的输入控制方法，虚拟现实设备通过声控的方式实现输入文字、对设备执行可视化界面操作或打开应用、文件，能够自动识别用户的语音信息，智能判断用户试图输入文字，还是执行可视化界面操作，或者是打开应用或文件，并进一步执行相应的操作，提高了用户操作虚拟现实设备的便捷性，优化了人机交互，进一步增强了虚拟现实体验。
进一步，本发明实施例的虚拟现实设备还能够实时统计存储器中关键字被检测到的次数，将关键字按照被检测到的次数由高到低重新排序，并在下一次将文字信息与存储器预存的关键字对比时，按照由高到低的顺序依次对比关键字，从而提高对比效率。
附图简要说明
图1是本发明实施例的虚拟现实设备的示意图；
图2是本发明实施例的虚拟现实设备工作的逻辑流程图；
图3是本发明实施例的虚拟现实设备输入控制方法的流程图。
具体实施方式
本发明的设计构思是，虚拟现实设备通过麦克风采集语音信息，对语音信息进行语义识别并转换为文字信息，当检测显示屏存在光标时，将文字信息输入至光标位置，当检测到显示屏不存在光标时，检测文字信息是否是操作命令，如果是操作命令，则进一步判断操作命令是执行可视化界面操作的命令，或者是打开应用或文件对应的命令，并转换成系统指令执行对应的操作。由此提高了用户操作虚拟现实设备的便捷性，优化了人机交互，进一步增强了虚拟现实体验。
为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。
本发明实施例提供一种虚拟现实设备，如图1所示，该虚拟现实设备包括：微处理器110，及与微处理器110连接的显示屏120、麦克风130和存储器140，
麦克风130，用于采集语音信息；
存储器140，用于存储关键字，关键字包括：操作命令、应用名称和文件名称，操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
微处理器110，用于识别麦克风130采集的语音信息的语义并转换为文字信息。具体地，微处理器110将语音信息经过编码后转换成数字信号，然后通过语音识别算法(ASR)进行语音识别，提取用户的语义，转换成文字信息。此为现有技术，不再赘述。
微处理器110，还用于检测显示屏120是否存在光标，如果存在光标，则将转换的文字信息输入至显示屏120上的光标位置；如果不存在光标，则将文字信息与存储器140中的关键字对比，检测文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则将操作命令转换成对应的系统指令，并执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过显示屏120给出无命令可执行的提示信息。
由上述可知，本发明实施例的虚拟现实设备通过声控的方式实现输入文字、对设备执行可视化界面操作或打开应用、文件，能够自动识别用户的语音信息，智能判断用户试图输入 文字，还是执行可视化界面操作，或者是打开应用或文件，并进一步执行相应的操作，提高了用户操作的便捷性，优化了人机交互，进一步增强了虚拟现实体验。
在本发明实施例中，当虚拟现实设备需要连接无线网络，在输入密码时，可通过后台服务把语音识别出的密码直接写入到光标所在位置，可以解决现有虚拟现实设备通过键盘不容易输入字符的问题。
在本发明实施例中，虚拟现实设备还包括：触摸屏或键盘(图中未示出)；
当输入光标位置的文字信息有误时，通过触摸屏或键盘移动光标进行文字信息的修改或重新输入文字。
在本发明实施例中，微处理器110在判断出执行可视化界面操作的命令时，通过后台服务进程执行相应的可视化界面操作；在判断出打开应用或文件的命令时，通过系统广播打开相应的应用或文件。
如图2所示，本发明实施例的虚拟现实设备工作的逻辑流程如下：
麦克风采集语音信息，微处理器识别语音信息的语义并转换为文字信息，并检测显示屏是否存在光标。
如果存在光标，将文字信息输入至显示屏上的光标位置。如果不存在光标，检测文字信息中是否有操作命令。
如果不存在操作命令，则通过显示屏给出无命令可执行的提示信息。如果存在操作命令，则判断检测到操作命令且是执行可视化界面操作的命令还是打开应用或文件对应的命令。如果判断出是执行可视化界面操作的命令时，通过后台服务进程执行相应的可视化界面操作。如果判断出是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称。如果存在应用名称或文件名称，则通过系统广播打开相应的应用或文件。如果不存在应用名称或文件名称，则通过显示屏给出无命令可执行的提示信息。
在本发明实施例中，执行可视化界面操作的命令包括：翻页、暂停视频、继续播放视频等，例如操作命令是“翻页”，则微处理器将系统界面由当前界面切换到下一个界面。打开应用或文件对应的命令例如可以是“启动”、“打开”等。
在本发明实施例中，麦克风130包括一个主麦克风和一个以上辅麦克风，微处理器110，还用于根据一个以上辅麦克风采集的语音信息滤除语音信息中的噪声，提高语音识别的准确率。具体地，微处理器110中存储有语音降噪算法，此为现有技术，不再赘述。
在本发明实施例中，微处理器110还用于在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新存储器140中的应用名称或文件名称。微处理器110还用于实时统计存储器140中的关键字被检测到的次数，按照被检测到的次数将关键字由高到低重新 排序，也即按照关键字被使用的频率由高到低排序，在下一次将所述文字信息与预存的关键字对比时，按照由高到低的顺序依次对比关键字。
随着虚拟现实设备中视频或者游戏的不断积累，存储器140中的应用或文件会越来越多，按照被检测到的次数将关键字由高到低重新排序，微处理器在下一次则将文字信息与存储器140中的关键字对比时，优先对比使用频率较高的关键字，以提高关键字对比效率，快速找到关键字。
本发明实施例还提供一种虚拟现实设备的输入控制方法，所述虚拟现实设备包括显示屏和麦克风；如图3所述，该方法包括：
步骤S310：对关键字进行预先存储，所述关键字包括：操作命令、应用名称和文件名称，所述操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
步骤S320：利用所述麦克风采集语音信息；
步骤S330：对所述麦克风采集的语音信息进行语义识别并转换为文字信息；
步骤S340：检测所述显示屏是否存在光标，如果存在光标，则将所述转换的文字信息输入至所述显示屏上的光标位置，如果不存在光标，则将所述文字信息与预存的关键字对比，
步骤S350：检测所述文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过所述显示屏给出无命令可执行的提示信息。
在本发明实施例中，所述麦克风包括一个主麦克风和一个以上辅麦克风，所述方法还包括：根据所述一个以上辅麦克风采集的语音信息滤除所述主麦克风采集的语音信息中的噪声，提高语音识别的准确率。
在本发明实施例中，所述方法还包括：当所述输入光标位置的文字信息有误时，通过虚拟现实设备的触摸屏或键盘移动光标进行文字信息修改或重新输入文字。
在本发明实施例中，所述执行相应的可视化界面操作包括：通过后台服务进程执行相应的可视化界面操作；所述打开相应的应用或文件包括：通过系统广播打开相应的应用或文件。
在本发明实施例中，所述方法还包括：在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新所述关键字。
在本发明实施例中，所述方法还包括：实时统计所述关键字被检测到的次数，将所述关键字按照所述被检测到的次数由高到低重新排序，并在下一次将所述文字信息与预存的关键字对比时，按照由高到低的顺序依次对比所述关键字，从而提高对比效率。
综上所述，本发明实施例提供的一种虚拟现实设备及虚拟现实设备的输入控制方法，虚 拟现实设备通过声控的方式实现输入文字、对设备执行可视化界面操作或打开应用、文件，能够自动识别用户的语音信息，智能判断用户试图输入文字，还是执行可视化界面操作，或者是打开应用或文件，并进一步执行相应的操作，提高了用户操作虚拟现实设备的便捷性，优化了人机交互，进一步增强了虚拟现实体验。
以上所述，仅为本发明的具体实施方式，在本发明的上述教导下，本领域技术人员可以在上述实施例的基础上进行其他的改进或变形。本领域技术人员应该明白，上述的具体描述只是更好的解释本发明的目的，本发明的保护范围应以权利要求的保护范围为准。

Claims (10)

  1. 一种虚拟现实设备，包括：微处理器，及与所述微处理器连接的显示屏、麦克风和存储器，其特征在于，
    所述麦克风，用于采集语音信息；
    所述存储器，用于存储关键字，所述关键字包括：操作命令、应用名称和文件名称，所述操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
    所述微处理器，用于识别所述麦克风采集的语音信息的语义并转换为文字信息；以及检测所述显示屏是否存在光标，如果存在光标，则将所述转换的文字信息输入至所述显示屏上的光标位置，如果不存在光标，则将所述文字信息与所述存储器中的关键字对比，检测所述文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过所述显示屏给出无命令可执行的提示信息。
  2. 根据权利要求1所述的虚拟现实设备，其特征在于，
    所述微处理器在判断出执行可视化界面操作的命令时，通过后台服务进程执行相应的可视化界面操作；在判断出打开应用或文件的命令时，通过系统广播打开相应的应用或文件。
  3. 根据权利要求1所述的虚拟现实设备，其特征在于，所述微处理器，还用于实时统计所述存储器中的关键字被检测到的次数，按照所述被检测到的次数将所述关键字由高到低重新排序；以及在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新所述存储器中的应用名称或文件名称。
  4. 根据权利要求1所述的虚拟现实设备，其特征在于，所述麦克风包括一个主麦克风和一个以上辅麦克风，所述微处理器，还用于根据所述一个以上辅麦克风采集的语音信息滤除所述语音信息中的噪声。
  5. 根据权利要求1所述的虚拟现实设备，其特征在于，所述虚拟现实设备还包括：触摸屏或键盘；
    当所述输入光标位置的文字信息有误时，通过所述触摸屏或所述键盘移动光标进行文字信息的修改或重新输入文字。
  6. 一种虚拟现实设备的输入控制方法，所述虚拟现实设备包括显示屏和麦克风；其 特征在于，
    对关键字进行预先存储，所述关键字包括：操作命令、应用名称和文件名称，所述操作命令包括：执行可视化界面操作的命令和打开应用或文件对应的命令；
    利用所述麦克风采集语音信息；
    对所述麦克风采集的语音信息进行语义识别并转换为文字信息；
    检测所述显示屏是否存在光标，如果存在光标，则将所述转换的文字信息输入至所述显示屏上的光标位置，如果不存在光标，则将所述文字信息与预存的关键字对比，
    检测所述文字信息中是否有操作命令，当检测到操作命令且是执行可视化界面操作的命令，则执行相应的可视化界面操作；当检测到操作命令且是打开应用或文件对应的命令，则检测剩余文字信息中是否存在应用名称或文件名称，当检测到存在应用名称或文件名称时，则打开相应的应用或文件，否则通过所述显示屏给出无命令可执行的提示信息。
  7. 根据权利要求6所述的虚拟现实设备的输入控制方法，其特征在于，
    所述执行相应的可视化界面操作包括：通过后台服务进程执行相应的可视化界面操作；
    所述打开相应的应用或文件包括：通过系统广播打开相应的应用或文件。
  8. 根据权利要求6所述的虚拟现实设备的输入控制方法，其特征在于，所述方法还包括：
    实时统计所述关键字被检测到的次数，按照所述被检测到的次数将所述关键字由高到低重新排序，并在下一次将所述文字信息与预存的关键字对比时，按照由高到低的顺序依次对比所述关键字；
    以及，在安装新的应用或删除原有应用，或写入新的文件或删除原有文件时，更新所述关键字。
  9. 根据权利要求6所述的虚拟现实设备的输入控制方法，其特征在于，所述麦克风包括一个主麦克风和一个以上辅麦克风，所述方法还包括：
    根据所述一个以上辅麦克风采集的语音信息滤除所述主麦克风采集的语音信息中的噪声。
  10. 根据权利要求6所述的虚拟现实设备的输入控制方法，其特征在于，所述方法还包括：
    当所述输入光标位置的文字信息有误时，通过虚拟现实设备的触摸屏或键盘移动光标进行文字信息的修改或重新输入文字。
PCT/CN2016/114048 2016-11-24 2016-12-31 一种虚拟现实设备及虚拟现实设备的输入控制方法 Ceased WO2018094852A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020187025305A KR20180102200A (ko) 2016-11-24 2016-12-31 가상현실 장치 및 가상현실 장치의 입력 제어 방법
US16/081,278 US20190034162A1 (en) 2016-11-24 2016-12-31 Virtual reality device and input control method thereof
JP2019502014A JP6588673B2 (ja) 2016-11-24 2016-12-31 仮想現実機器及び仮想現実機器の入力制御方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611045610.9 2016-11-24
CN201611045610.9A CN106775555B (zh) 2016-11-24 2016-11-24 一种虚拟现实设备及虚拟现实设备的输入控制方法

Publications (1)

Publication Number Publication Date
WO2018094852A1 true WO2018094852A1 (zh) 2018-05-31

Family

ID=58975352

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/114048 Ceased WO2018094852A1 (zh) 2016-11-24 2016-12-31 一种虚拟现实设备及虚拟现实设备的输入控制方法

Country Status (5)

Country Link
US (1) US20190034162A1 (zh)
JP (1) JP6588673B2 (zh)
KR (1) KR20180102200A (zh)
CN (1) CN106775555B (zh)
WO (1) WO2018094852A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20260008409A1 (en) * 2022-08-05 2026-01-08 Koito Manufacturing Co., Ltd. Road surface drawing device for vehicle and road surface drawing method for vehicle

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107436749A (zh) * 2017-08-03 2017-12-05 安徽智恒信科技有限公司 基于三维虚拟现实场景的文字输入方法及系统
CN108389579A (zh) * 2018-02-09 2018-08-10 北京北行科技有限公司 一种在vr虚拟世界语音控制系统以及控制方法
CN112652302B (zh) * 2019-10-12 2024-05-24 腾讯科技（深圳）有限公司 语音控制方法、装置、终端及存储介质
CN111142675A (zh) * 2019-12-31 2020-05-12 维沃移动通信有限公司 输入方法及头戴式电子设备
CN111459288B (zh) * 2020-04-23 2021-08-03 捷开通讯(深圳)有限公司 一种运用头控实现语音输入的方法和装置
US12061842B2 (en) 2022-04-04 2024-08-13 Snap Inc. Wearable device AR object voice-based interaction

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1229216A (zh) * 1998-03-16 1999-09-22 致伸实业股份有限公司 可接受语音指令的视窗显示系统
CN101882007A (zh) * 2010-06-13 2010-11-10 北京搜狗科技发展有限公司 一种基于输入界面进行信息输入和执行的方法、装置
US20110153620A1 (en) * 2003-03-01 2011-06-23 Coifman Robert E Method and apparatus for improving the transcription accuracy of speech recognition software
CN103631800A (zh) * 2012-08-23 2014-03-12 腾讯科技（深圳）有限公司 信息处理方法及装置
CN104346127A (zh) * 2013-08-02 2015-02-11 腾讯科技（深圳）有限公司 语音输入的实现方法、装置及终端

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11120269A (ja) * 1997-10-20 1999-04-30 Pca Kk 音声入力会計システム及び音声入力会計プログラムを記憶した媒体
JP2000242464A (ja) * 1999-02-23 2000-09-08 Sharp Corp 音声情報処理装置及び方法並びに音声情報処理プログラムを記憶した記憶媒体
JP2005108087A (ja) * 2003-10-01 2005-04-21 Mitsubishi Electric Corp ウェブページ入力装置およびプログラム
CN102755745A (zh) * 2012-07-31 2012-10-31 曾珠峰 一种全身式仿真游戏设备
CN103578472A (zh) * 2012-08-10 2014-02-12 海尔集团公司 电器设备的控制方法和控制装置
CN103309618A (zh) * 2013-07-02 2013-09-18 姜洪明 移动操作系统
CN104731549B (zh) * 2015-04-09 2017-12-19 安徽咪鼠科技有限公司 一种基于鼠标的语音识别人机交互方法
CN105700704B (zh) * 2016-03-21 2018-08-28 深圳五洲无线股份有限公司 小尺寸屏幕下的文字输入方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1229216A (zh) * 1998-03-16 1999-09-22 致伸实业股份有限公司 可接受语音指令的视窗显示系统
US20110153620A1 (en) * 2003-03-01 2011-06-23 Coifman Robert E Method and apparatus for improving the transcription accuracy of speech recognition software
CN101882007A (zh) * 2010-06-13 2010-11-10 北京搜狗科技发展有限公司 一种基于输入界面进行信息输入和执行的方法、装置
CN103631800A (zh) * 2012-08-23 2014-03-12 腾讯科技（深圳）有限公司 信息处理方法及装置
CN104346127A (zh) * 2013-08-02 2015-02-11 腾讯科技（深圳）有限公司 语音输入的实现方法、装置及终端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20260008409A1 (en) * 2022-08-05 2026-01-08 Koito Manufacturing Co., Ltd. Road surface drawing device for vehicle and road surface drawing method for vehicle

Also Published As

Publication number Publication date
CN106775555B (zh) 2020-02-07
US20190034162A1 (en) 2019-01-31
JP2019527889A (ja) 2019-10-03
KR20180102200A (ko) 2018-09-14
CN106775555A (zh) 2017-05-31
JP6588673B2 (ja) 2019-10-09

Similar Documents

Publication Publication Date Title
CN106775555B (zh) 一种虚拟现实设备及虚拟现实设备的输入控制方法
US9479911B2 (en) Method and system for supporting a translation-based communication service and terminal supporting the service
US9218052B2 (en) Framework for voice controlling applications
CN103869931B (zh) 语音控制用户界面的方法及装置
CN107331400A (zh) 一种声纹识别性能提升方法、装置、终端及存储介质
US9454964B2 (en) Interfacing device and method for supporting speech dialogue service
CN107992587A (zh) 一种浏览器的语音交互方法、装置、终端和存储介质
CN104090652A (zh) 一种语音输入方法和装置
CN108376543A (zh) 一种电器设备的控制方法、装置、设备和存储介质
CN102148031A (zh) 语音识别与交互系统及方法
JP7017598B2 (ja) スマートデバイスのデータ処理方法、装置、機器及び記憶媒体
JP2014132342A (ja) 対話型サーバ、ディスプレイ装置及びその制御方法
CN103731707A (zh) 移动终端设备控制智能电视端语音输入的方法及系统
CN103811006A (zh) 用于语音识别的方法和装置
US12190882B2 (en) Method and apparatus for generating general voice commands and augmented reality display
CN110968245B (zh) 一种透过语音控制office办公软件的操作方法
US20100131275A1 (en) Facilitating multimodal interaction with grammar-based speech applications
WO2019101067A1 (zh) 用于数据可视化的信息的处理方法以及装置
KR20150077580A (ko) 음성 인식 기반 서비스 제공 방법 및 그 장치
CN115359798A (zh) 语音控制的控件识别方法、装置、设备、介质及程序产品
CN106095492A (zh) 一种应用程序的关闭方法和装置
CN107005609B (zh) 基于吹气动作操作移动终端的方法和移动终端
CN110827815A (zh) 一种语音识别方法、终端、系统以及计算机存储介质
KR20130071161A (ko) 음성인식을 이용한 문서편집기의 기능실행 방법
CN108235813A (zh) 一种语音输入的方法和相关设备

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 20187025305

Country of ref document: KR

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16922517

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019502014

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16922517

Country of ref document: EP

Kind code of ref document: A1