WO2016161906A1 - 一种终端设备的控制方法、控制设备以及终端设备 - Google Patents
一种终端设备的控制方法、控制设备以及终端设备 Download PDFInfo
- Publication number
- WO2016161906A1 WO2016161906A1 PCT/CN2016/077411 CN2016077411W WO2016161906A1 WO 2016161906 A1 WO2016161906 A1 WO 2016161906A1 CN 2016077411 W CN2016077411 W CN 2016077411W WO 2016161906 A1 WO2016161906 A1 WO 2016161906A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal device
- control
- operation instruction
- blind
- action
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
Definitions
- the present application relates to the field of communications technologies, and in particular, to a terminal device control method, a control device, and a terminal device.
- the head-mounted display device can establish a connection with the terminal device through the communication interface, thereby implementing multimedia information (such as video information, audio information, image information, etc.) being broadcasted in the terminal device by the head-mounted display device.
- multimedia information such as video information, audio information, image information, etc.
- the head mounted display device comprises: a left display screen for left eye viewing and a right display screen for right eye viewing, each of the display screens including a main board, an ultra micro display screen and a lens.
- the multimedia information that is being broadcasted in the terminal device can be obtained through the left and right display screens of the head mounted display device. It is equivalent to wearing a pair of multifunctional glasses.
- the user wears the head-mounted display device
- the user cannot recognize the external environment.
- the user's control of the terminal device is relatively blind, and the terminal device performs the terminal device according to the received control command sent by the user.
- the problem of controlling the control error rate is relatively high.
- the embodiments of the present application provide a control method, a control device, and a terminal device of a terminal device, which are used to solve the current control command sent by the terminal device according to the received user because the user cannot identify the external environment. Comparison of control error rates for terminal equipment control High problem.
- a method for controlling a terminal device includes: monitoring an action operation instruction initiated by a user through the terminal device; determining, according to a preset correspondence relationship between the action operation instruction and the control content, Control action content corresponding to the action operation instruction; wherein the preset correspondence relationship is valid when establishing a communication connection between the terminal device and the head mounted display device; according to the determined control content
- the terminal device controls.
- a control device of a terminal device including: a listening unit, configured to monitor an action operation instruction initiated by a user through the terminal device; and a first determining unit, configured to execute an instruction and control according to the action Determining, by the preset correspondence between the content, the control content corresponding to the monitored operation operation instruction; wherein the preset correspondence is effective when establishing a communication connection between the terminal device and the head mounted display device
- the control unit is configured to control the terminal device according to the determined control content.
- a control device for a terminal device includes: a memory, a processor, wherein the memory is configured to store one or more instructions, wherein the one or more instructions are for The processor invokes execution;
- the processor is configured to: monitor an action operation instruction initiated by the user through the terminal device; and determine, according to a preset correspondence relationship between the action operation instruction and the control content, a control content corresponding to the monitored action operation instruction;
- the preset correspondence is effective when a communication connection is established between the terminal device and the head mounted display device; and the terminal device is controlled according to the determined control content.
- a terminal device comprising the above-described control device.
- the embodiment of the present application monitors the action operation command initiated by the user through the terminal device, and determines the control content corresponding to the monitored action operation instruction according to the preset correspondence relationship between the action operation instruction and the control content, and the corresponding relationship It is effective when a communication connection is established between the terminal device and the head mounted display device, and the terminal device is controlled according to the determined control content.
- the user may identify the action operation command initiated by the user through the terminal device, and determine The user wants to control the control content of the terminal device, avoiding The problem that the control error rate of the terminal device controlling the terminal device according to the received control command sent by the user is relatively high due to the inability of the user to recognize the external environment, thereby effectively improving the accuracy of the terminal device recognition operation operation instruction and greatly improving the accuracy.
- the control accuracy of the terminal device is relatively high due to the inability of the user to recognize the external environment, thereby effectively improving the accuracy of the terminal device recognition operation operation instruction and greatly improving the accuracy.
- FIG. 1 is a schematic flowchart of a method for controlling a terminal device according to an embodiment of the present disclosure
- FIG. 2 is a schematic structural view of a blind operation interface
- FIG. 3 is a schematic structural diagram of a control device of a terminal device according to an embodiment of the present disclosure
- FIG. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
- a control method, a control device, and a terminal device of a terminal device are provided in the embodiment of the present application.
- the action operation instruction initiated by the user through the terminal device is identified according to the preset correspondence relationship between the action operation instruction and the control content, and the control content that the user wishes to control the terminal device is determined.
- the problem that the control device has a relatively high control error rate for controlling the terminal device according to the received control command sent by the user due to the user's inability to recognize the external environment is avoided, thereby effectively improving the accuracy of the terminal device identifying the action operation command and greatly improving the accuracy.
- the control accuracy of the terminal device is provided in the embodiment of the present application.
- control method of the terminal device in the embodiment of the present application is performed on the premise that a communication connection is established between the terminal device and the head mounted display device, specifically, between the terminal device and the head mounted display device.
- the communication connection can be established through the mobile terminal high-definition audio and video standard interface (English: Mobile High-Definition Link; abbreviation: MHL), or the communication connection can be established through a high-definition multimedia interface (English: High Definition Multimedia Interface; HDMI).
- MHL Mobile High-Definition Link
- HDMI High Definition Multimedia Interface
- the terminal device can transmit the multimedia being broadcast through MHL or HDMI
- the information is transmitted to the display in the head mounted display device.
- the head-mounted display device in the embodiment of the present application may be referred to as a glasses-type display, and may also be a helmet with a display function.
- the specific expression form of the head-mounted display device is not specifically limited herein. .
- the working principle of the head-mounted display device is: when receiving the multimedia information being broadcasted on the terminal device, pushing the received multimedia information to the display on the ultra-micro display screen; through the optical system (for example, a lens) Performing an enlargement operation on the multimedia information displayed on the ultra-micro display, and projecting the enlarged multimedia information on the user's retina, so that the user can obtain the broadcasted in the terminal device through the left and right display screens of the head-mounted display device Multimedia information.
- the optical system for example, a lens
- FIG. 1 is a schematic flowchart diagram of a method for controlling a terminal device according to an embodiment of the present disclosure. The method can be as follows.
- Step 101 Detect whether a communication connection is established between the terminal device and the head mounted display device. If the communication connection is established, step 102 is performed; otherwise, the terminal device is controlled according to the prior art solution.
- step 101 it is detected whether the external communication interface of the terminal device establishes a communication connection with the head mounted display device via MHL or HDMI.
- the terminal device If it is detected that the external communication interface of the terminal device establishes a communication connection with the head mounted display device through MHL or HDMI, the terminal device transmits the display content being displayed and the display content in the display window to the display in the head mounted display device.
- the selection message is used to remind the user whether to open the “head-mounted display device display mode” .
- selection message may be displayed on the upper part of the display screen of the terminal device for the user to directly select.
- the "head-mounted display device display mode” may mean that the “head-mounted display” is turned on.
- the terminal device will turn on the sleep state after the set time, and the user needs to view the display content being displayed on the terminal device through the head mounted display device.
- the set duration can be determined according to actual needs, for example: 10s.
- the terminal is in a sleep state, which may be that the display interface of the terminal device is in a lock screen state or the display brightness of the display interface is dark or the display interface of the terminal device is in a black screen state.
- the blind operation mode is used to identify that the terminal device can identify an action operation instruction initiated by the user when the visual operation interface of the terminal device cannot be perceived.
- the enabling of the blind operation mode may be a condition for triggering a preset correspondence between the action operation instruction and the control content. That is to say, once the terminal device turns on the blind operation mode, the subsequently monitored action operation instruction needs to determine the control content corresponding to the monitored action operation instruction by the preset correspondence between the effective action operation instruction and the control content.
- the action operation instruction that the terminal device listens in the blind operation mode can accurately use the preset correspondence between the action action instruction and the control content.
- the action operation instruction is identified to improve the control accuracy of the terminal device.
- the terminal device when detecting that a communication connection is established between the terminal device and the head mounted display device, the terminal device is instructed to generate a blind operation interface.
- the blind operation interface is configured to monitor an action operation instruction initiated by the user through the terminal device.
- the working state of the blind operation interface is configured to be in a sleep state.
- the blind operation interface can be put into a sleep state at this time to save system resources.
- the blind operation interface can be activated in the setting mode, so that the terminal device can recognize the subsequent operation command.
- how to activate the blind operation interface it can be implemented in the following manner. Specifically, when the working state of the blind operation interface is a sleep state, the monitoring user performs an action operation instruction initiated by the terminal device, and performs the monitored operation instruction command and the activated instruction of the set blind operation interface. In comparison, when the comparison result is that the action operation command that is monitored matches the activation command of the set blind operation interface, the working state of the blind operation interface is configured to be an active state.
- the activated instruction of the set blind operation interface may be a set action instruction, for example, the handheld terminal device considers the action of continuously triggering the position of the lower right corner of the terminal device as an activation command, and the duration may be based on Need to determine, generally longer than the click operation, not specifically defined here.
- the blind operation interface includes a blind operation interface.
- the blind operation interface includes an icon indicating the preset correspondence.
- generating a blind operation interface means that a blind operation interface is generated, and the floating display interface is displayed in a manner of being displayed on the display window currently displayed by the terminal device.
- the blind operation interface is displayed on the display window currently displayed by the terminal device.
- Synchronizing pushing the blind operation interface to the head mounted display device to cause the head mounted display device to display the blind operation interface.
- the action operation command initiated by the user through the terminal device has not been monitored, and the blind operation interface is hidden at this time, that is, the working state of the blind operation interface is configured to be in a sleep state.
- the blind operation interface is first activated.
- the manner of activating the blind operation interface may be implemented by activating the blind operation interface, or may be implemented by other methods, which is not limited herein.
- the display window currently displayed on the terminal device is displayed in a floating manner. The way above the mouth, the blind operation interface is displayed.
- the blind operation interface may be transparent, and the multimedia information in the pause state may be viewed through the blind operation interface.
- the blind operation interface described in the embodiment of the present application may also be referred to as a “mask”.
- FIG. 2 it is a schematic structural diagram of a blind operation interface.
- the blind operation interface is suspended above the display window currently displayed by the terminal device, and the preset operation between the double-click operation command and the playback state of the control multimedia information can be seen in the blind operation interface.
- the icon of the relationship that is, each time the double-click is performed, the playback state of the multimedia information is controlled to be converted once, for example, from playback to pause, or from pause to play;
- the sliding operation instruction and the icon corresponding to the preset relationship between the first sliding operation direction and the playback volume level of the control multimedia information may refer to the vertical direction along the current display content, then along the The vertical direction of the currently displayed content, the sliding operation instruction is to slide up along the vertical direction of the current display content, and the playback volume corresponding to controlling the multimedia information is increased, and the sliding operation instruction is to slide down along the vertical direction of the current display content, and the corresponding control The playback volume of the multimedia information is reduced;
- An icon of the sliding operation instruction and the preset correspondence relationship between the second sliding operation direction and the playback progress of controlling the multimedia information may refer to the horizontal direction along the current display content, then along The horizontal direction of the currently displayed content, the sliding operation instruction is to slide to the left along the horizontal direction of the current display content, and the playback progress of the corresponding multimedia information is backed off, and the sliding operation instruction is to slide to the right along the horizontal direction of the current display content, and the corresponding control The progress of the playback of multimedia information is advanced.
- Step 102 Monitor an action operation instruction initiated by the user through the terminal device.
- step 102 the manner of monitoring the action operation command initiated by the user through the terminal device includes but is not limited to:
- the action operation instruction initiated by the user through the terminal device is monitored;
- the action operation instruction initiated by the user on the blind operation interface is monitored.
- the working state of the blind operation interface generated when the communication connection is established between the terminal device and the head mounted display device may be configured to be in a dormant state, the user is detected to be initiated by the terminal device.
- the method further includes:
- Determining an operating state of the blind operation interface where the working state includes at least one of a sleep state and an activation state;
- step 103 is performed;
- the working state of the blind operation interface is a sleep state, comparing the monitored operation operation instruction with the activated instruction of the set blind operation interface, and the comparison result is the monitored operation operation instruction and When the activated activation command of the blind operation interface is the same, the working state of the blind operation interface is configured to be an active state.
- the action operation instruction initiated by the user through the terminal device is monitored again at the blind operation interface.
- Step 103 Determine, according to a preset correspondence between the action operation instruction and the control content, the control content corresponding to the monitored action operation instruction.
- the preset correspondence is effective when a communication connection is established between the terminal device and the head mounted display device.
- step 103 the preset correspondence between the action operation instruction and the control content includes at least one of the following:
- the preset correspondence between the action operation instruction and the control content may be set according to the user's operation habits, and may also be determined according to actual needs, and is not limited herein.
- the determined control content is to change the playing state of the multimedia information, for example, the playing state of the current multimedia information is playing, then
- the double-click operation is monitored, it is determined that the control content is to adjust the multimedia information currently in the playing state to the suspended state; when the playing state of the current multimedia information is paused, when the double-clicking operation is monitored, it is determined that the control content is currently in the suspended state.
- the multimedia information is adjusted to the playback state.
- the action operation command that is monitored is a slide operation. At this time, it is necessary to determine the direction of the slide operation and the duration of the slide operation, and then according to the preset correspondence, the control content corresponding to the slide operation can be determined.
- the direction of the sliding operation is the first sliding operation direction
- the determined control content is to adjust the playing volume of the multimedia information and adjust the volume of the volume
- the direction of the sliding operation is the second sliding operation direction, and then the determined control content is to adjust the playing progress of the multimedia information and the adjustment progress.
- the control content corresponding to the same action operation instruction may be Differently, the preset correspondence relationship between the action operation instruction and the control content may be respectively established based on different types of display windows, so that the monitored corresponding position is determined according to a preset correspondence relationship between the action operation instruction and the control content.
- the method further includes:
- a preset correspondence relationship between the action operation instruction and the control content matching the determined type of the display window is selected.
- the terminal device receives the call request sent by the network side, and the terminal device needs to open the “telephone call window” in response to the call request to make the user
- the call request can be viewed, and then the display window currently displayed by the terminal device includes a “video play window” and a “telephone call window”.
- the preset correspondence between the action operation instruction and the control content matched with the "video play window” and the preset correspondence relationship between the action operation command and the control content matched with the "telephone call window” may be expressed as shown in Table 1 below. :
- the video being displayed in the “video play window” is paused while the terminal device determines to answer the call.
- the playing state of the video being displayed in the “video playing window” is automatically Pause to switch to play.
- the terminal device when the user is watching a certain video through the head mounted display device, the terminal device receives a notification message such as a short message or a WeChat, and determines that the display window currently displayed by the terminal device is a “video play window” and "Notification message display window".
- a notification message such as a short message or a WeChat
- the preset correspondence between the action operation instruction and the control content matched with the "video play window” and the preset correspondence relationship between the action operation command and the control content matched with the "notification message display window” can be expressed as shown in Table 2 below. :
- the window display that is, the “Video Play Window” can continue to play the video, and the “Notification Message Display Window” can be displayed at the top of the play interface of the “Video Play Window”.
- the display window in the embodiment of the present application may refer to a window displayed in a display area of the terminal device (for example, a pixel area of a display panel of the terminal device), or may be a display area of the terminal device.
- the window displayed in the partial area may also be any display column displayed in the display area of the terminal device, and the form of the display window is not limited herein.
- Step 104 Control the terminal device according to the determined control content.
- step 104 the terminal device is controlled according to the control content determined in step 103.
- the determined control content is to adjust the multimedia information currently in the suspended state to the playing state, and then adjust the playing state of the multimedia information according to the control content;
- the determined control content is to adjust the volume, and then the playback volume of the multimedia information is adjusted according to the control content;
- the determined control content is to adjust the playback progress, and then the playback progress of the multimedia information is adjusted according to the control content.
- the monitoring user initiates an action operation instruction initiated by the terminal device, and determines, according to a preset correspondence relationship between the action operation instruction and the control content, the control content corresponding to the monitored action operation instruction.
- the corresponding relationship is valid when a communication connection is established between the terminal device and the head mounted display device, and the terminal device is controlled according to the determined control content.
- the user may identify the action operation command initiated by the user through the terminal device, and determine The user wants to control the control content of the terminal device, and avoids the problem that the control device has a high control error rate for controlling the terminal device according to the received control command sent by the user due to the user's inability to recognize the external environment, thereby effectively improving the terminal device.
- the accuracy of the recognition operation command is greatly improved, and the control accuracy of the terminal device is greatly improved.
- FIG. 3 is a schematic structural diagram of a control device of a terminal device according to an embodiment of the present disclosure.
- the control device includes: a monitoring unit 31, a first determining unit 32, and a control unit 33, wherein:
- the monitoring unit 31 is configured to monitor an action operation instruction initiated by the user through the terminal device;
- the first determining unit 32 is configured to determine, according to the preset correspondence between the action operation instruction and the control content, the control content corresponding to the monitored action operation instruction; wherein the preset correspondence is at the terminal Effective when a communication connection is established between the device and the head mounted display device;
- the control unit 33 is configured to control the terminal device according to the determined control content.
- control device further includes: a mode switching unit 34, where:
- the mode switching unit 34 is configured to: when detecting, by the user, an action operation instruction initiated by the terminal device, when detecting that a communication connection is established between the terminal device and the head mounted display device, The operation mode is switched to the blind operation mode to make the correspondence take effect.
- control device further includes: an indication unit 35, where:
- the indicating unit 35 is configured to instruct the terminal device to generate blindness when detecting that a communication connection is established between the terminal device and the head mounted display device before monitoring an action operation instruction initiated by the terminal device by the terminal device An operation interface, wherein the blind operation interface is configured to monitor an action operation instruction initiated by a user through the terminal device.
- control device further includes: a configuration unit 36, where:
- the configuration unit 36 is configured to configure the working state of the blind operation interface to a sleep state if the action operation command initiated by the user through the terminal device has not been monitored within a set time after the blind operation interface is generated.
- control device further includes: a second determining unit 37, where:
- a second determining unit 37 configured to determine an operating state of the blind operation interface when the user invokes an action operation instruction initiated by the terminal device, where the working state includes at least one of a sleep state and an active state.
- the first determining unit 32 If it is determined that the working state of the blind operation interface is an active state, triggering the first determining unit 32 to perform an operation of determining a control content corresponding to the monitored motion operation instruction;
- the trigger configuration unit 36 performs the following operations:
- the working state of the blind operation interface is configured to be active.
- the blind operation interface includes a blind operation interface, where the blind operation interface includes an icon indicating the preset correspondence.
- control device further includes: a display unit 38, where:
- the display unit 38 is configured to display the blind operation interface in a manner that the floating display is displayed on the display window currently displayed by the terminal device;
- the preset correspondence between the action operation instruction and the control content includes at least one of the following:
- control device further includes: a third determining unit 39 and a selecting unit 40, where:
- a third determining unit 39 configured to determine, before determining the monitored content corresponding to the action operation instruction, according to the preset correspondence between the action operation instruction and the control content, determining a display window currently displayed by the terminal device Types of;
- the selecting unit 40 is configured to select a preset correspondence relationship between the action operation instruction and the control content that match the determined type of the display window;
- the first determining unit 32 is specifically configured to determine, according to the preset correspondence relationship selected by the selecting unit, the control content corresponding to the intercepted action operation instruction.
- control device in the embodiment of the present disclosure may be implemented by using a software, or may be implemented by using a hardware, which is not limited herein.
- the embodiment of the present application further provides a control device for a terminal device, including: a memory, a processor, wherein the memory is configured to store one or more instructions, wherein the one or more instructions are used for the The processor calls execution;
- the processor is configured to: monitor an action operation instruction initiated by the user through the terminal device;
- the processor is further configured to: before detecting an action operation instruction initiated by the terminal device by the terminal device, when detecting that a communication connection is established between the terminal device and the head mounted display device, The operation mode of the terminal device is switched to a blind operation mode, so that the preset correspondence is valid.
- the processor is further configured to: when detecting a motion operation instruction initiated by the terminal device by the terminal device, when detecting that a communication connection is established between the terminal device and the head mounted display device, The terminal device generates a blind operation interface, where the blind operation interface is used to monitor an action operation instruction initiated by the user through the terminal device.
- the processor is further configured to: if the action operation instruction initiated by the user through the terminal device has not been monitored within a set time after the blind operation interface is generated, the working state of the blind operation interface is Configured to sleep.
- the processor is further configured to determine an operating state of the blind operation interface when monitoring an action operation instruction initiated by the user by the terminal device, where the working state includes a sleep state and an activation state. If it is determined that the working state of the blind operation interface is an active state, triggering an operation of determining a control content corresponding to the monitored action operation instruction; and determining that the working state of the blind operation interface is In the sleep state, the action operation instruction that is monitored is compared with the activation command of the set blind operation interface, and when the comparison result is that the action operation instruction that is monitored is consistent with the activation command of the set blind operation interface And configuring the working state of the blind operation interface to an active state.
- the blind operation interface includes a blind operation interface, wherein the blind operation interface includes an icon indicating the preset correspondence relationship.
- the processor is further configured to display the blind operation interface in a manner that the floating display is displayed on the display window currently displayed by the terminal device; and push the blind operation interface to the headset
- the display device is such that the head mounted display device displays the blind operation interface.
- the preset correspondence between the action operation instruction and the control content includes at least one of the following:
- the processor is further configured to determine that the terminal device is currently displayed before determining the monitored control content corresponding to the action operation instruction according to the preset correspondence between the action operation instruction and the control content.
- the control content corresponding to the action operation instruction includes: determining, according to the selected preset correspondence, the control content corresponding to the monitored action operation instruction.
- FIG. 4 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
- the terminal device comprises the control device described in FIG.
- embodiments of the present application can be provided as a method, apparatus (device), or computer program product.
- the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware.
- the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
- These computer program instructions can also be stored in a bootable computer or other programmable data processing device.
- a computer readable memory that operates in a particular manner, causing instructions stored in the computer readable memory to produce an article of manufacture comprising an instruction device implemented in one or more flows and/or block diagrams of the flowchart The function specified in the box or in multiple boxes.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
- the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed.
- the foregoing steps include the steps of the foregoing method embodiments; and the foregoing storage medium includes: a medium that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请公开了一种终端设备的控制方法、控制设备以及终端设备，包括：监听用户通过终端设备发起的动作操作指令，根据动作操作指令与控制内容之间的预设对应关系，确定监听到的动作操作指令对应的控制内容，对应关系是在终端设备与头戴式显示设备之间建立通信连接时生效的，根据确定的控制内容对终端设备进行控制。当用户使用头戴式显示设备观看终端设备中正在播放的多媒体信息时，在无法感知终端设备的可视化操作界面时，利用动作操作指令与控制内容之间的预设对应关系，对用户通过终端设备发起的动作操作指令进行识别，有效地提升终端设备识别动作操作指令的精度，大大改善对终端设备的控制准确度。
Description
交叉引用
本申请引用于2015年04月10日递交的名称为“一种终端设备的控制方法、控制设备以及终端设备”的第201510170364.9号中国专利申请，其通过引用被全部并入本申请。
本申请涉及通信技术领域，尤其涉及一种终端设备的控制方法、控制设备以及终端设备。
随着科学技术的发展，出现了一种头戴式显示设备。这种头戴式显示设备可以通过通信接口与终端设备建立连接，进而实现通过头戴式显示设备将该终端设备中正在播出的多媒体信息(例如：视频信息、音频信息以及图像信息等)进行显示的目的。
其中，该头戴式显示设备分别包括：用于左眼观看的左显示屏和用于右眼观看的右显示屏，每一个显示屏中包括主板、超微显示屏和透镜。当用户佩戴该头戴式显示设备，且该头戴式显示设备与终端设备连接时，可以通过该头戴式显示设备的左右显示屏获取该终端设备中正在播出的多媒体信息，这种情形相当于用户佩戴了一副多功能眼镜。
但是，在用户佩戴该头戴式显示设备的场景中，用户无法识别外界环境，此时用户对终端设备的控制相对比较盲然，导致终端设备根据接收到的用户发送的控制指令对终端设备进行控制的控制错误率比较高的问题。
发明内容
有鉴于此，本申请实施例提供了一种终端设备的控制方法、控制设备以及终端设备，用于解决目前存在的由于用户无法识别外界环境而导致终端设备根据接收到的用户发送的控制指令对终端设备进行控制的控制错误率比较
高的问题。
根据本申请的一个方面，提供了一种终端设备的控制方法，包括：监听用户通过所述终端设备发起的动作操作指令；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；根据确定的所述控制内容对所述终端设备进行控制。
根据本申请的一个方面，提供了一种终端设备的控制设备，包括：监听单元，用于监听用户通过所述终端设备发起的动作操作指令；第一确定单元，用于根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；控制单元，用于根据确定的所述控制内容对所述终端设备进行控制。
根据本申请的一个方面，提供了一种终端设备的控制设备，包括：内存、处理器，其中，所述内存，用于存储一条或多条指令，其中，所述一条或多条指令以供所述处理器调用执行；
所述处理器被配置为：监听用户通过所述终端设备发起的动作操作指令；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；根据确定的所述控制内容对所述终端设备进行控制。
根据本申请的一个方面，提供了一种终端设备，包含上述的控制设备。
本申请有益效果如下：
本申请实施例监听用户通过所述终端设备发起的动作操作指令，根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容，所述对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的，根据确定的所述控制内容对所述终端设备进行控制。这样，当用户使用头戴式显示设备观看终端设备中正在播放的多媒体信息时，可以在无法感知终端设备的可视化操作界面时，对用户通过所述终端设备发起的动作操作指令进行识别，确定出用户希望控制终端设备的控制内容，避
免了由于用户无法识别外界环境而导致终端设备根据接收到的用户发送的控制指令对终端设备进行控制的控制错误率比较高的问题，有效地提升了终端设备识别动作操作指令的精度，大大改善了对终端设备的控制准确度。
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简要介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域的普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的一种终端设备的控制方法的流程示意图；
图2为盲操作界面的结构示意图；
图3为本申请实施例提供的一种终端设备的控制设备的结构示意图；
图4为本申请实施例提供了一种终端设备的结构示意图。
为了实现本申请的目的，本申请实施例中提供了一种终端设备的控制方法、控制设备和终端设备，当用户使用头戴式显示设备观看终端设备中正在播放的多媒体信息时，可以在无法感知终端设备的可视化操作界面时，根据动作操作指令与控制内容之间的预设对应关系，对用户通过所述终端设备发起的动作操作指令进行识别，确定出用户希望控制终端设备的控制内容，避免了由于用户无法识别外界环境而导致终端设备根据接收到的用户发送的控制指令对终端设备进行控制的控制错误率比较高的问题，有效地提升了终端设备识别动作操作指令的精度，大大改善了对终端设备的控制准确度。
需要说明的是，本申请实施例中所述的终端设备的控制方法执行前提是该终端设备与头戴式显示设备之间建立通信连接，具体地，该终端设备与头戴式显示设备之间可以通过移动终端高清影音标准接口(英文：Mobile High-Definition Link；缩写：MHL)建立通信连接，也可以通过高清晰度多媒体接口(英文：High Definition Multimedia Interface；缩写：HDMI)建立通信连接，这样通过MHL或者HDMI该终端设备可以将正在播出的多媒体
信息传输至头戴式显示设备中显示。
需要说明的是，本申请实施例中所述的头戴式显示设备可以被称为眼镜式显示器，还可以是具备显示功能的头盔，这里对于头戴式显示设备的具体表现形式不做具体限定。
具体地，头戴式显示设备的工作原理为：在接收到终端设备上正在播出的多媒体信息时，将接收到的多媒体信息推送至超微显示屏上显示；通过光学系统(例如：透镜)将超微显示屏上显示的多媒体信息执行放大操作，并将放大后的多媒体信息投射在用户的视网膜上，这样用户通过该头戴式显示设备的左右显示屏即可获取该终端设备中正在播出的多媒体信息。
下面结合说明书附图对本申请各个实施例作进一步地详细描述。显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其它实施例，都属于本申请保护的范围。
图1为本申请实施例提供的一种终端设备的控制方法的流程示意图。所述方法可以如下所述。
步骤101：检测终端设备与头戴式显示设备之间是否建立通信连接，若建立通信连接，则执行步骤102；否则，按照现有技术方案对终端设备进行控制。
在步骤101中，检测终端设备的外部通信接口是否通过MHL或者HDMI与头戴式显示设备建立通信连接。
若检测到终端设备的外部通信接口通过MHL或者HDMI与头戴式显示设备建立通信连接，那么终端设备将正在显示的显示窗口以及显示窗口中的显示内容传输至头戴式显示设备中显示。
可选的，在检测到终端设备的外部通信接口通过MHL或者HDMI与头戴式显示设备建立通信连接时，推送选择消息，该选择消息用于提醒用户是否开启“头戴式显示设备显示方式”。
需要说明的是，该选择消息可显示于终端设备的显示屏幕上部，以便用户直接选择。
这里的“头戴式显示设备显示方式”可以是指在确定开启“头戴式显示
设备显示方式”时，终端设备将在设定时长后开启休眠状态，用户需要通过头戴式显示设备查看终端设备上正在显示的显示内容。
设定时长可以根据实际需要确定，例如：10s等。
这里终端开启休眠状态可以是指终端设备的显示界面处于锁屏状态或者显示界面的显示亮度变暗或者终端设备的显示界面处于黑屏状态。
可选的，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，将所述终端设备的操作模式切换为盲操作模式。
其中，所述盲操作模式用于表征所述终端设备能够对用户在无法感知所述终端设备的可视化操作界面时发起的动作操作指令进行识别。
具体地，所述盲操作模式的启用可以作为触发动作操作指令与控制内容之间的预设对应关系生效的条件。也就是说，一旦终端设备开启盲操作模式，后续监听到的动作操作指令需要通过生效的动作操作指令与控制内容之间的预设对应关系来确定监听到的动作操作指令对应的控制内容。
由于预先限定了动作操作指令与控制内容之间的对应关系，那么终端设备在盲操作模式下监听到的动作操作指令，可以利用生效的动作操作指令与控制内容之间的预设对应关系精确地对动作操作指令进行识别，改善对终端设备的控制准确度。
可选的，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，指示所述终端设备生成盲操作接口。
其中，所述盲操作接口用于监听用户通过所述终端设备发起的动作操作指令。
可选的，若在生成盲操作接口之后的设定时间内，尚未监听到用户通过所述终端设备发起的动作操作指令，则将所述盲操作接口的工作状态配置为休眠状态。
需要说明的是，这里的设定时间可以根据实际需要确定，例如：10s，具体如何设定不做限定。
这样，若所述终端设备与所述头戴式显示设备之间建立通信连接后，用户通过所述头戴式显示设备观看终端设备正在播出的多媒体信息，若没有需
要对终端设备正在播出的多媒体信息进行调整时，此时可以使盲操作接口处于休眠状态，以节省系统资源。
若需要对终端设备正在播出的多媒体信息进行调整时，此时可以通过设定方式激活盲操作接口，以便于终端设备对后续监听到的动作操作指令进行识别。
至于如何激活盲操作接口可以采用以下方式实现。具体地，在所述盲操作接口的工作状态为休眠状态时，监听用户通过所述终端设备发起的动作操作指令，将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接口的工作状态配置为激活状态。
需要说明的是，设定的盲操作接口的激活指令可以是设定的动作指令，例如：手持终端设备，将持续触发终端设备的右下角位置的动作视为激活指令，持续时间的长短可以根据需要确定，一般比单击操作的时间长，这里不做具体限定。
可选的，所述盲操作接口包含盲操作界面。其中，所述盲操作界面中包含表示所述预设对应关系的图标。
需要说明的是，假设盲操作接口的表现形式为盲操作界面，那么生成盲操作接口意味着产生盲操作界面，此时将按照悬浮显示于所述终端设备当前显示的显示窗口之上的方式，在终端设备当前显示的显示窗口之上显示该盲操作界面。
同步，将所述盲操作界面推送给所述头戴式显示设备，以使得所述头戴式显示设备显示所述盲操作界面。
那么在盲操作界面显示设定时长内，尚未监听到用户通过所述终端设备发起的动作操作指令，此时将盲操作界面隐藏，即使得盲操作界面的工作状态配置为休眠状态。
当需要对终端设备进行盲控制时，首先激活盲操作界面，对于如何激活盲操作界面的方式可以采用激活盲操作接口的方式实现，也可以采用其他方式实现，这里不做限定。
一旦激活盲操作界面，按照悬浮显示于所述终端设备当前显示的显示窗
口之上的方式，显示所述盲操作界面。
这里需要说明的是，在盲操作界面产生/激活时，将正在播放的多媒体信息切换至暂停状态。
盲操作界面可以是透明的，通过盲操作界面可以观看到处于暂停状态的多媒体信息，本申请实施例中所述的盲操作界面还可以被称为“蒙版”。
如图2所示，为盲操作界面的结构示意图。
从图2中可以看出，盲操作界面悬浮于所述终端设备当前显示的显示窗口之上，在该盲操作界面中可以看到双击操作指令与控制多媒体信息的播放状态之间的预设对应关系的图标，即每双击一次，控制多媒体信息的播放状态转换一次，例如，由播放转换成为暂停，或者由暂停转换为播放；
滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系的图标，例如：这里的第一滑动操作方向可以是指沿着当前显示内容的垂直方向，那么沿着当前显示内容的垂直方向，滑动操作指令为沿着当前显示内容的垂直方向向上滑动，对应控制多媒体信息的播放音量增加，滑动操作指令为沿着当前显示内容的垂直方向向下滑动，对应控制多媒体信息的播放音量减小；
滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度之间的预设对应关系的图标，例如：这里的第二滑动操作方向可以是指沿着当前显示内容的水平方向，那么沿着当前显示内容的水平方向，滑动操作指令为沿着当前显示内容的水平方向向左滑动，对应控制多媒体信息的播放进度后退，滑动操作指令为沿着当前显示内容的水平方向向右滑动，对应控制多媒体信息的播放进度前进。
步骤102：监听用户通过所述终端设备发起的动作操作指令。
在步骤102中，监听用户通过所述终端设备发起的动作操作指令的方式包括但不限于：
通过在盲操作接口处监听用户通过所述终端设备发起的动作操作指令；
在确定终端设备当前处于盲操作模式时，监听用户通过所述终端设备发起的动作操作指令；
监听用户在盲操作界面上发起的动作操作指令。
可选的，由于在所述终端设备与所述头戴式显示设备之间建立通信连接时生成的盲操作接口的工作状态可能被配置为休眠状态，那么在监听到用户通过所述终端设备发起的动作操作指令时，所述方法还包括：
确定所述盲操作接口的工作状态，其中，所述工作状态包含休眠状态、激活状态中的至少一种；
若确定所述盲操作接口的工作状态为激活状态时，触发执行步骤103；
若确定所述盲操作接口的工作状态为休眠状态时，将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接口的工作状态配置为激活状态。
在盲操作接口的工作状态调整为激活状态时，再次在盲操作接口处监听用户通过所述终端设备发起的动作操作指令。
步骤103：根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的。
在步骤103中，动作操作指令与控制内容之间的预设对应关系包含以下的至少一种：
双击操作指令与控制多媒体信息的播放状态之间的预设对应关系；
滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系；
滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度之间的预设对应关系。
需要说明的是，动作操作指令与控制内容之间的预设对应关系可以根据用户的操作习惯设定，还可以根据实际需要确定，这里不做限定。
例如：监听到的动作操作指令为双击操作，那么确定的控制内容为改变多媒体信息的播放状态，例如：当前多媒体信息的播放状态为播放，那么在
监听到双击操作时，确定控制内容为将当前处于播放状态的多媒体信息调整为暂停状态；当前多媒体信息的播放状态为暂停，那么在监听到双击操作时，确定控制内容为将当前处于暂停状态的多媒体信息调整为播放状态。
监听到的动作操作指令为滑动操作，此时需要确定滑动操作的方向以及滑动操作持续的时长，那么根据预设对应关系，即可确定该滑动操作对应的控制内容。
例如：滑动操作的方向为第一滑动操作方向，那么确定的控制内容为调整多媒体信息的播放音量以及调整音量的大小；
滑动操作的方向为第二滑动操作方向，那么确定的控制内容为调整多媒体信息的播放进度以及调整进度的多少。
可选的，由于终端设备包含多个不同类型的显示窗口，例如：播放多媒体信息的显示窗口；发起呼叫的显示窗口等，那么对于不同类型的显示窗口，相同的动作操作指令对应的控制内容可能不同，那么可以基于不同类型的显示窗口，分别建立动作操作指令与控制内容之间的预设对应关系，这样在根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容之前，所述方法还包括：
确定所述终端设备当前显示的显示窗口的类型；
选择与确定的所述显示窗口的类型匹配的动作操作指令与控制内容之间的预设对应关系。
根据选择的所述预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
具体的，假设当用户通过头戴式显示设备正在观看某一视频时，终端设备接收到网络侧发送的呼叫请求，此时终端设备响应该呼叫请求时需要打开“电话呼入窗口”以使得用户能够查看到该呼叫请求，那么此时终端设备当前显示的显示窗口包含“视频播放窗口”和“电话呼入窗口”。由于与“视频播放窗口”匹配的动作操作指令与控制内容之间的预设对应关系以及与“电话呼入窗口”匹配的动作操作指令与控制内容之间的预设对应关系可如下表1表示：
表1
从表1中可以看出，当监听到用户通过终端设备发起针对第三滑动操作方向的滑动操作指令时，可以确定该用户控制接听呼叫的电话。
可选的，为了不影响用户观看当前播放的视频，在终端设备确定接听该呼叫的电话的同时暂停播放“视频播放窗口”中正在显示的视频。
当监听到用户通过终端设备发起针对第四滑动操作方向的滑动操作指令时，可以确定该用户控制挂断呼叫的电话，此时，自动将“视频播放窗口”中正在显示的视频的播放状态由暂停切换为播放。
在另一个实施例中，当用户通过头戴式显示设备正在观看某一视频时，终端设备接收到短信或微信等通知消息，此时确定终端设备当前显示的显示窗口为“视频播放窗口”和“通知消息显示窗口”。由于与“视频播放窗口”匹配的动作操作指令与控制内容之间的预设对应关系以及与“通知消息显示窗口”匹配的动作操作指令与控制内容之间的预设对应关系可如下表2表示：
表2
从表2中可以看出，当监听到用户通过终端设备发起单击操作指令时，可以确定该用户控制终端设备实现打开/关闭/发送消息。即用户首先通过单击操作指令控制打开消息，然后再次通过单击操作指令控制实现快捷回复内容的输入及消息的发送。
需要说明的是，为了不影响用户观看当前播放的视频，这里可以实现多
窗口显示，即“视频播放窗口”可继续播放视频，“通知消息显示窗口”可显示在“视频播放窗口”的播放界面顶部。
需要说明的是，本申请实施例中所述的显示窗口可以是指在终端设备的显示区域(例如：终端设备的显示面板的像素区域)中显示的窗口，也可以是在终端设备的显示区域中的部分区域中显示的窗口，还可以是在终端设备的显示区域中显示的任意显示栏，这里对于显示窗口的形式不做限定。
步骤104：根据确定的所述控制内容对所述终端设备进行控制。
在步骤104中，根据步骤103中确定的控制内容对所述终端设备进行控制。
例如：确定的控制内容为将当前处于暂停状态的多媒体信息调整为播放状态，那么根据该控制内容，调整多媒体信息的播放状态；
确定的控制内容为调整音量，那么根据该控制内容，调整多媒体信息的播放音量；
确定的控制内容为调整播放进度，那么根据该控制内容，调整多媒体信息的播放进度。
通过本申请实施例的方案，监听用户通过所述终端设备发起的动作操作指令，根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容，所述对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的，根据确定的所述控制内容对所述终端设备进行控制。这样，当用户使用头戴式显示设备观看终端设备中正在播放的多媒体信息时，可以在无法感知终端设备的可视化操作界面时，对用户通过所述终端设备发起的动作操作指令进行识别，确定出用户希望控制终端设备的控制内容，避免了由于用户无法识别外界环境而导致终端设备根据接收到的用户发送的控制指令对终端设备进行控制的控制错误率比较高的问题，有效地提升了终端设备识别动作操作指令的精度，大大改善了对终端设备的控制准确度。
图3为本申请实施例提供的一种终端设备的控制设备的结构示意图。所述控制设备包括：监听单元31、第一确定单元32和控制单元33，其中：
监听单元31，用于监听用户通过所述终端设备发起的动作操作指令；
第一确定单元32，用于根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；
控制单元33，用于根据确定的所述控制内容对所述终端设备进行控制。
可选的，所述控制设备还包括：模式切换单元34，其中：
模式切换单元34，用于在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，将所述终端设备的操作模式切换为盲操作模式，以使得所述对应关系生效。
可选的，所述控制设备还包括：指示单元35，其中：
指示单元35，用于在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，指示所述终端设备生成盲操作接口，其中，所述盲操作接口用于监听用户通过所述终端设备发起的动作操作指令。
可选的，所述控制设备还包括：配置单元36，其中：
配置单元36，用于若在生成盲操作接口之后的设定时间内，尚未监听到用户通过所述终端设备发起的动作操作指令，则将所述盲操作接口的工作状态配置为休眠状态。
可选的，所述控制设备还包括：第二确定单元37，其中：
第二确定单元37，用于在监听到用户通过所述终端设备发起的动作操作指令时，确定所述盲操作接口的工作状态，其中，所述工作状态包含休眠状态、激活状态中的至少一种；
若确定所述盲操作接口的工作状态为激活状态时，触发所述第一确定单元32执行确定监听到的所述动作操作指令对应的控制内容的操作；
若确定所述盲操作接口的工作状态为休眠状态时，触发配置单元36执行以下操作：
将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接口的工作状态配置为激活状态。
可选的，所述盲操作接口包含盲操作界面，其中，所述盲操作界面中包含表示所述预设对应关系的图标。
可选的，所述控制设备还包括：显示单元38，其中：
显示单元38，用于按照悬浮显示于所述终端设备当前显示的显示窗口之上的方式，显示所述盲操作界面；并
将所述盲操作界面推送给所述头戴式显示设备，以使得所述头戴式显示设备显示所述盲操作界面。
可选的，动作操作指令与控制内容之间的预设对应关系包含以下的至少一种：
双击操作指令与控制多媒体信息的播放状态之间的预设对应关系；
滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系；
滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度快慢之间的预设对应关系。
可选的，所述控制设备还包括：第三确定单元39和选择单元40，其中：
第三确定单元39，用于在根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容之前，确定所述终端设备当前显示的显示窗口的类型；
选择单元40，用于选择与确定的所述显示窗口的类型匹配的动作操作指令与控制内容之间的预设对应关系；
所述第一确定单元32，具体用于根据所述选择单元选择的所述预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
需要说明的是，本申请实施例中所述的控制设备可以通过软件方式实现，也可以通过硬件方式实现，这里不做限定。
本申请实施例还提供了一种终端设备的控制设备，包括：内存、处理器，其中，所述内存，用于存储一条或多条指令，其中，所述一条或多条指令以供所述处理器调用执行；
所述处理器被配置为：监听用户通过所述终端设备发起的动作操作指令；
根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；根据确定的所述控制内容对所述终端设备进行控制。
进一步地，所述处理器进一步被配置为：在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，将所述终端设备的操作模式切换为盲操作模式，以使得所述预设对应关系生效。
进一步地，所述处理器进一步被配置为：在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，指示所述终端设备生成盲操作接口，其中，所述盲操作接口用于监听用户通过所述终端设备发起的动作操作指令。
进一步地，所述处理器进一步被配置为：若在生成盲操作接口之后的设定时间内，尚未监听到用户通过所述终端设备发起的动作操作指令，则将所述盲操作接口的工作状态配置为休眠状态。
进一步地，所述处理器进一步被配置为：在监听到用户通过所述终端设备发起的动作操作指令时，确定所述盲操作接口的工作状态，其中，所述工作状态包含休眠状态、激活状态中的至少一种；若确定所述盲操作接口的工作状态为激活状态时，触发执行确定监听到的所述动作操作指令对应的控制内容的操作；若确定所述盲操作接口的工作状态为休眠状态时，将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接口的工作状态配置为激活状态。
进一步地，所述盲操作接口包含盲操作界面，其中，所述盲操作界面中包含表示所述预设对应关系的图标。
进一步地，所述处理器进一步被配置为：按照悬浮显示于所述终端设备当前显示的显示窗口之上的方式，显示所述盲操作界面；并将所述盲操作界面推送给所述头戴式显示设备，以使得所述头戴式显示设备显示所述盲操作界面。
进一步地，动作操作指令与控制内容之间的预设对应关系包含以下的至少一种：
双击操作指令与控制多媒体信息的播放状态之间的预设对应关系；
滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系；
滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度之间的预设对应关系。
进一步地，所述处理器进一步被配置为：在根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容之前，确定所述终端设备当前显示的显示窗口的类型；选择与确定的所述显示窗口的类型匹配的动作操作指令与控制内容之间的预设对应关系；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容，包括：根据选择的所述预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
图4为本申请实施例提供了一种终端设备的结构示意图。所述终端设备包含了图3中所述的控制设备。
本领域的技术人员应明白，本申请的实施例可提供为方法、装置(设备)、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请是参照根据本申请实施例的方法、装置(设备)和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设
备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请的优选实施例，但本领域内的技术人员一旦得知了基本创造性概念，则可对这些实施例作出另外的变更和修改。所以，所附权利要求意欲解释为包括优选实施例以及落入本申请范围的所有变更和修改。
显然，本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样，倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内，则本申请也意图包含这些改动和变型在内。
本领域普通技术人员可以理解：实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成，前述的程序可以存储于一计算机可读取存储介质中，该程序在执行时，执行包括上述方法实施例的步骤；而前述的存储介质包括：ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是：以上各实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述各实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
Claims (20)
- 一种终端设备的控制方法，其特征在于，包括：监听用户通过所述终端设备发起的动作操作指令；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；根据确定的所述控制内容对所述终端设备进行控制。
- 如权利要求1所述的控制方法，其特征在于，在监听用户通过所述终端设备发起的动作操作指令之前，所述方法还包括：在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，将所述终端设备的操作模式切换为盲操作模式，以使得所述预设对应关系生效。
- 如权利要求1或2所述的控制方法，其特征在于，在监听用户通过所述终端设备发起的动作操作指令之前，所述方法还包括：在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，指示所述终端设备生成盲操作接口，其中，所述盲操作接口用于监听用户通过所述终端设备发起的动作操作指令。
- 如权利要求3所述的控制方法，其特征在于，所述方法还包括：若在生成盲操作接口之后的设定时间内，尚未监听到用户通过所述终端设备发起的动作操作指令，则将所述盲操作接口的工作状态配置为休眠状态。
- 如权利要求3或4所述的控制方法，其特征在于，在监听到用户通过所述终端设备发起的动作操作指令时，所述方法还包括：确定所述盲操作接口的工作状态，其中，所述工作状态包含休眠状态、激活状态中的至少一种；若确定所述盲操作接口的工作状态为激活状态时，触发执行确定监听到的所述动作操作指令对应的控制内容的操作；若确定所述盲操作接口的工作状态为休眠状态时，将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接 口的工作状态配置为激活状态。
- 如权利要求3所述的控制方法，其特征在于，所述盲操作接口包含盲操作界面，其中，所述盲操作界面中包含表示所述预设对应关系的图标。
- 如权利要求6所述的控制方法，其特征在于，所述方法还包括：按照悬浮显示于所述终端设备当前显示的显示窗口之上的方式，显示所述盲操作界面；并将所述盲操作界面推送给所述头戴式显示设备，以使得所述头戴式显示设备显示所述盲操作界面。
- 如权利要求1所述的控制方法，其特征在于，动作操作指令与控制内容之间的预设对应关系包含以下的至少一种：双击操作指令与控制多媒体信息的播放状态之间的预设对应关系；滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系；滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度之间的预设对应关系。
- 如权利要求1所述的控制方法，其特征在于，在根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容之前，所述方法还包括：确定所述终端设备当前显示的显示窗口的类型；选择与确定的所述显示窗口的类型匹配的动作操作指令与控制内容之间的预设对应关系；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容，包括：根据选择的所述预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
- 一种终端设备的控制设备，其特征在于，包括：监听单元，用于监听用户通过所述终端设备发起的动作操作指令；第一确定单元，用于根据动作操作指令与控制内容之间的预设对应关系， 确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；控制单元，用于根据确定的所述控制内容对所述终端设备进行控制。
- 如权利要求10所述的控制设备，其特征在于，所述控制设备还包括：模式切换单元，用于在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，将所述终端设备的操作模式切换为盲操作模式，以使得所述预定对应关系生效。
- 如权利要求10或11所述的控制设备，其特征在于，所述控制设备还包括：指示单元，用于在监听用户通过所述终端设备发起的动作操作指令之前，在检测到所述终端设备与所述头戴式显示设备之间建立通信连接时，指示所述终端设备生成盲操作接口，其中，所述盲操作接口用于监听用户通过所述终端设备发起的动作操作指令。
- 如权利要求12所述的控制设备，其特征在于，所述控制设备还包括：配置单元，用于若在生成盲操作接口之后的设定时间内，尚未监听到用户通过所述终端设备发起的动作操作指令，则将所述盲操作接口的工作状态配置为休眠状态。
- 如权利要求12或13所述的控制设备，其特征在于，所述控制设备还包括：第二确定单元，用于在监听到用户通过所述终端设备发起的动作操作指令时，确定所述盲操作接口的工作状态，其中，所述工作状态包含休眠状态、激活状态中的至少一种；若确定所述盲操作接口的工作状态为激活状态时，触发所述第一确定单元执行确定监听到的所述动作操作指令对应的控制内容的操作；若确定所述盲操作接口的工作状态为休眠状态时，触发配置单元执行以下操作：将监听到的所述动作操作指令与设定的盲操作接口的激活指令进行比 较，在比较结果是监听到的所述动作操作指令与设定的盲操作接口的激活指令一致时，将所述盲操作接口的工作状态配置为激活状态。
- 如权利要求12所述的控制设备，其特征在于，所述盲操作接口包含盲操作界面，其中，所述盲操作界面中包含表示所述预设对应关系的图标。
- 如权利要求15所述的控制设备，其特征在于，所述控制设备还包括：显示单元，用于按照悬浮显示于所述终端设备当前显示的显示窗口之上的方式，显示所述盲操作界面；并将所述盲操作界面推送给所述头戴式显示设备，以使得所述头戴式显示设备显示所述盲操作界面。
- 如权利要求10所述的控制设备，其特征在于，动作操作指令与控制内容之间的预设对应关系包含以下的至少一种：双击操作指令与控制多媒体信息的播放状态之间的预设对应关系；滑动操作指令以及第一滑动操作方向与控制多媒体信息的播放音量大小之间的预设对应关系；滑动操作指令以及第二滑动操作方向与控制多媒体信息的播放进度快慢之间的预设对应关系。
- 如权利要求10所述的控制设备，其特征在于，所述控制设备还包括：第三确定单元，用于在根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容之前，确定所述终端设备当前显示的显示窗口的类型；选择单元，用于选择与确定的所述显示窗口的类型匹配的动作操作指令与控制内容之间的预设对应关系；所述第一确定单元，具体用于根据所述选择单元选择的所述预设对应关系，确定监听到的所述动作操作指令对应的控制内容。
- 一种终端设备，其特征在于，包含如权利要求10至18任一项所述的控制设备。
- 一种终端设备的控制设备，其特征在于，包括：包括：内存、处理器，其中，所述内存，用于存储一条或多条指令，其中，所述一条或多条指 令以供所述处理器调用执行；所述处理器被配置为：监听用户通过所述终端设备发起的动作操作指令；根据动作操作指令与控制内容之间的预设对应关系，确定监听到的所述动作操作指令对应的控制内容；其中，所述预设对应关系是在所述终端设备与头戴式显示设备之间建立通信连接时生效的；根据确定的所述控制内容对所述终端设备进行控制。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510170364.9 | 2015-04-10 | ||
| CN201510170364.9A CN105992036A (zh) | 2015-04-10 | 2015-04-10 | 一种终端设备的控制方法、控制设备以及终端设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016161906A1 true WO2016161906A1 (zh) | 2016-10-13 |
Family
ID=57040206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/077411 WO2016161906A1 (zh) | 2015-04-10 | 2016-03-25 | 一种终端设备的控制方法、控制设备以及终端设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105992036A (zh) |
| WO (1) | WO2016161906A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107231489B (zh) * | 2017-07-06 | 2020-08-21 | 钛马信息网络技术有限公司 | 一种终端及其投屏方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120302289A1 (en) * | 2011-05-27 | 2012-11-29 | Kang Heejoon | Mobile terminal and method of controlling operation thereof |
| CN103324309A (zh) * | 2013-06-18 | 2013-09-25 | 杭鑫鑫 | 可穿戴计算机 |
| CN104218963A (zh) * | 2014-08-28 | 2014-12-17 | 腾讯科技（深圳）有限公司 | 执行控制操作的方法、可穿戴设备和终端 |
| CN104463152A (zh) * | 2015-01-09 | 2015-03-25 | 京东方科技集团股份有限公司 | 一种手势识别方法、系统、终端设备及穿戴式设备 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4824793B2 (ja) * | 2009-07-06 | 2011-11-30 | 東芝テック株式会社 | ウエアラブル端末装置及びプログラム |
| CN102063183A (zh) * | 2011-02-12 | 2011-05-18 | 深圳市亿思达显示科技有限公司 | 一种手套式虚拟输入装置 |
| CN103294180B (zh) * | 2012-03-01 | 2017-02-15 | 联想(北京)有限公司 | 一种人机交互控制方法及电子终端 |
-
2015
- 2015-04-10 CN CN201510170364.9A patent/CN105992036A/zh active Pending
-
2016
- 2016-03-25 WO PCT/CN2016/077411 patent/WO2016161906A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120302289A1 (en) * | 2011-05-27 | 2012-11-29 | Kang Heejoon | Mobile terminal and method of controlling operation thereof |
| CN103324309A (zh) * | 2013-06-18 | 2013-09-25 | 杭鑫鑫 | 可穿戴计算机 |
| CN104218963A (zh) * | 2014-08-28 | 2014-12-17 | 腾讯科技（深圳）有限公司 | 执行控制操作的方法、可穿戴设备和终端 |
| CN104463152A (zh) * | 2015-01-09 | 2015-03-25 | 京东方科技集团股份有限公司 | 一种手势识别方法、系统、终端设备及穿戴式设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105992036A (zh) | 2016-10-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12056341B2 (en) | Method, apparatus, and terminal for processing notification information | |
| US10545583B2 (en) | Modifying a highlighting function on a display based on content | |
| US10585637B2 (en) | Information processing method and electronic device | |
| WO2017173793A1 (zh) | 一种视频投屏方法及装置 | |
| WO2016045579A1 (zh) | 一种应用程序交互控制方法、装置及终端 | |
| WO2017032054A1 (zh) | 一种播放速度调节方法及终端 | |
| US20140361955A1 (en) | Means for dynamically regulating the time-out characteristics of a display of an electronic device | |
| WO2017113862A1 (zh) | 基于虚拟现实头盔观看视频的方法和装置 | |
| US9740283B2 (en) | Display method and electronic device | |
| WO2015161578A1 (zh) | 一种窗口管理方法及装置 | |
| TW201830219A (zh) | 即時通訊訊息的提醒方法及即時通訊用戶端 | |
| EP3103020B1 (en) | User terminal and control method thereof | |
| US9319468B2 (en) | Information processing apparatus and information processing method | |
| US20180267624A1 (en) | Systems and methods for spotlight effect manipulation | |
| WO2017054142A1 (zh) | 获取视频数据的方法、装置、系统及计算机可读存储介质 | |
| WO2015188503A1 (zh) | 一种控制终端的方法和装置 | |
| US20180181263A1 (en) | Uninterruptable overlay on a display | |
| WO2023045885A1 (zh) | 同步方法和装置 | |
| CN113918010A (zh) | 显示设备及显示设备的控制方法 | |
| EP3203465A1 (en) | Image display method, user terminal and video receiving equipment | |
| WO2018059552A1 (zh) | 屏幕显示控制方法、装置及移动终端和计算机存储介质 | |
| KR102005406B1 (ko) | 디스플레이 장치 및 그 제어 방법 | |
| US20230384868A1 (en) | Display apparatus | |
| WO2016161906A1 (zh) | 一种终端设备的控制方法、控制设备以及终端设备 | |
| CN113593488A (zh) | 背光调整方法及显示设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16776081 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16776081 Country of ref document: EP Kind code of ref document: A1 |