CN107466396A - Head-mounted display apparatus and its control method - Google Patents

Head-mounted display apparatus and its control method Download PDF

Info

Publication number
CN107466396A
CN107466396A CN201680011871.0A CN201680011871A CN107466396A CN 107466396 A CN107466396 A CN 107466396A CN 201680011871 A CN201680011871 A CN 201680011871A CN 107466396 A CN107466396 A CN 107466396A
Authority
CN
China
Prior art keywords
touch
touch area
touching signals
head
display apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680011871.0A
Other languages
Chinese (zh)
Inventor
林麒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Royole Technologies Co Ltd
Original Assignee
Shenzhen Royole Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Royole Technologies Co Ltd filed Critical Shenzhen Royole Technologies Co Ltd
Publication of CN107466396A publication Critical patent/CN107466396A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A kind of head-mounted display apparatus, including body (10), processor (30) and the display module (20) being arranged in body (10).Body (10) includes inner side (11) and outside (12) corresponding with inner side (11), and inner side (11) include providing the viewing form (111) of display module (20) light source outgoing.Head-mounted display apparatus also includes the first touch area (40) and the second touch area (50).First touch area (40) is arranged on outside (12) and corresponding with viewing form (111).Processor (30) is used for the touching signals according to caused by the first touch area (40) and performs corresponding Interface Control instruction, it is additionally operable to the touch corresponding to touching signals according to caused by the second touch area (50), and touch and the corresponding relation of control instruction on pre-defined the second touch area (50), perform the control instruction corresponding with the current touch on the second touch area (50).The equipment can improve handling and operation convenience, so as to lift the experience of user.

Description

Head-mounted display apparatus and its control method Technical field
The present invention relates to one kind to wear display equipment technical field more particularly to a kind of head-mounted display apparatus and its control method.
Background technique
Head-mounted display apparatus (HMD, Head Mounted Display) refers to the display equipment that can be worn on the head.HMD mono- is showing the multimedia messages such as graphic pictures on several centimetres of eyeball of display screen using " nearly optics of the eye system ".The type of HMD includes it can be seen that external and HMD shows the penetration HMD of content and can only see the immersion HMD that HMD shows content at present.Immersion HMD has the application of many entertainments, and after wearable device, vision auxiliary is completely lost, when to execute input and operate, it is difficult to position finger position, it is difficult to the accurate touch-control of finger is realized, to be not easy to user's controlling equipment.
Summary of the invention
The embodiment of the present invention a kind of head-mounted display apparatus and its control method are disclosed, it can be achieved that finger accurate touch-control, to improve the convenience of the handling of head-mounted display apparatus and operation.
The embodiment of the present invention discloses a kind of head-mounted display apparatus, including ontology, processor and it is set to the intrinsic display module, the ontology includes inside and outside corresponding with the inside, and the inside includes providing the viewing form of the display module light source outgoing.The head-mounted display apparatus further includes the first touch area and the second touch area.First touch area is set on the outside and corresponding with the viewing form.The processor is used for the touching signals generated according to first touch area, execute corresponding Interface Control instruction, it is also used to the corresponding touch action of touching signals generated according to second touch area, and the corresponding relationship of the touch action and control instruction on second touch area predetermined, execute control instruction corresponding with the current touch action on second touch area.
A kind of control method of head-mounted display apparatus is also disclosed in the embodiment of the present invention, the head-mounted display apparatus includes ontology, processor and is set to the intrinsic display module, the ontology includes inside and outside corresponding with the inside, and the inside includes providing the viewing view of the display module light source outgoing Window, the head-mounted display apparatus further include the first touch area and the second touch area, first touch area be set on the outside and with the viewing form, the control method includes:
When the touching signals come from first touch area, corresponding Interface Control is executed according to the touching signals and is instructed;And
When the touching signals come from second touch area, the corresponding touch action of touching signals generated according to second touch area, and the corresponding relationship of the touch action and control instruction on second touch area predetermined, execute control instruction corresponding with the current touch action on second touch area.
In embodiment provided by the invention, since the first touch area is corresponding with viewing form, it is set to the leading exterior surface of head-mounted display apparatus, so that the first touch area corresponds to the display interface that user is seen by display module, consistent correspondence on sense organ is provided, first touch area is navigated to when wearing the head-mounted display apparatus convenient for user, so that wearer is convenient to touch the first touch area to control display interface, so that the handling of head-mounted display apparatus can be improved.Furthermore head-mounted display apparatus further includes the second touch area, control instruction corresponding with the current touch action on the second touch area can be executed according to the corresponding relationship of touch action predetermined and control instruction.That is, second touch area is provided for executing the touch area of prompt operation, therefore can provide the manipulation for more meeting user operation habits further directed to the product characteristic of head-mounted display apparatus, manipulation efficiency is promoted, so as to promote the operating experience of user.Therefore, the convenience that can further improve the handling of head-mounted display apparatus and operation, to promote the experience of user.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, the drawings to be used in the embodiments are briefly described below, apparently, drawings in the following description are only some embodiments of the invention, for those of ordinary skill in the art, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is the stereoscopic schematic diagram of head-mounted display apparatus in the embodiment of the present invention;
Fig. 2 is the partial structure diagram of the head-mounted display apparatus in Fig. 1;
Fig. 3 is the functional block diagram of the head-mounted display apparatus in Fig. 1;And
Fig. 4 is the flow chart of the control method of head-mounted display apparatus in embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical scheme in the embodiment of the invention is clearly and completely described, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, every other embodiment obtained by those of ordinary skill in the art without making creative efforts, shall fall within the protection scope of the present invention.
Referring to figs. 1 to Fig. 3, the head-mounted display apparatus in first embodiment of the invention may include ontology 10, the display module being set in ontology 10 20, processor 30, the first touch area 40 and the second touch area 50.Ontology 10 includes inside 11 and outside 12 corresponding with inside 11.The viewing form 111 for being provided with the outgoing of 20 light source of display module is arranged in inside 11.Display module 20 can be the integral structure for including display and optics module (not illustrated), or independently of the single display device structure of optics module, present embodiment is not limited this.The virtual image for the amplification that the light source that wearer can watch display is formed through optics module, i.e., so that wearer watches the display interface of display indirectly.The display interface includes the content that display is shown, including but not limited to main interface, menu interface, video playing interface, audio broadcast interface, application interface, etc..
In present embodiment, the first touch area 40 is set on outside 12, corresponding with viewing form 111.The touching signals that processor 30 is generated according to the first touch area 40 execute corresponding Interface Control instruction.First touch area 40 can be suspension touch control region, can also be the touch areas such as common condenser type, resistance-type.According to the characteristic of suspension touch control, when touch control object is fallen in the sensing range of suspension, it can trigger suspension touch control region and generate corresponding suspension touch control signal, i.e., without actually touching suspension touch control region, that is, can trigger suspension touch control region and generate corresponding touching signals.Preferably, the first touch area 40 is flexible touch area, such as can be using flexible Trackpad.On the outside 12 be arbitrary shape when, the first touch area 40 can coat outside 12.In present embodiment, since the first touch area 40 is corresponding with viewing form 111, it is set to the leading exterior surface of head-mounted display apparatus, so that the first touch area 40 corresponds to user and passes through the display interface that display module 20 is seen, consistent correspondence on sense organ is provided, first touch area 40 is navigated to when wearing the head-mounted display apparatus convenient for user, so that wearer is convenient to The first touch area 40 is touched to control display interface, so that the handling of head-mounted display apparatus can be improved.
In present embodiment, it is common contact Trackpad in the first touch area 40, including but not limited to condenser type, resistance-type, the location information for the touching signals that processor 30 is generated according to the first touch area show pattern indicator in place of display interface corresponds to the location information.Pattern indicator can fall burnt display etc. for graphic cursor, mouse pointer, in action-item.Touch control object is usually finger, certainly can also be the object that other can be sensed.That is, in the present embodiment, when a position of the first touch area of touch control object touch-control 40, processor 30 shows pattern indicator in the corresponding position of display interface according to the location information of the position, using the input guiding as user.Further, when processor 30 knows that it generates displacement according to the location information of the touching signals, according to the displacement correspondingly mobile graphics indicator, and the touching signals generated in the first touch area 40 are when touching touching signals, according to the corresponding content of pattern indicator, such as pattern indicator falls into the band of position of a certain action-item, execution correspondingly operates.That is, after showing pattern indicator, if user on the first touch area 40 up, down, the mobile touch control object of any directions such as turn left or turn right, produce displacement, then processor 30 is according to the display position of the displacement correspondingly mobile graphics indicator, in order to which user judges whether the moving direction of touch control object is correct according to the movement of pattern indicator.Further, it when pattern indicator is moved to destination, such as is moved at open application program, executes touch action on the first touch area 40, such as click, double-click.At this point, touch action of the processor 30 according to user, gets touch touching signals and execution correspondingly operates, such as it is application program that single pattern indicator, which is moved to action-item, then can open the application program of selection by the operation clicked.In present embodiment, with the current location of graphic cursor instruction touch control object, it is oriented to as input, it can be convenient for the manipulation after user's wearable device to equipment.
In present embodiment, processor 30 judges touch control object when executing a predetermined registration operation on the first touch area 30 according to the touching signals that the first touch area 40 generates, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, executes correspondingly Interface Control and instruct.For example, then executing the control instruction for zooming in or out display interface when executing two fingers opening on the first touch area 40 or closing up operation.In another example two fingers simultaneously when sliding to the left on the first touch area 40, return to a upper interface.For another example three refer to simultaneously when clicking on the first touch area 40, homepage is returned.It is understood that operation related content is merely illustrative elaboration herein, it is not intended to limit the present invention range.
In present embodiment, when the first touch area 40 is suspension touch control region, processor 30 shows pattern indicator in place of display interface corresponds to the location information according to the location information of the suspension touch control signal of the first touch area 40.That is, in the present embodiment, when touch control object is fallen in the sensing range of the first touch area 40, i.e., pattern indicator is shown in the corresponding position of display interface, using the input guiding as user.Further, when processor 30 knows that it generates displacement also according to the location information for the suspension touch control signal that the first touch area 40 generates, such as, touch control object is when the front of the first touch area 40 is mobile toward the medium any direction in upper and lower, left and right, the location information of suspension touch control signal changes, know which create displacements, according to the displacement correspondingly mobile graphics indicator, and when the first touch area 40 generates and touches touching signals, correspondingly operated according to the corresponding content execution of pattern indicator.That is, after showing pattern indicator, if user can be in sensing space in suspension touch control region, execute up, down, the movement for the mobile touch control object such as turn left or turn right when, the then correspondingly mobile graphics indicator of processor 30, i.e. according to the location information dynamically changed in displacement process, real-time control icon indicator is in the display position of display interface, the synchronous shift of icon indicator and touch control object is then realized, judges whether the moving direction of touch control object is correct according to the movement of pattern indicator convenient for user.Further, when pattern indicator is moved to destination, such as it is moved to certain action-item of current display interface, such as certain menu item of certain film poster, certain audio file, certain setting options, navigation interface etc. it is any it is clear can be by action-item, user no longer carries out relative to the movement being parallel on display interface direction, but touch control object is moved to and touches the first touch area 40, that is, be relatively orthogonal to moving on display picture direction and touches the first touch area 40 generation touch touching signals.At this point, processor 30 is correspondingly operated according to the corresponding action-item execution of pattern indicator according to the touch action of user, for example, pattern indicator falls into a certain application program, then the operation for opening the application program of selection is executed.In present embodiment, with the current location of pattern indicator instruction touch control object, it is oriented to as input, it can be convenient for the manipulation after user's wearable device to equipment.Further, touch control operation can be realized, further improve the convenience of manipulation without the practical touch-control of user to touch area using suspension touch control region.
It is understood that action-item further includes the action-item resurrected by a predefined predetermined registration operation.Such as recessive menu etc..The predetermined registration operation includes gesture operation.
In present embodiment, when the first touch area 40 is suspension touch control region, processor 30 is according to the When the suspension touch control signal that one touch area 40 generates judges that the suspension touch control signal corresponds to a predetermined registration operation, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, the corresponding Interface Control instruction of the predetermined registration operation is executed.For example, two fingers zoom in or out display interface when the front of the first touch area 40 is opened or closed up.In another example two fingers simultaneously when the front of the first touch area 40 is moved to the left, return to a upper interface.
It is, of course, understood that can also realize correspondingly Interface Control by direct the first touch area of touch-control 40 when the first touch area 40 is suspension touch control region.For example, returning to a upper interface when the first touch area of two fingers touch-control 40 is simultaneously slided to the left simultaneously.
It is understood that can also correspondingly be controlled according to predetermined registration operation execution of first touch area 40 in conjunction with suspension procedure is touched when the first touch area 40 is suspension touch control region.Such as, correspondingly Interface Control is executed according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction to instruct, can be, one finger touches the first touch area 40, it is mobile that another finger executes orientation, or two suspension procedures for opening/closing up, for predetermined registration operation, Interface Control instruction with corresponding relationship is that finger touches to choose an action-item, such as picture, audio file icon, video file icon, application software etc., accordingly, suspension procedure can mobile to draw the action-item mobile in executing corresponding orientation on display interface in the orientation of suspension procedure according to, according to the opening of suspension procedure/close up, it executes to action-item, for example, picture, amplified accordingly/is reduced.As a result, under limited touch area, providing more operations may.On the one hand many and diverse action-item clear on display interface can be reduced, more succinct display picture is provided.On the other hand, provide user it is more convenient, fitting user habit intuitive operation mode.
In present embodiment, the second touch area 50 is set on outside 12 and adjacent to the first touch area 40, and it can also be two Trackpads that the second touch area 50, which can be the different touch areas of same Trackpad from the first touch area 40,.In other embodiments, the second touch area 50 can also be located at the other positions of head-mounted display apparatus, such as be set at the earphone 70 of 10 opposite end of ontology.When head-mounted display apparatus further includes the headband 60 being connected between two earphones 70, the second touch area 50 be may also set up in the arbitrary region in 60 outside of headband.Certainly, in other embodiments, it may also comprise multiple second touch areas 50, such as two the second touch areas 50, the two sides of the first touch area 40 can be separately positioned on, or be separately positioned at two earphones 70.The quantity of second touch area 50 and setting position can be as needed Carry out flexible setting.Second touch area 50 can be floated touch area, can also be common condenser type, electric resistance touch-control region.Preferably, the second touch area 50 is flexible touch area.
In present embodiment, head-mounted display apparatus includes the corresponding relationship of the touch action and control instruction on the second touch area 50 predetermined, and executes control instruction corresponding with the current touch action on the second touch area 50 according to the corresponding relationship.When the second touch area 50 is suspension touch control region, touch action on second touch area 50 can be the touch action executed in the suspension sensing range of the second touch area 50, the second touch area 50 can be actually touched, can also not touch the second touch area 50 actually.The corresponding relationship of touch action and control instruction on second touch area 50 can be factory setting or the customized setting of user.Specifically, the corresponding relationship can store the memory module in head-mounted display apparatus, such as: read-only memory (ROM, Read Only Memory), electrically-alterable ROM (EEPROM, Electrically Erasable Programmable Read-Only Memory), random access memory (RAM, Random Access Memory), disk etc..The data of memory module can be read in processor 30.Touch action can include for click, double click, slide operation etc., control instruction can be used for executing volume adjustment, skip forward/back is adjusted, switching audio/video scheme control, mute control, and/or, the instruction of pause/broadcasting control etc..That is, the second touch area 50 is provided for execute the touch area of prompt operation, can be further described below by way of example to this in present embodiment.
For example, the corresponding control instruction of the operational motion for presetting upward sliding is volume increase instruction, the corresponding control instruction of the operational motion of slide downward is volume down instruction.When playing music or video, if processor 30 judges that the touch control operation being implemented on the second touch area 50 is upward sliding according to the signal that the second touch area 50 generates, then increase volume, if judge that the touch control operation being implemented on the second touch area 50 is slide downward, reduce volume.
In present embodiment, second touch area 50 is provided for execute the touch area of prompt operation, can provide further directed to the product characteristic of head-mounted display apparatus and more meet user operation habits manipulation, manipulation efficiency is promoted, so as to promote the operating experience of user.
Head-mounted display apparatus in present embodiment further includes being connected to ontology 10 and for dressing head-mounted display apparatus to the headband 60, earphone 70 and loudspeaker 80 of wearer's head.Wherein, loudspeaker 80 may be disposed in ontology 10, may also set up in any position of head-mounted display apparatus, such as settable In headband 60 or earphone 70.Processor 30 can control audio signal according to the touch action on the second touch area 50 and be played out by earphone 70 or loudspeaker 80.Such as, if receiving the touching signals from the second touch area 50 when playing audio content by earphone 70, and judge that touch action is when describing a circle on the second touch area 50 according to touching signals, processor 30, which is switched to, plays audio content by loudspeaker 80.In this way, by executing touch control operation on the second touch area 50, it can be achieved that the quick switching that earphone 70 plays and loudspeaker 80 plays, further improves the convenience of operation.It can also include that, when judging that touch action, associated control instruction are to switch to audio mode according to the touching signals of the second touch area 50, processor 30 closes display output, only plays audio by earphone 70 or loudspeaker 80.It includes but is not limited to that the display of display module 20 is made to enter the off working states such as standby mode that wherein processor 30, which closes display output, such as not power supply state therefore saves on electric power resource, reduces power consumption.When being in audio mode, judge that touch action, associated control instruction are to switch to video mode according to the touching signals of the second touch area 50, then processor 30 opens display output.It is understood that above-mentioned example scheme, in order to provide the setting for the second touch area 50, combination product characteristic can provide the operation readiness being more preferably adapted to.Certainly, it is not used to limit specific control action, the control instruction of the second touch area 50.
Fig. 4 is the flow chart of the control method of head-mounted display apparatus in embodiment of the present invention, be may comprise steps of:
Step 401, judge that touching signals are from the first touch area 40 or the second touch area 50.When touching signals come from the first touch area 40, step 402 is executed, otherwise, i.e., when touching signals come from the second touch area 50, executes step 403.
Step 402, when touching signals come from the first touch area 40, corresponding Interface Control is executed according to touching signals and is instructed.
Specifically, when the first touch area 40 is common contact touch area, according to the location information for the touching signals that the first touch area 40 generates, pattern indicator is shown in place of display interface corresponds to the position.Pattern indicator can fall burnt display etc. for graphic cursor, mouse pointer, in action-item.Touch control object is usually finger, certainly can also be the object that other can be sensed.That is, in the present embodiment, when a position of the first touch area of touch control object touch-control 40, being existed according to the location information of the position The corresponding position of display interface shows pattern indicator, using the input guiding as user.Further, when the location information of the touching signals generated according to the first touch area 40 knows that it generates displacement, according to the displacement correspondingly mobile graphics indicator, and the touching signals generated in the first touch area 40 are when touching touching signals, according to the corresponding content of pattern indicator, such as pattern indicator falls into the band of position of a certain action-item, execution correspondingly operates.That is, after showing pattern indicator, if user is on the first touch area 40 toward the mobile touch control object of arbitrary orientation, produce displacement, then according to the display position of the displacement correspondingly mobile graphics indicator, in order to which user judges whether the moving direction of touch control object is correct according to the movement of pattern indicator.Further, it when pattern indicator is moved to destination, such as is moved at open application program, executes touch action on the first touch area 40, such as click, double-click.At this point, getting touch touching signals according to the touch action of user and execution correspondingly operating, such as it is application program that pattern indicator, which is moved to action-item, then can open the application program of selection by the operation clicked.In present embodiment, with the current location of graphic cursor instruction touch control object, it is oriented to as input, it can be convenient for the manipulation after user's wearable device to equipment.
Specifically, touch control object is judged when executing a predetermined registration operation on the first touch area 30 according to the touching signals that the first touch area 40 generates, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, execute correspondingly Interface Control and instruct.For example, then executing the control instruction for zooming in or out display interface when executing two fingers opening on the first touch area 40 or closing up operation.In another example two fingers simultaneously when sliding to the left on the first touch area 40, return to a upper interface.For another example three refer to simultaneously when clicking on the first touch area 40, homepage is returned.It is understood that operation related content is merely illustrative elaboration herein, it is not intended to limit the present invention range.
Specifically, when the first touch area 40 is suspension touch control region, according to the location information for the suspension touch control signal that the first touch area 40 generates, pattern indicator is shown in place of display interface corresponds to the location information.That is, in the present embodiment, when touch control object is fallen in the sensing range of the first touch area 40, i.e., pattern indicator is shown in the corresponding position of display interface, using the input guiding as user.Further, also according to the first touch area 40 generate suspension touch control signal location information know its generate displacement when, such as touch control object is when the front of the first touch area 40 is mobile toward the medium any direction in upper and lower, left and right, the location information of suspension touch control signal changes, know which create displacement, according to this It is displaced correspondingly mobile graphics indicator, and when the first touch area 40 generates and touches touching signals, is correspondingly operated according to the corresponding content execution of pattern indicator.That is, after showing pattern indicator, if user can be in sensing space in suspension touch control region, execute up, down, the movement for the mobile touch control object such as turn left or turn right when, correspondingly mobile graphics indicator, i.e., according to the location information dynamically changed in displacement process, real-time control icon indicator is in the display position of display interface, the synchronous shift of icon indicator and touch control object is then realized, judges whether the moving direction of touch control object is correct according to the movement of pattern indicator convenient for user.Further, when pattern indicator is moved to destination, such as it is moved to certain action-item of current display interface, such as certain menu item of certain film poster, certain audio file, certain setting options, navigation interface etc. it is any it is clear can be by action-item, user no longer carries out relative to the movement being parallel on display interface direction, but touch control object is moved to and touches the first touch area 40, that is, be relatively orthogonal to moving on display picture direction and touches the first touch area 40 generation touch touching signals.At this point, correspondingly being operated according to the corresponding action-item execution of pattern indicator according to the touch action of user, for example, pattern indicator falls into a certain application program, then executing the operation for opening the application program of selection.In present embodiment, with the current location of pattern indicator instruction touch control object, it is oriented to as input, it can be convenient for the manipulation after user's wearable device to equipment.Further, touch control operation can be realized, further improve the convenience of manipulation without the practical touch-control of user to touch area using suspension touch control region.
It is understood that action-item further includes the action-item resurrected by a predefined predetermined registration operation.Such as recessive menu etc..The predetermined registration operation includes gesture operation.
Specifically, when the first touch area 40 is suspension touch control region, when judging that the suspension touch control signal corresponds to a predetermined registration operation according to the suspension touch control signal that the first touch area 40 generates, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, the corresponding Interface Control instruction of the predetermined registration operation is executed.For example, two fingers zoom in or out display interface when the front of the first touch area 40 is opened or closed up.In another example two fingers simultaneously when the front of the first touch area 40 is slided to the left, return to a upper interface.
It is, of course, understood that can also realize correspondingly Interface Control by direct the first touch area of touch-control 40 when the first touch area 40 is suspension touch control region.For example, returning to a upper interface when the first touch area of two fingers touch-control 40 is simultaneously slided to the left simultaneously.
It is understood that touch can also be defined when the first touch area 40 is suspension touch control region It is correspondingly controlled to predetermined registration operation execution of first touch area 40 in conjunction with suspension procedure.Such as, correspondingly Interface Control is executed according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction to instruct, can be, one finger touches the first touch area 40, it is mobile that another finger executes orientation, or two suspension procedures for opening/closing up, for predetermined registration operation, Interface Control instruction with corresponding relationship is that finger touches to choose an action-item, such as picture, audio file icon, video file icon, application software etc., accordingly, suspension procedure can mobile to draw the action-item mobile in executing corresponding orientation on display interface in the orientation of suspension procedure according to, according to the opening of suspension procedure/close up, it executes to action-item, for example, picture, amplified accordingly/is reduced.As a result, under limited touch area, providing more operations may.On the one hand many and diverse action-item clear on display interface can be reduced, more succinct display picture is provided.On the other hand, provide user it is more convenient, fitting user habit intuitive operation mode.
Step 403, when touching signals come from the second touch area 50, according to the corresponding relationship of touch action and control instruction on the second touch area 50 predetermined, control instruction corresponding with the current touch action on the second touch area 50 is executed.
Specifically, the second touch area 50 can be floated touch area, can also be common contact touch area.When the second touch area 50 is suspension touch control region, touch action on second touch area 50 can be the touch action executed in the suspension sensing range of the second touch area 50, the second touch area 50 can be actually touched, can also not touch the second touch area 50 actually.
Specifically, the corresponding relationship of the touch action on the second touch area 50 and control instruction can be factory setting or the customized setting of user.Touch action can include for click, double click, slide operation etc., control instruction can be used for executing volume adjustment, skip forward/back is adjusted, switching audio/video scheme control, mute control, and/or, the instruction of pause/broadcasting control etc..That is, the second touch area 50 is provided for execute the touch area of prompt operation in present embodiment, it can be further directed to the product characteristic of head-mounted display apparatus, offer more meets user operation habits manipulation, manipulation efficiency is promoted, so as to promote the operating experience of user.
The above is the preferred embodiment of the present invention, it is noted that for those skilled in the art, various improvements and modifications may be made without departing from the principle of the present invention, and these modifications and embellishments are also considered to be within the scope of the present invention.

Claims (18)

  1. A kind of head-mounted display apparatus, including ontology processor and it is set to the intrinsic display module, the ontology includes inside and outside corresponding with the inside, the inside includes providing the viewing form of the display module light source outgoing, it is characterized in that, the head-mounted display apparatus further include:
    First touch area is set to the outside and corresponding with the viewing form;
    Second touch area;
    The processor, touching signals for being generated according to first touch area, execute corresponding Interface Control instruction, it is also used to the corresponding touch action of touching signals generated according to second touch area, and second touch area predetermined touch action and control instruction corresponding relationship, execute corresponding with the current touch action of second touch area control instruction.
  2. Head-mounted display apparatus described in claim 1, which is characterized in that second touch area is set to the outside and neighbouring first touch area.
  3. Head-mounted display apparatus as described in claim 1, which is characterized in that further include being set to the earphone of the ontology opposite end, and the headband being connected between two earphones, second touch area is set to the earphone and/or headband.
  4. Head-mounted display apparatus as described in claims 1 to 3 any one, which is characterized in that first touch area and second touch area are flexible touch area.
  5. Head-mounted display apparatus as described in claim 1, which is characterized in that first touch area is suspension touch control region, and the touching signals include suspension touch control signal.
  6. Head-mounted display apparatus as claimed in claim 5, which is characterized in that the processor executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    The processor is when the touching signals that first touch area generates are suspension touch control signal, according to the location information of the suspension touch control signal, pattern indicator is shown in place of display interface corresponds to the location information, when the location information of the suspension touch control signal generates displacement, the pattern indicator is correspondingly moved according to the displacement, and the touching signals generated in first touch area are correspondingly to be operated when touching touching signals according to the corresponding content execution of the pattern indicator.
  7. Head-mounted display apparatus as claimed in claim 5, which is characterized in that the processor executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    The touching signals that the processor is generated in first touch area are suspension touch control signal, and when the suspension touch control signal is a predetermined registration operation, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, executes correspondingly Interface Control and instruct.
  8. Head-mounted display apparatus as claimed in claim 5, which is characterized in that the processor executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    The processor is when the touching signals that first touch area generates include suspension touch control signal and touch touching signals, judge the suspension touch control signal and the corresponding predetermined registration operation of combination for touching touching signals, and correspondingly Interface Control is executed according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction and is instructed.
  9. Head-mounted display apparatus as described in claim 1, which is characterized in that the processor executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    The processor is when the touching signals that first touch area generates is touch touching signals, according to the location information for touching touching signals, pattern indicator is shown in place of display interface corresponds to the location information, when the location information for touching touching signals generates displacement, correspondingly move the pattern indicator, and when generating touch control signal again, correspondingly operated according to the corresponding content execution of the pattern indicator.
  10. Head-mounted display apparatus as claimed in claim 9, which is characterized in that the processor executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    The touching signals that the processor is generated in first touch area, according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction, execute correspondingly Interface Control instruction to touch touching signals, and when the touchs touching signals are a predetermined registration operation.
  11. Head-mounted display apparatus as described in claim 1, which is characterized in that the control instruction adjusts the switching mute control of audio/video scheme control including can be used for executing volume adjustment skip forward/back, and/or, pause/broadcasting control instruction.
  12. A kind of control method of head-mounted display apparatus, the head-mounted display apparatus includes ontology processor and is set to the intrinsic display module, the ontology includes inside and outside corresponding with the inside, the inside includes providing the viewing form of the display module light source outgoing, the head-mounted display apparatus further includes the first touch area and the second touch area, first touch area be set to the outside and with the viewing form, it is characterized in that, the control method includes:
    When the touching signals come from first touch area, corresponding Interface Control is executed according to the touching signals and is instructed;And
    When the touching signals come from second touch area, the corresponding touch action of touching signals generated according to second touch area, and second touch area predetermined touch action and control instruction corresponding relationship, execute corresponding with the current touch action of second touch area control instruction.
  13. The control method of head-mounted display apparatus as claimed in claim 12, it is characterized in that, first touch area is suspension touch control region, when the touching signals come from first touch area, executes corresponding Interface Control according to the touching signals and instructs specifically:
    When the touching signals that first touch area generates are suspension touch control signal, according to the location information of the suspension touch control signal, pattern indicator is shown in place of display interface corresponds to the location information, when the location information of the suspension touch control signal generates displacement, the pattern indicator is correspondingly moved according to the displacement, and the touching signals generated in first touch area are correspondingly to be operated when touching touching signals according to the corresponding content execution of the pattern indicator.
  14. The control method of head-mounted display apparatus as claimed in claim 12, it is characterized in that, first touch area is suspension touch control region, when the touching signals come from first touch area, executes corresponding Interface Control according to the touching signals and instructs specifically:
    First touch area generate touching signals be suspension touch control signal, and the suspension touch control signal be a predetermined registration operation when, according to preset predetermined registration operation and Interface Control instruction corresponding relationship, execute correspondingly Interface Control instruct.
  15. The control method of head-mounted display apparatus as claimed in claim 12, which is characterized in that first touch area is suspension touch control region, executes corresponding Interface Control according to the touching signals that first touch area generates and instructs specifically:
    When the touching signals that first touch area generates include suspension touch control signal and touch touching signals, judge the suspension touch control signal and the corresponding predetermined registration operation of combination for touching touching signals, and correspondingly Interface Control is executed according to the corresponding relationship of preset predetermined registration operation and Interface Control instruction and is instructed.
  16. The control method of head-mounted display apparatus as claimed in claim 12, which is characterized in that when the touching signals come from first touch area, execute corresponding interface according to the touching signals and control System instruction specifically:
    When the touching signals that first touch area generates are to touch touching signals, according to the location information for touching touching signals, pattern indicator is shown in place of display interface corresponds to the location information, when the location information for touching touching signals generates displacement, correspondingly move the pattern indicator, and when generating touch control signal again, correspondingly operated according to the corresponding content execution of the pattern indicator.
  17. Head-mounted display apparatus as claimed in claim 16, which is characterized in that execute corresponding Interface Control according to the touching signals that first touch area generates and instruct specifically:
    First touch area generate touching signals be touch touching signals, and the touchs touching signals be a predetermined registration operation when, according to preset predetermined registration operation and Interface Control instruction corresponding relationship, execute correspondingly Interface Control instruction.
  18. The control method of head-mounted display apparatus as claimed in claim 12, which is characterized in that the control instruction adjusts the switching mute control of audio/video scheme control including can be used for executing volume adjustment skip forward/back, and/or, pause/broadcasting control instruction.
CN201680011871.0A 2016-03-22 2016-03-22 Head-mounted display apparatus and its control method Pending CN107466396A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/076981 WO2017161497A1 (en) 2016-03-22 2016-03-22 Head-mounted display device and operating and controlling method therefor

Publications (1)

Publication Number Publication Date
CN107466396A true CN107466396A (en) 2017-12-12

Family

ID=59899825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680011871.0A Pending CN107466396A (en) 2016-03-22 2016-03-22 Head-mounted display apparatus and its control method

Country Status (2)

Country Link
CN (1) CN107466396A (en)
WO (1) WO2017161497A1 (en)

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102117140A (en) * 2009-12-30 2011-07-06 联想(北京)有限公司 Touch processing method and mobile terminal
US20120242560A1 (en) * 2011-03-24 2012-09-27 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
CN103487937A (en) * 2012-06-13 2014-01-01 索尼公司 Head-mounted video display device
CN103677356A (en) * 2012-09-03 2014-03-26 联想(北京)有限公司 Electronic equipment
CN103677224A (en) * 2012-09-03 2014-03-26 联想(北京)有限公司 Method for processing information and electronic device
CN103914128A (en) * 2012-12-31 2014-07-09 联想(北京)有限公司 Head mounted electronic device and input method
CN104063037A (en) * 2013-03-18 2014-09-24 联想(北京)有限公司 Operating command recognition method and device as well as wearable electronic equipment
CN104076907A (en) * 2013-03-25 2014-10-01 联想(北京)有限公司 Control method, control device and wearable electronic equipment
CN204203554U (en) * 2014-11-05 2015-03-11 昆山优力电能运动科技有限公司 head-mounted display apparatus
CN104503584A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Head-mounted touch display device
CN104503585A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Touch type head-mounted display
CN105190477A (en) * 2013-03-21 2015-12-23 索尼公司 Head-mounted device for user interactions in an amplified reality environment
US20160216792A1 (en) * 2015-01-26 2016-07-28 Seiko Epson Corporation Head mounted display, and control method and control program for head mounted display

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102117140A (en) * 2009-12-30 2011-07-06 联想(北京)有限公司 Touch processing method and mobile terminal
US20120242560A1 (en) * 2011-03-24 2012-09-27 Seiko Epson Corporation Head-mounted display device and control method for the head-mounted display device
CN103487937A (en) * 2012-06-13 2014-01-01 索尼公司 Head-mounted video display device
CN103677356A (en) * 2012-09-03 2014-03-26 联想(北京)有限公司 Electronic equipment
CN103677224A (en) * 2012-09-03 2014-03-26 联想(北京)有限公司 Method for processing information and electronic device
CN103914128A (en) * 2012-12-31 2014-07-09 联想(北京)有限公司 Head mounted electronic device and input method
CN104063037A (en) * 2013-03-18 2014-09-24 联想(北京)有限公司 Operating command recognition method and device as well as wearable electronic equipment
CN105190477A (en) * 2013-03-21 2015-12-23 索尼公司 Head-mounted device for user interactions in an amplified reality environment
CN104076907A (en) * 2013-03-25 2014-10-01 联想(北京)有限公司 Control method, control device and wearable electronic equipment
CN204203554U (en) * 2014-11-05 2015-03-11 昆山优力电能运动科技有限公司 head-mounted display apparatus
CN104503584A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Head-mounted touch display device
CN104503585A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Touch type head-mounted display
US20160216792A1 (en) * 2015-01-26 2016-07-28 Seiko Epson Corporation Head mounted display, and control method and control program for head mounted display

Also Published As

Publication number Publication date
WO2017161497A1 (en) 2017-09-28

Similar Documents

Publication Publication Date Title
AU2021290292C1 (en) User interface for camera effects
JP7465952B2 (en) DEVICE, METHOD AND GRAPHICAL USER INTERFACE FOR INTERACTING WITH A THREE-DIMENSIONAL ENVIRONMENT - Patent application
US11775248B2 (en) Systems and methods for initiating and interacting with a companion-display mode for an electronic device with a touch-sensitive display
US20200279539A1 (en) User interface for a flashlight mode on an electronic device
JP5900393B2 (en) Information processing apparatus, operation control method, and program
EP2929424B1 (en) Multi-touch interactions on eyewear
US10139906B1 (en) Ring human-machine interface
US20170293351A1 (en) Head mounted display linked to a touch sensitive input device
EP4193244A1 (en) Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
US9430041B2 (en) Method of controlling at least one function of device by using eye action and device for performing the method
US20140232637A1 (en) Head mounted display apparatus and contents display method
KR20160005013A (en) Delay warp gaze interaction
US20220229524A1 (en) Methods for interacting with objects in an environment
DK201670755A1 (en) User Interface for Camera Effects
JP2009193423A (en) Input device for electronic equipment
US20180267624A1 (en) Systems and methods for spotlight effect manipulation
US9001055B2 (en) Portable device and method for operating portable device
CN107466396A (en) Head-mounted display apparatus and its control method
JP7220724B2 (en) Information processing equipment
US20230259265A1 (en) Devices, methods, and graphical user interfaces for navigating and inputting or revising content
KR20140117957A (en) Dual display device
CN117616366A (en) Input device, system, and control method
KR20200125062A (en) Method for user input and user interface device executing the method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20171212

WD01 Invention patent application deemed withdrawn after publication