CN108121442A - Operating method, device and the terminal device of three dimensions display interface - Google Patents
Operating method, device and the terminal device of three dimensions display interface Download PDFInfo
- Publication number
- CN108121442A CN108121442A CN201711200382.2A CN201711200382A CN108121442A CN 108121442 A CN108121442 A CN 108121442A CN 201711200382 A CN201711200382 A CN 201711200382A CN 108121442 A CN108121442 A CN 108121442A
- Authority
- CN
- China
- Prior art keywords
- instruction
- gesture
- user
- object operations
- display interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Abstract
The present invention provides a kind of operating method, device and the terminal devices of three dimensions display interface；Wherein, this method includes：Receive the Object Operations instruction that user sends；Wherein, Object Operations instruction includes phonetic order, gesture instruction or operational order；From current three dimensions display interface, when determining to receive Object Operations instruction, the object aimed at is taken aim at；Selected object carries out control operation to object.By the present invention, user can by way of taking aim at a little and sending Object Operations instruction and cooperate selected object, mode of operation is quick, accurate, higher with the intention compatible degree of user, improves the user experience of three dimensions display interface operation.
Description
Technical field
The present invention relates to three dimensions display technology field, more particularly, to a kind of operation side of three dimensions display interface
Method, device and terminal device.
Background technology
In the operation of traditional three dimensions display interface, user can choose three-dimensional space by way of periodically taking aim at a little
Between object in display interface, however this mode needs user to wait for a period of time, and easily causes the operation fatigue of user, also easy
It causes to choose the erroneous judgement of instruction, violates the intention of user；User can also by way of sending voice signal selected object, so
And if voice signal is longer or ambient noise is larger, recognition accuracy can be caused relatively low, generating object choosing is wrong, user experience
It spends poor.
It is relatively low for above-mentioned existing three dimensions display interface mode of operation convenience and accuracy, cause the body of user
The problem of degree of testing is poor not yet proposes effective solution.
The content of the invention
In view of this, it is an object of the invention to provide a kind of operating method, device and the ends of three dimensions display interface
End equipment so that three dimensions display interface mode of operation is quick, accurate, improves the user's body of three dimensions display interface operation
Degree of testing.
In a first aspect, an embodiment of the present invention provides a kind of operating method of three dimensions display interface, this method applications
In terminal device；This method includes：Receive the Object Operations instruction that user sends；Wherein, Object Operations instruction includes voice and refers to
It makes, gesture instruction or operational order；From current three dimensions display interface, when determining to receive Object Operations instruction, take aim at
The object that point aims at；Selected object carries out control operation to object.
With reference to first aspect, an embodiment of the present invention provides the first possible embodiment of first aspect, wherein, on
It states when Object Operations instruction includes phonetic order, receives the step of Object Operations that user sends instruct, including：Pass through Mike
Wind receives the voice signal that user sends；Whether judge in voice signal comprising default keyword；If so, by voice signal
In the keyword that includes be determined as Object Operations instruction.
With reference to first aspect, an embodiment of the present invention provides second of possible embodiment of first aspect, wherein, on
It states when Object Operations instruction includes gesture instruction, receives the step of Object Operations that user sends instruct, including：Pass through camera shooting
Device receives the gesture vision signal that user sends；Whether judge in gesture vision signal comprising default gesture feature；If
It is that the gesture feature included in gesture vision signal is determined as Object Operations instruction.
With reference to first aspect, an embodiment of the present invention provides the third possible embodiment of first aspect, wherein, on
It states when Object Operations instruction includes operational order, receives the step of Object Operations that user sends instruct, including：Pass through handle
The operational order that user sends is received, operational order is determined as Object Operations instruction.
With reference to first aspect, an embodiment of the present invention provides the 4th kind of possible embodiment of first aspect, wherein, on
The method of stating further includes：The motion state of user's head is detected by sensor device；According to motion state, control is taken aim at a little in three-dimensional
Spatial display moves in interface.
Second aspect, an embodiment of the present invention provides a kind of operating device of three dimensions display interface, which is set
In terminal device；The device includes：Command reception module, for receiving the Object Operations instruction that user sends；Wherein, object is grasped
Making instruction includes phonetic order, gesture instruction or operational order；Object determining module, for showing boundary from current three dimensions
In face, when determining to receive Object Operations instruction, the object aimed at is taken aim at；Object selected module, for selected object, to object
Carry out control operation.
With reference to second aspect, an embodiment of the present invention provides the first possible embodiment of second aspect, wherein, on
Command reception module is stated to be additionally operable to：The voice signal sent by microphone reception user；Judge whether included in voice signal
Default keyword；If so, the keyword included in voice signal is determined as Object Operations instruction.
With reference to second aspect, an embodiment of the present invention provides second of possible embodiment of second aspect, wherein, on
Command reception module is stated to be additionally operable to：The gesture vision signal sent by photographic device reception user；Judge gesture vision signal
In whether include default gesture feature；If so, the gesture feature included in gesture vision signal is determined as Object Operations
Instruction.
With reference to second aspect, an embodiment of the present invention provides the third possible embodiment of second aspect, wherein, on
Command reception module is stated to be additionally operable to：The operational order sent by handle reception user, is determined as Object Operations by operational order
Instruction.
The third aspect, an embodiment of the present invention provides a kind of terminal device, including processor and machine readable storage medium,
Machine readable storage medium is stored with the machine-executable instruction that can be executed by processor, and processor performs machine and can perform finger
Make realizing the operating method of above-mentioned three dimensions display interface.
The embodiment of the present invention brings following advantageous effect：
Operating method, device and the terminal device of a kind of three dimensions display interface provided in an embodiment of the present invention, when connecing
Phonetic order, gesture instruction or operational order that user sends are received when Object Operations instruct, is shown from current three dimensions
Show and determine to take aim at the object aimed in interface；The object is chosen again, and control operation is carried out to the object；In which, user
Can by way of taking aim at a little and sending Object Operations instruction and cooperate selected object, mode of operation is quick, accurate, with user
Intention compatible degree it is higher, improve three dimensions display interface operation user experience.
Other features and advantages of the present invention will illustrate in the following description, alternatively, Partial Feature and advantage can be with
Deduce from specification or unambiguously determine or by implement the present invention above-mentioned technology it can be learnt that.
For the above objects, features and advantages of the present invention is enable to be clearer and more comprehensible, better embodiment cited below particularly, and match somebody with somebody
Attached drawing appended by conjunction, is described in detail below.
Description of the drawings
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution of the prior art
Embodiment or attached drawing needed to be used in the description of the prior art are briefly described, it should be apparent that, in describing below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, can also be obtained according to these attached drawings other attached drawings.
Fig. 1 is a kind of flow chart of the operating method of three dimensions display interface provided in an embodiment of the present invention；
Fig. 2 is the flow chart of the operating method of another three dimensions display interface provided in an embodiment of the present invention；
Fig. 3 is the flow chart of the operating method of another three dimensions display interface provided in an embodiment of the present invention；
Fig. 4 is a kind of structure diagram of the operating device of three dimensions display interface provided in an embodiment of the present invention；
Fig. 5 is a kind of structure diagram of terminal device provided in an embodiment of the present invention.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiment be part of the embodiment of the present invention rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Lower all other embodiments obtained, belong to the scope of protection of the invention.
In the operating method of existing three dimensions display interface, can by way of periodically taking aim at a little selected object, example
Such as, user's control, which is taken aim at, is a little moved on the position of certain an object, when take aim at a little rest on the object time be more than setting time threshold
During value, what terminal device received the object chooses instruction, and then chooses the object；However mode a little is taken aim in this timing, needs
User is wanted to wait for a period of time, easily causes the operation fatigue of user；In addition, after user suspends movement, taking aim at a little can also rest on
In certain an object, and user may be not intended to choose the object at this time, cause to choose the erroneous judgement of instruction, violate the meaning of user
Figure so that the operating experience degree of user is poor.
User can also by way of sending voice signal selected object, for example, user can initiate " to choose the upper left corner
Pink colour chest "；Terminal device needs to carry out feature extraction to the voice signal, and then obtains the choosing of voice signal representative
Middle instruction；However, terminal device is relatively low to the recognition accuracy of longer voice signal, the wrong situation of frequent generating object choosing；
In addition, when the ambient noise residing for user is higher, the accuracy rate of terminal device recognition of speech signals can be lower, thus, it uses
The user experience that voice signal is operated is still poor.
It is relatively low in view of existing three dimensions display interface mode of operation convenience and accuracy, cause the experience of user
The problem of poor is spent, an embodiment of the present invention provides a kind of operating method, device and the terminal devices of three dimensions display interface；
The technology can be applied to VR (Virtual Reality, virtual reality) or AR (Augmented Reality, augmented reality)
Etc. in scenes, it is particularly possible to applied to VR glasses, the AR helmets, the terminals such as mobile phone, tablet computer with VR or AR playing functions
Equipment；Relevant software or hardware realization may be employed in the technology, is described below by embodiment.
A kind of flow chart of the operating method of three dimensions display interface shown in Figure 1, this method are applied to terminal
Equipment；This method comprises the following steps：
Step S102 receives the Object Operations instruction that user sends；Wherein, the Object Operations instruction include phonetic order,
Gesture instruction or operational order；
Step S104 from current three dimensions display interface, when determining to receive Object Operations instruction, takes aim at an aiming
Object；
Step S106 chooses the object, and control operation is carried out to the object.
For example, the VR virtual scenes that after VR glasses, the terminal devices such as mobile phone are worn, are played in terminal device of user can be with
It the movement such as translation, rotation of user's head and changes, the object aimed at is taken aim in VR interfaces, can also be changed therewith.When
When user wants to operate the object A in VR scenes, first choice needs to control head movement, makes to take aim at and a little rests on object A's
On position, then send Object Operations instruction；After terminal device receives Object Operations instruction, that is, object A is chosen, so it is right
Object A performs subsequent control operation, for example, when object A is an article, movement can be carried out to the article, is opened
Deng operation.
From the angle of terminal device, user will take aim at when a little resting on object location A, and terminal device is simultaneously unaware of the use
Family is intended to selected object A, still only stops head movement；When receiving the Object Operations instruction that user sends, terminal
Equipment will currently take aim at the object selected stopped again, and then perform subsequent control operation to object A.
The operating method of a kind of three dimensions display interface provided in an embodiment of the present invention, when the language for receiving user and sending
Sound instruction, gesture instruction or operational order determine to take aim at a little when Object Operations are instructed from current three dimensions display interface
The object of aiming；The object is chosen again, and control operation is carried out to the object；In which, user can be by taking aim at a little and sending out
Go out the mode selected object that Object Operations instruction cooperates, mode of operation is quick, accurate, with the intention compatible degree of user compared with
Height improves the user experience of three dimensions display interface operation.
The flow chart of the operating method of another three dimensions display interface shown in Figure 2, this method are applied to eventually
End equipment；This method is realized on the basis of shown method in Fig. 1, is said so that Object Operations instruction includes phonetic order as an example
It is bright；This method comprises the following steps：
Step S202 detects the motion state of user's head by sensor device；
Step S204, according to the motion state, control is taken aim at a little moves in three dimensions display interface；
The sensor device can be nine axle sensors, and the motion state of user's head is detected by nine axle sensors,
For example, it moves in parallel, swing bucket rotor, move up and down；Taking aim in three dimensions display interface can a little be fixed on setting for interface
Positioning is put, for example, the center of three dimensions display interface；In user, when user's head moves, three dimensions display interface
The virtual image of broadcasting changes therewith, and it is constant to take aim at a position；Thus, virtual image is relatively moved with taking aim at, virtual graph
With taking aim at the object overlapped to changing as in.
Step S206, the voice signal sent by microphone reception user；
Whether step S208 is judged in the voice signal comprising default keyword；If so, perform step S210；Such as
Fruit is no, terminates；
In general, above-mentioned steps S208, in actual implementation, terminal device is carried out firstly the need of the voice signal to receiving
Noise reduction is filtered, characteristic is extracted to the voice signal after noise reduction, then this feature data are matched with key word library, general
With the corresponding keyword of successful characteristic as the corresponding keyword of the voice signal.
In general, in order to improve the accuracy of speech recognition, keyword can it is more brief, species is also less, for example,
The keywords such as " choosing ", " definite "；It can not only ensure the accuracy of speech recognition, the efficiency of speech recognition can also be improved,
The instruction of quick response user.
The keyword included in voice signal is determined as Object Operations instruction by step S210；
Step S212 from current three dimensions display interface, when determining to receive Object Operations instruction, takes aim at and a little takes aim at
Accurate object；
Step S214 chooses the object, and control operation is carried out to the object.
In which, user can take aim at a little and send voice signal cooperate by way of selected object, operation side
Formula is quick, accurate, higher with the intention compatible degree of user, improves the user experience of three dimensions display interface operation.
The flow chart of the operating method of another three dimensions display interface shown in Figure 3, this method are applied to eventually
End equipment；This method is realized on the basis of shown method in Fig. 1, is said so that Object Operations instruction includes gesture instruction as an example
It is bright；This method comprises the following steps：
Step S302 detects the motion state of user's head by sensor device；
Step S304, according to the motion state, control is taken aim at a little moves in three dimensions display interface；
Step S306, the gesture vision signal sent by photographic device reception user；
Whether step S308 is judged in gesture vision signal comprising default gesture feature；If so, perform step
S310；If not, terminate；
In general, above-mentioned steps S308, in actual implementation, terminal device is firstly the need of the gesture vision signal to receiving
Noise reduction is filtered, after carrying out the processing such as edge detection to the gesture vision signal after noise reduction, extracts characteristic, then by the spy
Sign data are matched with gesture feature storehouse, are believed the corresponding gesture feature of the characteristic of successful match as the gesture video
Number corresponding gesture feature.
In general, in order to improve the accuracy of gesture identification, gesture feature can it is relatively simple, resolution is high, species
It is less, for example, the dynamic gestures such as " √ " gesture, click gesture, can also be static hand gesture, for example, stretching out particular hand
The posture of finger；Simple gesture feature can not only ensure the accuracy of gesture identification, can also improve the efficiency of gesture identification,
The instruction of quick response user.
The gesture feature included in gesture vision signal is determined as Object Operations instruction by step S310；
Step S312 from current three dimensions display interface, when determining to receive Object Operations instruction, takes aim at and a little takes aim at
Accurate object；
Step S314 chooses the object, and control operation is carried out to the object.
In which, user can take aim at a little and send gesture vision signal cooperate by way of selected object, behaviour
It is quick, accurate to make mode, it is higher with the intention compatible degree of user, improve the user experience of three dimensions display interface operation
Degree.
In addition, the embodiment of the present invention additionally provides the operating method of another three dimensions display interface, in this method, with
Object Operations instruction includes illustrating exemplified by operational order；The step of Object Operations instruction that above-mentioned reception user sends, tool
Body includes：Operational order is determined as Object Operations instruction by the operational order sent by handle reception user.
Specifically, be provided on the handle can send " definite " or " choosing " instruction button, when user press this by
It during key, that is, represents and sends operational order, and then choose and take aim at the object aimed at face to face.The handle can be VR handles, can also
For the operation handle of AR.
In which, user can take aim at a little and send operational order cooperate by way of selected object, operation side
Formula is quick, accurate, higher with the intention compatible degree of user, improves the user experience of three dimensions display interface operation.
Corresponding to above method embodiment, a kind of knot of the operating device of three dimensions display interface shown in Figure 4
Structure schematic diagram；The device is arranged at terminal device；The device includes such as lower part：
Command reception module 40, for receiving the Object Operations instruction that user sends；Wherein, Object Operations instruction includes language
Sound instruction, gesture instruction or operational order；
Object determining module 41, for from current three dimensions display interface, determining to receive Object Operations instruction
When, take aim at the object aimed at；
For selected object, control operation is carried out to object for object selected module 42.
Further, above-metioned instruction receiving module is additionally operable to：The voice signal sent by microphone reception user；Judge
Whether default keyword is included in voice signal；If so, the keyword included in voice signal is determined as Object Operations
Instruction.
Further, above-metioned instruction receiving module is additionally operable to：The gesture video sent by photographic device reception user is believed
Number；Whether judge in gesture vision signal comprising default gesture feature；If so, the gesture that will be included in gesture vision signal
Feature is determined as Object Operations instruction.
Further, above-metioned instruction receiving module is additionally operable to：The operational order sent by handle reception user, will operate
Instruction is determined as Object Operations instruction.
The operating device of a kind of three dimensions display interface provided in an embodiment of the present invention, when the language for receiving user and sending
Sound instruction, gesture instruction or operational order determine to take aim at a little when Object Operations are instructed from current three dimensions display interface
The object of aiming；The object is chosen again, and control operation is carried out to the object；In which, user can be by taking aim at a little and sending out
Go out the mode selected object that Object Operations instruction cooperates, mode of operation is quick, accurate, with the intention compatible degree of user compared with
Height improves the user experience of three dimensions display interface operation.
A kind of structure diagram of terminal device shown in Figure 5；The equipment includes memory 100 and processor 101；
Wherein, for storing one or more computer instruction, one or more computer instruction is executed by processor memory 100,
To realize the operating method of above-mentioned three dimensions display interface, more than the operating method of the three dimensions display interface can include
One or more in method.
Further, the Network Management Equipment shown in Fig. 5 further includes bus 102 and communication interface 103, processor 101, communication interface
103 and memory 100 connected by bus 102.
Wherein, memory 100 may include high-speed random access memory (RAM, Random Access Memory),
Non-labile memory (non-volatile memory), for example, at least a magnetic disk storage may be further included.By extremely
A few communication interface 103 (can be wired or wireless) is realized logical between the system network element and at least one other network element
Letter connection can use internet, wide area network, local network, Metropolitan Area Network (MAN) etc..Bus 102 can be isa bus, pci bus or
Eisa bus etc..The bus can be divided into address bus, data/address bus, controlling bus etc..For ease of representing, only used in Fig. 5
One four-headed arrow represents, it is not intended that an only bus or a type of bus.
Processor 101 may be a kind of IC chip, have the processing capacity of signal.It is above-mentioned during realization
Each step of method can be completed by the integrated logic circuit of the hardware in processor 101 or the instruction of software form.On
The processor 101 stated can be general processor, including central processing unit (Central Processing Unit, abbreviation
CPU), network processing unit (Network Processor, abbreviation NP) etc.；It can also be digital signal processor (Digital
Signal Processing, abbreviation DSP), application-specific integrated circuit (Application Specific Integrated
Circuit, abbreviation ASIC), ready-made programmable gate array (Field-Programmable Gate Array, abbreviation FPGA) or
Person other programmable logic device, discrete gate or transistor logic, discrete hardware components.It can realize or perform sheet
Disclosed each method, step and logic diagram in disclosed embodiment.General processor can be microprocessor or this at
It can also be any conventional processor etc. to manage device.The step of method with reference to disclosed in disclosure embodiment, can direct body
Now completion is performed for hardware decoding processor or perform completion with the hardware in decoding processor and software module combination.It is soft
Part module can be located at random access memory, and flash memory, read-only memory, programmable read only memory or electrically erasable programmable are deposited
In the storage medium of this fields such as reservoir, register maturation.The storage medium is located at memory 100, and processor 101 reads storage
Information in device 100, with reference to its hardware complete aforementioned embodiments method the step of.
The meter of the operating method of three dimensions display interface that the embodiment of the present invention is provided a kind of, device and terminal device
Calculation machine program product, the computer readable storage medium including storing program code, the instruction that said program code includes can
For performing the method described in previous methods embodiment, specific implementation can be found in embodiment of the method, and details are not described herein.
If the function is realized in the form of SFU software functional unit and is independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contribute to the prior art or the part of the technical solution can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, is used including some instructions so that a computer equipment (can be
People's computer, server or network equipment etc.) perform all or part of the steps of the method according to each embodiment of the present invention.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.
Finally it should be noted that：Embodiment described above is only the specific embodiment of the present invention, to illustrate the present invention
Technical solution, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those of ordinary skill in the art that：Any one skilled in the art
In the technical scope disclosed by the present invention, can still modify to the technical solution recorded in previous embodiment or can be light
It is readily conceivable that variation or equivalent substitution is carried out to which part technical characteristic；And these modifications, variation or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical solution of the embodiment of the present invention, should all cover the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention described should be subject to the protection scope in claims.
Claims (10)
1. a kind of operating method of three dimensions display interface, which is characterized in that the method is applied to terminal device；The side
Method includes：
Receive the Object Operations instruction that user sends；Wherein, the Object Operations instruction includes phonetic order, gesture instruction or behaviour
It instructs；
From current three dimensions display interface, when determining to receive the Object Operations instruction, the object aimed at is taken aim at；
The object is chosen, control operation is carried out to the object.
2. according to the method described in claim 1, it is characterized in that, when the Object Operations instruction include phonetic order when, institute
It states and receives the step of Object Operations that user sends instruct, including：
The voice signal sent by microphone reception user；
Whether judge in the voice signal comprising default keyword；
It is instructed if so, the keyword included in the voice signal is determined as the Object Operations.
3. according to the method described in claim 1, it is characterized in that, when the Object Operations instruction include gesture instruction when, institute
It states and receives the step of Object Operations that user sends instruct, including：
The gesture vision signal sent by photographic device reception user；
Whether judge in the gesture vision signal comprising default gesture feature；
It is instructed if so, the gesture feature included in the gesture vision signal is determined as the Object Operations.
4. according to the method described in claim 1, it is characterized in that, when the Object Operations instruction include operational order when, institute
It states and receives the step of Object Operations that user sends instruct, including：
The operational order is determined as the Object Operations and instructed by the operational order sent by handle reception user.
5. according to the method described in claim 1, it is characterized in that, the method further includes：
The motion state of the user's head is detected by sensor device；
According to the motion state, take aim at described in control and a little moved in three dimensions display interface.
6. a kind of operating device of three dimensions display interface, which is characterized in that described device is arranged at terminal device；The dress
Put including：
Command reception module, for receiving the Object Operations instruction that user sends；Wherein, the Object Operations instruction includes voice
Instruction, gesture instruction or operational order；
Object determining module, when being instructed for from current three dimensions display interface, determining to receive the Object Operations,
Take aim at the object aimed at；
For choosing the object, control operation is carried out to the object for object selected module.
7. device according to claim 6, which is characterized in that described instruction receiving module is additionally operable to：
The voice signal sent by microphone reception user；
Whether judge in the voice signal comprising default keyword；
It is instructed if so, the keyword included in the voice signal is determined as the Object Operations.
8. device according to claim 6, which is characterized in that described instruction receiving module is additionally operable to：
The gesture vision signal sent by photographic device reception user；
Whether judge in the gesture vision signal comprising default gesture feature；
It is instructed if so, the gesture feature included in the gesture vision signal is determined as the Object Operations.
9. device according to claim 6, which is characterized in that described instruction receiving module is additionally operable to：
The operational order is determined as the Object Operations and instructed by the operational order sent by handle reception user.
10. a kind of terminal device, which is characterized in that including processor and machine readable storage medium, the machine readable storage
Media storage has the machine-executable instruction that can be performed by the processor, and the processor performs the machine and can perform finger
It makes realizing method described in any one of claim 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711200382.2A CN108121442B (en) | 2017-11-24 | 2017-11-24 | Operation method and device of three-dimensional space display interface and terminal equipment |
| PCT/CN2018/081355 WO2019001060A1 (en) | 2017-06-26 | 2018-03-30 | Application display method and device, three-dimensional space display interface operation method and device, display method and device, application content display method and device, and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711200382.2A CN108121442B (en) | 2017-11-24 | 2017-11-24 | Operation method and device of three-dimensional space display interface and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108121442A true CN108121442A (en) | 2018-06-05 |
| CN108121442B CN108121442B (en) | 2020-05-08 |
Family
ID=62227873
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711200382.2A Expired - Fee Related CN108121442B (en) | 2017-06-26 | 2017-11-24 | Operation method and device of three-dimensional space display interface and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108121442B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105955470A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Control method and device of helmet display |
| CN106575156A (en) * | 2014-07-25 | 2017-04-19 | 微软技术许可有限责任公司 | Smart placement of virtual objects to stay in the field of view of a head mounted display |
| CN106980383A (en) * | 2017-03-31 | 2017-07-25 | 哈尔滨工业大学 | A kind of dummy model methods of exhibiting, module and the virtual human body anatomical model display systems based on the module |
-
2017
- 2017-11-24 CN CN201711200382.2A patent/CN108121442B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106575156A (en) * | 2014-07-25 | 2017-04-19 | 微软技术许可有限责任公司 | Smart placement of virtual objects to stay in the field of view of a head mounted display |
| CN105955470A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Control method and device of helmet display |
| CN106980383A (en) * | 2017-03-31 | 2017-07-25 | 哈尔滨工业大学 | A kind of dummy model methods of exhibiting, module and the virtual human body anatomical model display systems based on the module |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110060537A (en) * | 2019-03-22 | 2019-07-26 | 珠海超凡视界科技有限公司 | A kind of virtual reality drives training device and its man-machine interaction method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108121442B (en) | 2020-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108062526B (en) | Human body posture estimation method and mobile terminal | |
| CN107251102B (en) | Augmented modification based on user interaction with augmented reality scene | |
| KR102173123B1 (en) | Method and apparatus for recognizing object of image in electronic device | |
| JP5619961B2 (en) | Method, device, computer-readable recording medium, and apparatus for advanced vocabulary rejection | |
| US8737693B2 (en) | Enhanced detection of gesture | |
| CN109641153A (en) | Object modeling and replacement in video flowing | |
| CN112926423B (en) | Pinch gesture detection and recognition method, device and system | |
| CN108874136B (en) | Dynamic image generation method, device, terminal and storage medium | |
| WO2014127697A1 (en) | Method and terminal for triggering application programs and application program functions | |
| US20140362002A1 (en) | Display control device, display control method, and computer program product | |
| AU2012273435B2 (en) | Facilitating image capture and image review by visually impaired users | |
| WO2019109900A1 (en) | Video editing method and device and intelligent mobile terminal | |
| CN106980840A (en) | Shape of face matching process, device and storage medium | |
| CN107111357A (en) | Use the gesture identification of gesture element | |
| KR20210124313A (en) | Interactive object driving method, apparatus, device and recording medium | |
| CN112445341B (en) | Keyboard perspective method and device of virtual reality equipment and virtual reality equipment | |
| CN103106388A (en) | Method and system of image recognition | |
| CN103389798A (en) | Method and device for operating mobile terminal | |
| WO2015131590A1 (en) | Method for controlling blank screen gesture processing and terminal | |
| CN107291238B (en) | Data processing method and device | |
| US20140232672A1 (en) | Method and terminal for triggering application programs and application program functions | |
| CN108961314B (en) | Moving image generation method, moving image generation device, electronic device, and computer-readable storage medium | |
| CN108121442A (en) | Operating method, device and the terminal device of three dimensions display interface | |
| KR20200127928A (en) | Method and apparatus for recognizing object of image in electronic device | |
| CN115061577A (en) | Hand projection interaction method, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200508 Termination date: 20201124 |