CN106155281B - Stereo interaction method, stereoscopic display device and its system - Google Patents
Stereo interaction method, stereoscopic display device and its system Download PDFInfo
- Publication number
- CN106155281B CN106155281B CN201510147807.2A CN201510147807A CN106155281B CN 106155281 B CN106155281 B CN 106155281B CN 201510147807 A CN201510147807 A CN 201510147807A CN 106155281 B CN106155281 B CN 106155281B
- Authority
- CN
- China
- Prior art keywords
- space
- dimensional interaction
- operation body
- display device
- stereoscopic display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 338
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000002452 interceptive effect Effects 0.000 claims abstract description 55
- 230000033001 locomotion Effects 0.000 claims description 100
- 238000013507 mapping Methods 0.000 claims description 29
- 238000006243 chemical reaction Methods 0.000 claims description 16
- 238000005520 cutting process Methods 0.000 claims description 16
- 230000004913 activation Effects 0.000 claims description 15
- 238000004891 communication Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 8
- 230000003213 activating effect Effects 0.000 claims description 6
- 235000013399 edible fruits Nutrition 0.000 claims description 2
- 239000011800 void material Substances 0.000 claims 1
- 239000007787 solid Substances 0.000 abstract description 18
- 238000010586 diagram Methods 0.000 description 31
- 241000699666 Mus <mouse, genus> Species 0.000 description 10
- 230000009471 action Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 230000001360 synchronised effect Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000004088 simulation Methods 0.000 description 5
- 230000001960 triggered effect Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 description 1
- 229910017214 AsGa Inorganic materials 0.000 description 1
- 241000699660 Mus musculus Species 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Abstract
The invention belongs to stereoscopic display interaction technique field, a kind of stereo interaction method is disclosed, applied in the interaction scenarios of stereoscopic display device and three-dimensional interaction operation body, including：Identification three-dimensional interaction operation body is in the operation information of contactless state, wherein, contactless state refers to that three-dimensional interaction operation body is moved with respect to stereoscopic display device, and the state not being in contact with stereoscopic display device；Judge whether operation information meets preset condition, if meeting preset condition, trigger the interactive operation in interaction scenarios.By the above-mentioned means, the present invention can realize three-dimensional interaction, and operating body does not have any Mechanical Contact with stereoscopic display device, reduces friction loss, and improves operating body and stereoscopic display device durability.The present invention also provides stereoscopic display device, and operation is interacted with three-dimensional interaction operation body, realizes the solid interaction under contactless state, rich interactive scene, the present invention also provides Three-dimensional interaction system, person easy to operation uses.
Description
Technical field
The present invention relates to stereoscopic display interaction technique field, more particularly to stereo interaction method, stereoscopic display device and
Its system.
Background technology
Stereo display technique refers to receive different pictures respectively using human eye or so, then brain pass through to image information into
Row superposition is lived again, form one have before-it is rear, upper-under, left-right, remote-near image technology for waiting stereo directional effect, it is vertical
Body shows that compared with plane is shown its picture is truer.
At present, the constructed dummy object out of stereoscopic display can be divided into two classes in visual effect, and one kind is naked eyes
Seem the object of protrusion screen, referred to as shield outer parallax object technology；Another kind of is that naked eyes seem the object in screen,
Referred to as parallax object technology in screen.Regardless of whether parallax object technology in the outer parallax object technology of screen or screen, to stereoscopic display
, it is necessary to use operating body when equipment is operated, operating body is contacted with the display screen of stereoscopic display device or and physics
Operation planar is contacted, and causes operating body to contact with the display screen of stereoscopic display device or produced with physical operations plane
Mechanical friction so that operating body, display screen and physical operations plane are easily damaged.
The content of the invention
The invention mainly solves the technical problem of providing a kind of stereo interaction method, stereoscopic display device and its system,
It can realize the solid interaction under contactless state, rich interactive scene, and three-dimensional interaction operation body and stereoscopic display device
There is no any Mechanical Contact, reduce friction loss, improve three-dimensional interaction operation body and stereoscopic display device durability.
In order to solve the above technical problems, the embodiment of the present invention provides stereo interaction method, applied to stereoscopic display device and
In the interaction scenarios of three-dimensional interaction operation body, including：
Three-dimensional interaction operation body is positioned, to obtain the actual motion track of three-dimensional interaction operation body；
Identify that the three-dimensional interaction operation body is in the operation information of contactless state, wherein, the contactless state is
Refer to the relatively described stereoscopic display device movement of the three-dimensional interaction operation body, and the shape not being in contact with the stereoscopic display device
State；
Judge whether the operation information meets preset condition, if meeting the preset condition, trigger the interactive field
Interactive operation in scape.
Specifically, the operation information includes the actual fortune of the relatively described stereoscopic display device of the three-dimensional interaction operation body
The operational order that dynamic rail mark and the three-dimensional interaction operation body are sent.
Further, further include：
It is virtual in the pseudo operation space that the stereoscopic display device is shown according to the actual motion Track Pick-up
Movement locus.
Specifically, it is described empty in the pseudo operation that the stereoscopic display device is shown according to the actual motion Track Pick-up
Interior fantasy sport track, including：
Set practical operation space；
Obtain the three-dimensional interaction operation body relatively described stereoscopic display device movement shape in the practical operation space
Into the actual motion track；
The actual motion track is subjected to space reflection and generates the fantasy sport track.
Specifically, the setting practical operation space, specifically includes：
Receive the practical operation space that the three-dimensional interaction operation body is sent and instruction is set；
Set and instructed according to the practical operation space, obtain the actual position coordinate of the three-dimensional interaction operation body；
The practical operation space is set according to the actual position coordinate of the three-dimensional interaction operation body.
Further, it is described that the actual motion track is subjected to the space reflection generation fantasy sport track, specifically
Including：
Receive the initial position transmitted by the three-dimensional interaction operation body and instruction is set, the initial position sets instruction to use
In first position coordinate of the setting three-dimensional interaction operation body in the practical operation space, and the three-dimensional interaction operation
Second place coordinate of the body in pseudo operation space；
According to the first position coordinate and the second place coordinate, establish the practical operation space with it is described virtual
Mapping relations between operating space；
According to the mapping relations, the actual motion track is subjected to space reflection and generates the fantasy sport track.
Further, the method further includes：
The scaling instruction that the three-dimensional interaction operation body is sent is received, and obtains the three-dimensional interaction operation body in the reality
The third place coordinate in the operating space of border；
According to the third place coordinate and the first position coordinate, the practical operation space is reset, and build
Stand the pseudo operation space and the mapping relations for resetting the practical operation space.
Further, the method further includes：
The lock operation instruction transmitted by the three-dimensional interaction operation body is received, and obtains the three-dimensional interaction operation body
Latched position coordinate；
The mobile three-dimensional interaction operation body, and receive the unlock operational order that the three-dimensional interaction operation body is sent
When, obtain unlocked position coordinate；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, described in reset
Practical operation space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
Alternatively, it is described to judge whether the operation information meets preset condition, if meeting the preset condition, trigger
Interactive operation in the interaction scenarios, specifically includes：
Judge whether the practical operation space overlaps with the pseudo operation space, if practical operation space with it is described
Pseudo operation space is misaligned, then is the pseudo operation by the actual motion trajectory map of the three-dimensional interaction operation body
The movement locus of virtual cursor in space, and the movement locus when the virtual cursor and the operation in the pseudo operation space
When the distance between object is less than pre-determined distance, the corresponding operation of the operational order is performed to the operation object.
Alternatively, if the practical operation space and the pseudo operation space coincidence, as the three-dimensional interaction behaviour
When making the distance between the actual motion track of body and operation object in pseudo operation space and being less than pre-determined distance, to institute
State operation object and perform the corresponding operation of the operational order.
Preferably, the operational order includes activation instruction, and the operation object is included along the Virtual Space depth side
To the multiple display objects being stacked, the three-dimensional interaction operation body performs the activation instruction, to the display object into
Line activating operates.
Preferably, the operational order includes cutting instruction, and the operation object is included in the pseudo operation space
Virtual human body tissue, the three-dimensional interaction operation body performs the cutting instruction, the virtual human body tissue cut
Operation.
Further, the method further includes：
In the interactive operation in triggering the interaction scenarios, send force feedback vibrations to the three-dimensional interaction operation body and refer to
Order, so that the three-dimensional interaction operation body carries out force feedback vibrations.
Further, before identifying that the three-dimensional interaction operation body is in the operation information of contactless state, further include：
Establish data communication between the stereoscopic display device and the three-dimensional interaction operation body.
The embodiment of the present invention also provides stereoscopic display device, described for interacting operation with three-dimensional interaction operation body
Stereoscopic display device includes display unit, for showing interaction scenarios, further includes：
Recognition unit, for identifying that the three-dimensional interaction operation body is in the operation information of contactless state, wherein, it is described
Contactless state refers to the relatively described stereoscopic display device movement of the three-dimensional interaction operation body, and is not set with the stereoscopic display
The standby state being in contact；
The recognition unit is described vertical to obtain by cooperating with the positioning unit on the three-dimensional interaction operation body
Body interactive operation body positions the locus coordinate of plane relative to stereoscopic display device；
Interactive unit, for judging whether the operation information meets preset condition, if meeting the preset condition, is touched
Interactive operation in sending out interaction scenarios described.
Specifically, the operation information includes the actual fortune of the relatively described stereoscopic display device of the three-dimensional interaction operation body
The operational order that dynamic rail mark and the three-dimensional interaction operation body are sent.
Specifically, the recognition unit includes：
Practical operation space setup module, is set for receiving the practical operation space that the three-dimensional interaction operation body is sent
Instruction, sets according to the practical operation space and instructs, and the actual position coordinate of the three-dimensional interaction operation body is obtained, according to institute
The actual position coordinate for stating three-dimensional interaction operation body sets the practical operation space；
Actual motion track acquisition module, for obtaining three-dimensional interaction operation body phase in the practical operation space
The actual motion track that movement to the stereoscopic display device is formed.
Further, the interactive unit includes：
Space conversion module, it is virtual for being shown according to the actual motion Track Pick-up in the stereoscopic display device
Fantasy sport track in operating space；
Interaction content processing module, for judging whether the operation information meets preset condition,
Alternative events trigger module, for when meeting the preset condition, triggering the interaction behaviour in the interaction scenarios
Make.
Further, the space conversion module, is additionally operable to：
Receive the initial position transmitted by the three-dimensional interaction operation body and instruction is set, the initial position sets instruction to use
In first position coordinate of the setting three-dimensional interaction operation body in the practical operation space, and the three-dimensional interaction operation
Second place coordinate of the body in pseudo operation space；
According to the first position coordinate and the second place coordinate, establish the practical operation space with it is described virtual
Mapping relations between operating space；
According to the mapping relations, the actual motion track is subjected to space reflection and generates the fantasy sport track.
Further, the space conversion module, is additionally operable to:
The scaling instruction that the three-dimensional interaction operation body is sent is received, and obtains the three-dimensional interaction operation body in the reality
The third place coordinate in the operating space of border；
The practical operation space is reset according to the third place coordinate and the first position coordinate, and is established
The pseudo operation space and the mapping relations for resetting the practical operation space.
Further, the space conversion module, is additionally operable to：
The lock operation instruction transmitted by the three-dimensional interaction operation body is received, and obtains the three-dimensional interaction operation body
Latched position coordinate；And unlock operational order transmitted during the mobile three-dimensional interaction operation body is received, obtain solution lock-bit
Put coordinate；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, described in reset
Practical operation space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
Specifically, the interaction content processing module includes：
First judging submodule, for judging whether the practical operation space overlaps with the pseudo operation space, such as
Fruit practical operation space and the pseudo operation space are misaligned, then by the actual motion rail of the three-dimensional interaction operation body
Mark is mapped as the movement locus of virtual cursor in the pseudo operation space；
Second judgment submodule, for judging the actual motion track or described virtual of the three-dimensional interaction operation body
It is default whether the distance between operation object in operating space in the movement locus of virtual cursor and pseudo operation space is less than
Distance.
Alternatively, the operational order includes activation instruction, and the operation object is included along the Virtual Space depth side
To the multiple display objects being stacked, the alternative events trigger module is specifically used for：The activation instruction is performed, to described
Show that object is operated into line activating.
Alternatively, the operational order includes cutting instruction, and the operation object is included in the pseudo operation space
Virtual human body tissue, the alternative events trigger module is specifically used for：The cutting instruction is performed, to the virtual human body group
Knit carry out cutting operation.
Preferably, the equipment further includes：
Force feedback unit, in the interactive operation in triggering the interaction scenarios, to the three-dimensional interaction operation body
Force feedback vibration command is sent, so that the three-dimensional interaction operation body carries out force feedback vibrations.
Preferably, the equipment further includes：
Communication unit, for establishing data communication between the stereoscopic display device and the three-dimensional interaction operation body.
The embodiment of the present invention also provides a kind of Three-dimensional interaction system, including three-dimensional interaction operation body, and solid described above
Display device.
The embodiment of the present invention is in the operation information of contactless state by identifying the three-dimensional interaction operation body, and is grasping
Meet preset condition into triggering interactive operation as information, so as to fulfill solid interaction；Further, since three-dimensional interaction operation body is with standing
Body display device does not have any Mechanical Contact, reduces friction loss, and improves three-dimensional interaction operation body and stereoscopic display device is durable
Property.
Brief description of the drawings
Fig. 1 is a kind of stereo interaction method flow diagram of the embodiment of the present invention；
Fig. 2 is the schematic diagram positioned in the embodiment of the present invention using ultrasonic wave to three-dimensional interaction operation body；
Fig. 3 is that the coordinate plane positioned in the embodiment of the present invention using ultrasonic wave to three-dimensional interaction operation body is illustrated
Figure；
Fig. 4 is multiple spot of embodiment of the present invention ultrasonic wave positioning time division multiplexing sequence diagram；
Fig. 5 is the schematic diagram positioned in the embodiment of the present invention using infrared light supply to three-dimensional interaction operation body；
Fig. 6 is that the camera structure positioned in the embodiment of the present invention using infrared light supply to three-dimensional interaction operation body is shown
It is intended to；
Fig. 7 is that the perspective structure positioned in the embodiment of the present invention using infrared light supply to three-dimensional interaction operation body is illustrated
Figure；
Fig. 8 is the schematic diagram that the embodiment of the present invention sets practical operation space；
Fig. 9 is the virtual billiard game application example schematic diagram of the embodiment of the present invention；
Figure 10 is a kind of application example schematic diagram for strengthening conventional mouse input of the embodiment of the present invention；
Figure 11 is the process schematic that practical operation space of the embodiment of the present invention is mapped with pseudo operation space；
Figure 12 is method schematic diagram of the embodiment of the present invention using three-dimensional interaction operation body scaling practical operation space scope；
Figure 13 is the signal of the cursor movement in the pseudo operation space shown by stereoscopic display device of the embodiment of the present invention
Figure；
Figure 14 is to be moved to another region unlock after the embodiment of the present invention locks virtual cursor using three-dimensional interaction operation body
Method schematic diagram；
Figure 15-Figure 17 is the embodiment of the present invention to realizing the mobile end in stereoscopic display using stereo interaction method of the present invention
Activate or choose a certain operation object in stereo scene to carry out three-dimensional interaction operation schematic diagram in end；
Figure 18 is that the embodiment of the present invention is stood using the schematic diagram of mouse pad and the three-dimensional interaction of finger ring auxiliary input device progress
The schematic diagram of rotate the situation of mechanical organ in body exchange method embodiment；
Figure 19-Figure 21 is that the three-dimensional mechanical structure application that auxiliary input device of the embodiment of the present invention is operated in a design is shown
It is intended to；
Figure 22 is the schematic diagram that the embodiment of the present invention realizes simulation engraving application；
Figure 23 is the schematic diagram that the embodiment of the present invention realizes virtual operation training application；
Figure 24-Figure 25 is the schematic diagram for the simulation billiard game application that the embodiment of the present invention is realized；
Figure 26 is stereoscopic display device structural representation of the embodiment of the present invention；
Figure 27 is that the present invention realizes example Three-dimensional interaction system structure diagram.
Embodiment
The present invention is described in detail with reference to the accompanying drawings and examples.
For ease of understanding the embodiment of the present invention, before each embodiment of the present invention is illustrated starting at, to the institute of the present invention
Have involved in embodiment to some terms explain.Specifically, in all embodiments of the invention, stereoscopic display device
Display is known as interaction scenarios for the stereo scene of three-dimensional interaction operation body row interactive operation, wherein, three-dimensional interaction operation body is opposite
It is known as practical operation space in the operating space of stereoscopic display device, space where interaction scenarios is pseudo operation space.It is vertical
Body interactive operation body is known as actual motion track in practical operation space relative to the track of stereoscopic display device actual motion,
For example three-dimensional interaction operation body can be three-dimensional interaction operation relative to the position of stereoscopic display device, profile or posture
The actual motion track of body.Actual motion trajectory map of the three-dimensional interaction operation body in practical operation space is empty in pseudo operation
Between form fantasy sport track.By the relatively described stereoscopic display device movement of three-dimensional interaction operation body, and do not shown with the solid
Show that the state that equipment is in contact is known as contactless state, when three-dimensional interaction operation body grasps the content in pseudo operation space
When making, the instruction that is sent or order are known as operational order, and the content in pseudo operation space is known as operation object, such as, swash
In phone book applications this operation in pseudo operation space living, activation command is operational order, and phone book applications are to grasp
Make object.
If it should be noted that not conflicting, each feature in the embodiment of the present invention and embodiment can be tied mutually
Close, within protection scope of the present invention.In addition, though function module division is carried out in schematic device, in flow
Logical order is shown in figure, but in some cases, can be with different from the Module Division in device, or in flow chart
Order performs shown or described step.
The stereo interaction method of the embodiment of the present invention is briefly described below.In embodiments of the present invention, it is three-dimensional to hand over
Contactless state is between interoperability body and stereoscopic display device, and identifies that three-dimensional interaction operation body is in contactless state
Operation information, when the operation information meets preset condition, trigger interactive operation, realize that three-dimensional interaction operation body is aobvious to solid
Show the interactive operation of operation object in equipment.
The embodiment of the present invention is further elaborated below in conjunction with the accompanying drawings.
Fig. 1 is a kind of stereo interaction method flow diagram of the embodiment of the present invention, as shown in Figure 1, the embodiment of the present invention
Exchange method, comprises the following steps：
S11, identifies that the three-dimensional interaction operation body is in the operation information of contactless state, wherein, the non-contact shape
State refers to the relatively described stereoscopic display device movement of the three-dimensional interaction operation body, and is not in contact with the stereoscopic display device
State.
In embodiments of the present invention, operation information includes the relatively described stereoscopic display device of the three-dimensional interaction operation body
The operational order that actual motion track and the three-dimensional interaction operation body are sent.The actual motion track of three-dimensional interaction operation body
Can be the position coordinates for stereoscopic display device, posture or profile.Operational order can include to stereoscopic display device
The various orders that the operation object of display is operated, the triggering of operational order can be trigger on three-dimensional interaction operation body by
Key, key combination, capacitance touch draw runner, start writing action or the screen UI triggerings for referring to fingerstall special action, form of a stroke or a combination of strokes operating body more, but
Not limited to this.
In embodiments of the present invention, before three-dimensional interaction operation body interacts operation to operation object, can first set
The practical operation space of three-dimensional interaction operation body, three-dimensional interaction operation body are moved in practical operation space, and pass through knowledge
The interactive operation for the operation object that the actual motion path implementation of other three-dimensional interaction operation body shows stereoscopic display device.Setting
During putting practical operation space, receive the practical operation space that three-dimensional interaction operation body is sent and instruction is set, according to actual behaviour
Make space and instruction is set, the actual position coordinate of the three-dimensional interaction operation body is obtained, according to the three-dimensional interaction operation body
Actual position coordinate sets the practical operation space；Meanwhile according to the actual motion Track Pick-up in the stereoscopic display
The fantasy sport track in pseudo operation space that equipment is shown.
S12, judges whether the operation information meets preset condition, if meeting the preset condition, triggers the friendship
Interactive operation in mutual scene.
In embodiments of the present invention, can by judge in operation information actual motion track whether meet preset condition come
Interactive operation is triggered, the fantasy sport track that can also be generated by judging actual motion trajectory map in operation information, such as,
Virtual cursor, if meet preset condition to trigger interactive operation.
In embodiments of the present invention, shown according to the actual motion Track Pick-up in the stereoscopic display device virtual
Fantasy sport track in operating space, including：
Set practical operation space；
Obtain the three-dimensional interaction operation body relatively described stereoscopic display device movement shape in the practical operation space
Into the actual motion track；
Space reflection is carried out according to the actual motion track and generates the fantasy sport track.In space reflection process
In, it is necessary to establish the mapping relations between practical operation space and pseudo operation space.
In embodiments of the present invention, space reflection generation fantasy sport track is carried out according to actual motion track, can wrapped
Include implementation below：
Receive the initial position transmitted by three-dimensional interaction operation body and instruction is set, the initial position sets instruction to be used to set
First position coordinate of the three-dimensional interaction operation body in the practical operation space is put, and the three-dimensional interaction operation body exists
Second place coordinate in pseudo operation space；
According to the first position coordinate and the second place coordinate, establish the practical operation space with it is described virtual
Mapping relations between operating space；
According to the mapping relations, the actual motion track is subjected to space reflection and generates the fantasy sport track.
Alternatively,
The scaling instruction that three-dimensional interaction operation body is sent is received, and it is empty in the practical operation to obtain three-dimensional interaction operation body
Interior the third place coordinate；
According to the third place coordinate and the first position coordinate, the practical operation space is reset, and build
Stand the pseudo operation space and the mapping relations for resetting the practical operation space.
Alternatively,
The lock operation instruction transmitted by three-dimensional interaction operation body is received, and obtains the locking of the three-dimensional interaction operation body
Position coordinates, the latched position coordinate are position coordinates of the three-dimensional interaction operation body before movement；
The mobile three-dimensional interaction operation body, and receive the unlock operational order that the three-dimensional interaction operation body is sent
When, obtain unlocked position coordinate；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, described in reset
Practical operation space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
In embodiments of the present invention, preset condition can be pre-set actual motion track or fantasy sport track with
The distance between operation object is less than pre-determined distance.
In embodiments of the present invention, judge whether the operation information meets preset condition, if meeting the preset condition,
The interactive operation in the interaction scenarios is then triggered, can specifically be included：If practical operation space and pseudo operation space are not
Overlap, then fortune that can be by the actual motion trajectory map of three-dimensional interaction operation body for virtual cursor in the pseudo operation space
Dynamic rail mark, and when the distance between operation object in the virtual cursor and pseudo operation space is less than pre-determined distance, it is right
The operation object performs the corresponding operation of the operational order.If practical operation space and pseudo operation space coincidence,
When the distance between operation object in actual motion track and the pseudo operation space of three-dimensional interaction operation body be less than it is default away from
From when, the corresponding operation of the operational order is performed to the operation object.
In embodiments of the present invention, the operational order includes activation instruction, and the operation object is included along described virtual
Multiple display objects that space depth direction is stacked, the then interactive operation triggered in the interaction scenarios are specially：It is described
Three-dimensional interaction operation body performs the activation instruction, and the display object is operated into line activating.
In embodiments of the present invention, the operational order includes cutting instruction, and the operation object is included in described virtual
Virtual human body tissue in operating space, the then interactive operation triggered in the interaction scenarios are specially：The three-dimensional interaction behaviour
Make body and perform the cutting instruction, cutting operation is carried out to the virtual human body tissue.
In embodiments of the present invention, the method further includes：
In the interactive operation in triggering the interaction scenarios, send force feedback vibrations to the three-dimensional interaction operation body and refer to
Order, so that the three-dimensional interaction operation body carries out force feedback vibrations.
In embodiments of the present invention, identify the three-dimensional interaction operation body be in contactless state operation information it
Before, further include：
Establish data communication between the stereoscopic display device and the three-dimensional interaction operation body.
The embodiment of the present invention is in the operation information of contactless state by identifying the three-dimensional interaction operation body, and is grasping
Meet preset condition into triggering interactive operation as information, so as to fulfill solid interaction, relative to interaction field disclosed in the prior art
Scape, interactive operation disclosed by the embodiments of the present invention is more convenient, and rich interactive scene；Further, since three-dimensional interaction operation
Body does not have any Mechanical Contact with stereoscopic display device, reduces friction loss, and improves three-dimensional interaction operation body and stereoscopic display is set
Standby durability.
The specific embodiment of exchange method of the present invention is further elaborated with reference to specific attached drawing.
In embodiments of the present invention, in order to obtain the actual motion track of three-dimensional interaction operation body, it is necessary first to solid
Interactive operation body is positioned.
Fig. 2 is the schematic diagram positioned in the embodiment of the present invention using ultrasonic wave to three-dimensional interaction operation body, such as Fig. 2 institutes
Show, ultrasonic transmitter 22 and synchronous signal transmitter 23 be installed on three-dimensional interaction operation body 21, on stereoscopic display device
Ultrasonic receiver 24 and synchronizing information receiver 25 are installed, wherein, synchronous signal transmitter 23 and synchronous signal receiver
The synchronizing information transmitted in 25 can be RF radiofrequency signals or infrared modulated light source, for ultrasonic arrival time (TOA)
Or the time synchronisation of ultrasonic reaching time-difference (TDOA).In order to calculate the locus of three-dimensional interaction operation body 21, by solid
Ultrasonic wave receives on the locus of ultrasonic transmitter 22 on interactive operation body 21 and stereoscopic display device positioning plane 26
The locus of device 24 carries out coordinatograph, as shown in Figure 3, it is assumed that three-dimensional interaction operation body ultrasonic wave launch point 31 is relative to solid
The coordinate of display device positioning plane 32 is (x, y, z), and filters out optimal in stereoscopic display device positioning plane 32 three
Ultrasonic wave receiving point S1, S2, S3, wherein, the distance of the first anchor point S1 and three-dimensional interaction operation body are D1, the second anchor point S2
Distance with three-dimensional interaction operation body is D2, and the distance of the 3rd anchor point S3 and three-dimensional interaction operation body are D3, which can
To be transformed by ultrasonic wave arrival time and the velocity of sound.Wherein the width of stereoscopic display device positioning plane 32 for w (S1 and S2 away from
From), S1 to S2 directions highly are directed toward for h (S1 and S3 distances), x-axis, Y-axis is directed toward S1 to S3 directions, and Z axis is directed toward perpendicular to plane
User, co-ordinate zero point position the midpoint of 32 planes for stereoscopic display device, there is y1=y2=-y3=-h/2, x1=x3=-x2
=-w/2, z1=z2=z3=0.The distance of ultrasonic wave launch point 31 distance S1, S2, S3 are D1, D2, D3, its numerical value passes through three
Sound wave arrival time conversion received by a receiving point.There is following relational expression 1：
Equation abbreviation is relational expression 2
X is drawn by 2 formula of relational expression, z can be obtained by bringing relational expression 1 into after y.
So far space coordinate of the three-dimensional interaction operation body relative to stereoscopic display device plane can be obtained.
Since ultrasonic wave is matter wave, for positioning when has the characteristics that exclusive channel, therefore wants to be followed the trail of with ultrasonic wave
Multiple points can take frequency division multiplexing or time-multiplexed method.Positioned most to put it more simply, time division multiplexing is multiple spot ultrasonic wave
For a kind of rational mode, if but the points there is also tracking position the problem of frame per second can reduce more at the same time.Consider tracking
The required points of finger movement, the quantity of ultrasonic wave launch point are most rational at 2~3.If Fig. 4 is that multiple spot ultrasonic wave is determined
Position time division multiplexing sequence diagram, wherein, tracking points are 2, synchronizing signal SYNC, first launch point be S1, and second is sent out
Exit point is S2.Wherein：Tsync is the interval that synchronizing signal launches SYNC and first anchor point launch time.General electronics
In system, send synchronized transmissions signal in the controller of transmitting terminal needs certain time, therefore this to receiving terminal triggering timing
Delay must be determined according to the device property of transmitting synchronizing signal.Such as common this interval of 38Khz infrared signals general 1~
2ms.Tgab is the interval launched between anchor point adjacent in sequential, is obscured to avoid channel.If the velocity of sound is Vs under room temperature, behaviour
The positioning ultimate range for making region is Smax, then under maximum orientation distance, the time Ts=Smax/ needed for this ultrasonic wave
Vs, it is contemplated that the problem of echo and acoustic wave energy of ultrasonic wave accumulate, from practical engineering experience, Tgab>5Ts is preferable
Setting, but should not be too big because Tgab too conferences reduce the speed of tracking.Twindow is the window time of single positioning,
It is the transmitting minimum interval of 2 subsynchronous signals.It is larger than the summation of above time.These time parameters are measured in receiving terminal
Had to after arrival time into line delay amendment, accurate with the distance that guarantee measures, it is very to set correct time parameter
Necessary, therefore, the embodiment of the present invention gives above-mentioned corresponding explanation according to engineering experience.
Fig. 5 is the schematic diagram that is positioned using infrared light supply to three-dimensional interaction operation body in the embodiment of the present invention, such as Fig. 5
It is shown, infrared markers light source 52 is installed on three-dimensional interaction operation body 51, generally using the AsGa LED of 850nm or 940nm as
Light source.The infrared markers that binocular infrared camera 54 is used on capture operation body are installed in stereoscopic display device positioning plane 53
Light source forms hot spot.The infrared bandpass optical filters 61 of 800nm~1100nm that the structure of camera should include, it is visible to filter out
Light, the hot spot eliminated in environment influence.Camera structure further includes camera lens as shown in fig. 6, in addition to infrared bandpass optical filter 61
Group 62 and camera sensing device 63.In order to calculate the locus of three-dimensional interaction operation body 51, it is necessary to set perspective structure, such as scheme
7 show perspective structure schematic diagram, wherein, C1 and C2 are the imaging sensor position of two cameras, between them
Distance is D.P points are the position of infrared light supply.When P points are come across in the public visual field of two cameras, P points are taken the photograph at 2
As the image generated in head will produce parallax, the numerical relation of the optical axis distance D of pixel difference and camera is demarcated, then basis
The perspective model of camera in itself, easily can extrapolate P points by triangulation and determine relative to stereoscopic display device
The locus of bit plane 53.
In embodiments of the present invention, it is necessary to set a reality first when interacting operation using three-dimensional interaction operation body
Border operating space.During normal use, user also has very big wish and carries out perspective operational in a random space, because
This needs the convenient setting for carrying out practical operation space.
The specific embodiment that practical operation space is set is expanded on further with reference to Fig. 8.As shown in figure 8, there are 2 respectively
Zero point of reference frame POS (0,0,0) and OP (0,0,0), corresponds to stereoscopic display device positioning plane zero point respectively and practical operation is empty
Between zero point.When needing to set practical operation space, three-dimensional interaction operation body sends practical operation space and sets instruction, at this time,
Record the position coordinates where three-dimensional interaction operation body, such as, three-dimensional interaction operation body in former practical operation space 81 zero
Point OP (0,0,0) triggers practical operation space and sets instruction, then has one in the case where stereoscopic display device positions 82 coordinate system of plane
A positioning plane zero point coordinate POS (x0, y0, z0) corresponding to original practical operation space zero point OP (0,0,0).When operator will
Three-dimensional interaction operation body is moved to some position, such as, new practical operation space 83, and trigger setting on three-dimensional interaction operation body
Zero setting point function key 84 triggers practical operation space and sets instruction, and three-dimensional interaction operation body is determined in stereoscopic display device at this time
The new coordinate POS (x1, x1, z1) of bit plane 82 will be by the mapping point new as OP (0,0,0).In this way, by reality
Operating space sends practical operation space and sets instruction, and obtains the actual position coordinate of three-dimensional interaction operation body, you can determines
The practical operation space of three-dimensional interaction operation body.
In embodiments of the present invention, in some cases, user can set practical operation operating space and pseudo operation
Space is completely superposed, and realization is exactly " finding is touched ", i.e., three-dimensional interaction operation body is the position of virtual cursor in itself, this
Generally virtual cursor is not shown under situation, is directly interacted in itself with operation object with operating body.It is illustrated in figure 9 virtual table
Ball game application example schematic, when user carries out virtual billiard game using the stereoscopic display device 91 of tiling, solid interaction
Operating body 92 is the club that player is held.The movement of club is as the important input information operated in game, and ball is
Naked eyes can be visible directly, and under this situation, practical operation space and pseudo operation space coordinates are to overlap.It is positioned
Three-dimensional interaction operation body 92 can directly be positioned relative to the space coordinate of the positioning plane 93 of stereoscopic display device 91
Calculate.
When the position in pseudo operation space or big small-scale inconvenient operator directly insert operating body, just
It may require that and the practical operation space of operating body is mapped in pseudo operation space.Such as Figure 10 show a kind of enhancing tradition
The application example schematic diagram of mouse input, the three-dimensional interaction operation body 101 that can be positioned is worn on the finger of user, and positioning is flat
Face 102 is the mouse pad of user, and when carrying out such as work of mechanical modeling design one kind, practical operation space is set in mouse
The operation that can be spatially more convenient operator based on mark pad.User need to the stereo content in stereoscopic display device into
During edlin, it will can be moved with space of the finger of fingerstall above mouse pad, three-dimensional interaction operation body 101 is opposite
The spatial coordinate of the cursor in stereoscopic display device 103 can be mapped as in the coordinate of positioning plane 102, person easy to operation edits aobvious
Show the stereo content in device.
Illustrated with reference to Figure 11 processes mapped with pseudo operation space practical operation space.Such as Figure 11
It is shown, there are 3 zero point of reference frame POS (0,0,0) respectively, OP (0,0,0), View (0,0,0) are corresponding respectively to position plane 112 0
113 zero point of point, 111 zero point of practical operation space and pseudo operation operating space.OP (0,0,0) is in the case where positioning plane coordinate system
There is a corresponding coordinate POS (x0, y0, z0).The numerical value of x0, y0, z0 can be by practical operation space methods to set up come really
It is fixed.
When operator is moved to a certain position using three-dimensional interaction operation body in practical operation space, new position exists
Position plane coordinate system under navigate to a new coordinate POS (x0+x, y0+y, z0+z), at this time basis preserved OP (0,0,
0) corresponding POS (x0, y0, z0) can go out x, the numerical value of y, z, i.e. OP (x, y, z) with difference.
Assuming that the pseudo operation space of stereoscopic display device is in x, y, the maximum on z directions is respectively ViewX, ViewY
And the maximum on ViewZ, practical operation space x, y, z direction is respectively OPX, OPY and OPZ, wherein, this maximum also may be used
Freely to be set by operator.
Then there are displacement scale coefficient PX, PY and PZ：
PX=ViewX/OPX
PY=ViewY/OPY
PZ=ViewZ/OPZ
The mapped coordinate in pseudo operation space of virtual cursor 114 is View (PX*x, PY*y, PZ*z) at this time.
In embodiments of the present invention, operator in need can be changed real when being operated using three-dimensional interaction operation body
The size of border operating space, this change are most exactly intuitively between the distance of operating body movement and the displacement distance of virtual cursor
Ratio change, i.e. virtual cursor speed changes.As shown in Fig. 12 it is real using three-dimensional interaction operation body scaling
The method schematic diagram of border operating space scope.As shown in figure 12, if the operating space zero point of former practical operation space 121 corresponds to
The location coordinate coordinate for positioning the positioning plane zero point POS (0,0,0) of plane 124 is POS (x0, y0, z0), and practical operation is empty
Between x, y, the maximum that z fills up in direction pseudo operation space is respectively OPX, OPY and OPZ.When triggering three-dimensional interaction operation body
After zoom operations space function key 125 on 123 triggers zoom operations space vector, three-dimensional interaction operation body 123 is moved to one
A new position, its coordinate are POS (x1, y1, z1), this puts the terminal as practical operation space, it can be deduced that
OPX '=x1-x0
OPY '=y1-y0
OPZ '=z1-z0
For practical operation space 122 in x, y, z fill up in direction pseudo operation sky after wherein OPX ', OPY ' and OPZ ' are used as scaling
Between maximum and be saved.Since operator can pull to any direction, in the case of the overwhelming majority, meeting operator makes
It is relative to the new practical operation space of the location determination of practical operation space with zero point of reference frame before with the method for custom
Zero point, but UI selection interfaces can be also provided and allow operator to select new dead-center position.
It should be noted that when the anchor point of three-dimensional interaction operation body has multiple, the sky of multiple points after being mapped with coordinate
Between the Geometric center coordinates that are calculated of coordinate as the unique coordinate needed for judging.
Figure 13 is the schematic diagram of the cursor movement in the pseudo operation space shown by stereoscopic display device.Such as Figure 13 institutes
Show there are 2 zero point of reference frame POS (0,0,0) respectively, OP (0,0,0), the zero point of corresponding positioning plane 134 and reality are grasped respectively
Make the zero point in space 132, it is shown when operator is moved using three-dimensional interaction operation body 131 in physical operation space 132
Virtual cursor 133 134 coordinate of pseudo operation space be space conversion map after coordinate, in pseudo operation space 134
Movement and three-dimensional interaction operation body 131 mobile synchronization.When the anchor point of three-dimensional interaction operation body 131 has multiple, to sit
Unique coordinate of the Geometric center coordinates that the space coordinate of multiple points is calculated after mark mapping needed for as judgement.Operator needs
Some accurate operations are switched to from rough operation, the interim handle of meeting is placed on a position easily fixed to better control over hand
The action in portion, continues operation just now in new position again, but so operating space will not connect with operation before
Continuous, the present embodiment mainly solves the problems, such as this.
In embodiments of the present invention, operator, can be empty by locking when being operated using three-dimensional interaction operation body
Intend the seamless switching that cursor realizes practical operation space.Figure 14 is to be moved to after locking virtual cursor using three-dimensional interaction operation body
The method schematic diagram of another region unlock.As shown in figure 14, it is assumed that the practical operation space zero point of three-dimensional interaction operation body 141 with
The coordinate system coordinate positioned corresponding to the positioning plane zero point POS (0,0,0) of plane 142 is POS (x0, y0, z0).When triggering is vertical
When body interactive operation body 141 locks cursor menu key 145, three-dimensional interaction operation body 141 is in the coordinate corresponding to positioning plane 142
It is that coordinate is POS (x1, y1, z1), blocks the pseudo operation space coordinate and three-dimensional interaction operation body of virtual cursor 144 at this time
The mapping of plane coordinates is positioned, that is, has locked the position of virtual cursor 144.When operator's moving three-dimensional interactive operation body 141 arrives
One new position POS (x2, y2, z2), and trigger three-dimensional interaction operation body 141 and unlock cursor menu key 146, will be actual
The zero point setting coordinate of operating space is POS (x0+ (x2-x1), y0+ (y2-y1), z0+ (z2-z1)) and reopens virtual optical
The mapping of the positioning plane coordinates of target pseudo operation space coordinate and three-dimensional interaction operation body, at this time operator just complete and make
Another region is moved to after locking virtual cursor with three-dimensional interaction operation body to unlock, and can be continued in new position before locking cursor
Operation, without changing the mapping relations of coordinate again, realize the seamless switching of operating space.It should be noted that this
In inventive embodiments, when three-dimensional interaction operation body triggers the instruction of locking cursor, virtual cursor coordinate information is locked, when
Three-dimensional interaction operation body unlock gesture when, obtain the current position of three-dimensional interaction operation body to calculate three-dimensional interaction behaviour
Make absolute displacement changes in coordinates of the body during " locking cursor ", the data of this change are by for correcting new operating space zero
Point, to realize the seamless switching in user's operation space.
After mobile terminal uses stereo display technique more and more, in order to realize the three-dimensional man-machine of stereoscopic display device
Interaction is no longer limited to the touch screen of two dimension, and three-dimensional can be effectively realized using the stereo interaction method of the embodiment of the present invention
Solid interaction.With reference to Figure 15-Figure 17 to being realized using stereo interaction method of the present invention in the mobile terminal of stereoscopic display
Activate or choose a certain operation object in stereo scene to carry out three-dimensional interaction operation further explanation.When operator uses solid
When interactive operation body moves in practical operation space, the space coordinate of three-dimensional interaction operation body is obtained, and solid interaction is grasped
The actual motion trajectory map for making body is the virtual cursor in pseudo operation space.When the movement locus institute of three-dimensional interaction operation body
When the virtual cursor of mapping and the space length for the operation object that can be activated or choose are less than the threshold value of setting, operation object
It is activated.As shown in figure 15, three-dimensional interaction operation body 151 in the movement locus of practical operation space 152 by positioning plane 153
The virtual cursor 155 in pseudo operation space 154 is mapped as, is preset when the distance of virtual cursor 155 and " phone " icon is less than
Threshold value, then " phone icon " be activated, be highlighted.As shown in figure 16, three-dimensional interaction operation body 161 is empty in practical operation
Between 162 movement locus be mapped as virtual cursor 165 in pseudo operation space 164 by positioning plane 163, work as virtual cursor
165 when being moved to " contact person " icon in left side, and the distance of virtual cursor 165 after mapping and " contact person " icon is less than default
Threshold value, " contact person " icon is activated, is highlighted.As shown in figure 17, three-dimensional interaction operation body 171 is in practical operation space
172 movement locus is mapped as virtual cursor 175 in pseudo operation space 174 by positioning plane 173, works as virtual cursor
175 move in z-axis, and the distance of the virtual cursor 175 after mapping and " short message " icon is less than default threshold value, " short message " icon
It is activated, object visually more shallow than the level does transparence and shows, the object being activated is highlighted.
To further understand exchange method of the embodiment of the present invention, the application below in conjunction with the accompanying drawings to exchange method of the present invention is real
Example is described further.
It is the schematic diagram that three-dimensional interaction is carried out using mouse pad and finger ring auxiliary input device as shown in figure 18.
It is by a positioning plane 181 that may be used as mouse pad and design, the three-dimensional friendship of the finger ring shape being worn on finger
Interoperate body 182 and the computer composition with stereoscopic display device 183.The alignment system of its finger ring can be foregoing ultrasound
Ripple alignment system or binocular camera identification infrared markers point.
When operator's normal use mouse, it and common mouse pad are no different；When user's hand leaves mouse pad, positioning
Plane 181 obtains 182 finger ring of three-dimensional interaction operation body and believes in the locus of practical operation space 184, and by its position in real time
Computer of the breath report to control stereoscopic display device 183.Computer can be to each quilt after obtaining the positional information of finger ring
The action of the finger of tracking is mapped, and will be placed in its associated virtual cursor 185 in scene.Usually, virtual cursor 185
Coordinate and multiple three-dimensional interaction operation bodies anchor point geometric center subject to.As operator empty actual behaviour on the positioning plane
When making space 184 and making action, computer system is by the action for parsing each finger being tracked and is mapped to corresponding interaction
Event, changes scene shown in stereoscopic display device.
Figure 19-Figure 21 is the three-dimensional mechanical structure application schematic diagram in one design of auxiliary input device operation.Such as Figure 19
Shown, this three-dimensional mechanical structure includes considerable level and internal structure.When three-dimensional interaction operation body 191 is in practical operation
During the relevant position in space 192, located 193 coordinate of plane maps 195 meeting of virtual cursor in later pseudo operation space 194
Correspondingly activation is designed the part on object correspondence position.Correspondingly, not in level all transparency process of activation.Work as operation
Person reduces direction movement with to Z axis, and corresponding virtual cursor 195 can also move and activate operated workpiece portion.Such as Figure 20
Shown, three-dimensional interaction operation body (finger ring in figure to be worn on finger) is at the relevant position of practical operation space 202, through fixed
203 coordinate of bit plane is mapped as the virtual cursor 205 in pseudo operation space 204, wherein, what is be activated is one small in workpiece
Piston element.When component is activated, finger ring controlled can produce once slight force feedback and remind operator's new object to be activated.
When operator two fingers for wearing three-dimensional interaction operation body are drawn close be affectedly bashful/capture when posture when, the workpiece that is activated enters
Seized condition, at this time workpiece can be moved as operator further moves, the posture being affectedly bashful until operator is cancelled.
During the action that operator is affectedly bashful and decontrols, device for force feedback can send very very brief force feedback several times, to produce viscous sense
To simulate the sense of touch that object is adsorbed and decontroled.Such as the situation shown in Figure 21, three-dimensional interaction operation body (are to wear on finger in figure
The finger ring worn) at the relevant position of practical operation space 212, located 213 coordinate of plane is mapped as pseudo operation space 214
Virtual cursor 215, after operator have activated piston article, be made that the action being affectedly bashful, then pull the workpiece in z-axis
Moved in direction.
Figure 22 is the schematic diagram that the embodiment of the present invention realizes simulation engraving application.
As shown in figure 22, three-dimensional interaction operation body 221 is held as virtual graver by operator, carved object
It is displayed in the pseudo operation space 222 of stereoscopic display device.When operator's hand-held three-dimensional interactive operation body 221 relative to
The 225 inner movement of practical operation space of plane 223 is positioned, Virtual Sculpturing knife 224 is synchronous to invade with carved dummy object
Enter, device for force feedback can synchronously work, the earthquake intensity of force feedback and the carved hardness of object and the speed of intrusion into
Direct ratio, allows operator to obtain the tactile that object is truly destroyed.Particularly, when positioning plane is using the flat of stereo display technique
Plate computer, mobile phone is when the screen surface of equipment, practical operation space and pseudo operation space coincidence, and virtual graver is grasped
The three-dimensional interaction operation body that author holds, also belongs to the category that the present invention is protected.
Figure 23 is the schematic diagram that the embodiment of the present invention realizes virtual operation training application.
As shown in figure 23, three-dimensional interaction operation body 231 is held as virtual scalpel by operator, the body of virtual operation
Body tissue is displayed in the pseudo operation space 232 of stereoscopic display device.When 231 body of operator's hand-held three-dimensional interactive operation exists
It is synchronous and by virtual tissue relative to the 235 inner movement of practical operation space of positioning plane 233, analog scalpel 234
Generation is cut and intrusion, while device for force feedback can carry out work according to the Process Synchronization of simulation operation and make operator's acquisition true
Sense of touch.Particularly, when positioning plane is the tablet computer using stereo display technique, mobile phone is real when the screen surface of equipment
Border operating space and pseudo operation space coincidence, the three-dimensional interaction operation body that virtual scalpel, that is, operator holds, also belong to
The category that the present invention is protected.
Figure 24-Figure 25 is the schematic diagram for the simulation billiard game application that the embodiment of the present invention is realized.
As shown in figure 24, three-dimensional interaction operation body 241 is fabricated to the form of club.When operator is in positioning plane 242
The inner moving three-dimensional interactive operation body 241 of practical operation space 243, three-dimensional interaction operation body 241 is mapped as pseudo operation space
Virtual Billiards stick 245 in 244 is synchronous to collide with virtual billiard ball, while device for force feedback can synchronously carry out work and allow operation
Person obtains collision sense true to nature.Particularly, as shown in figure 25, when positioning plane 251 is the tablet electricity using stereo display technique
Brain, mobile phone is when the screen surface of stereoscopic display device 252, practical operation space and pseudo operation space coincidence, virtual table
The three-dimensional interaction operation body 253 that club, that is, operator holds, also belongs to the category that the present invention is protected.
In embodiments of the present invention, identify that three-dimensional interaction operation body is believed with operation of the stereoscopic display device in contactless state
Breath, and in the case where operation information meets preset condition, trigger interactive operation, can be especially virtual by actual motion trajectory map
Virtual cursor in operating space, and the operational order sent according to operating body control virtual cursor to stereoscopic display device
Operation object is operated, so as to fulfill solid interaction；Further, since operating body does not have any machinery to connect with stereoscopic display device
Touch, reduce friction loss, improve operating body and stereoscopic display device durability.
Figure 26 is stereoscopic display device structural representation of the embodiment of the present invention.As shown in figure 26, a kind of stereoscopic display device, is used
In interacting operation with three-dimensional interaction operation body, including：
Recognition unit 261, for identifying that the three-dimensional interaction operation body is in the operation information of contactless state, wherein,
The contactless state refers to the relatively described stereoscopic display device movement of the three-dimensional interaction operation body, and not aobvious with the solid
Show the state that equipment is in contact,
Interactive unit 262, for judging whether the operation information meets preset condition, if meeting the preset condition,
The interactive operation in the interaction scenarios is then triggered,
Display unit 263, for showing interaction scenarios.
In embodiments of the present invention, the operation information is set including the relatively described stereoscopic display of the three-dimensional interaction operation body
The operational order that standby actual motion track and the three-dimensional interaction operation body are sent.
In embodiments of the present invention, the recognition unit 261 includes：
Practical operation space setup module 2611, the practical operation space sent for receiving the three-dimensional interaction operation body
Instruction is set, is set and instructed according to the practical operation space, obtains the actual position coordinate of the three-dimensional interaction operation body, root
The practical operation space is set according to the actual position coordinate of the three-dimensional interaction operation body；
Actual motion track acquisition module 2612, for according to the three-dimensional interaction operation body in the practical operation space
Inside the movement locus of relatively described stereoscopic display device determines the actual motion track of the three-dimensional interaction operation body.
In embodiments of the present invention, recognition unit 261 by with the positioning unit on three-dimensional interaction operation body, such as, surpass
Pinger or infrared light supply, cooperate, flat relative to stereoscopic display device positioning to obtain three-dimensional interaction operation body
The locus coordinate in face, appearance is too or profile.It should be noted that if three-dimensional interaction operation body can be obtained independently in itself
When its own is relative to the locus coordinate of stereoscopic display device positioning plane, posture or profile, then recognition unit 261 can
Directly locus coordinate, posture or the profile is obtained from three-dimensional interaction operation body.
In embodiments of the present invention, the interactive unit 262 includes：
Space conversion module 2621, for the actual motion track to be generated the stereoscopic display device through image procossing
Fantasy sport track in the pseudo operation space of display；
Interaction content processing module 2622, for judging whether the operation information meets preset condition,
Alternative events trigger module 2623, for when meeting the preset condition, triggering the friendship in the interaction scenarios
Interoperability.
In embodiments of the present invention, the space conversion module 2621 is additionally operable to：
Receive the initial position transmitted by the three-dimensional interaction operation body and instruction is set, the initial position sets instruction to use
In first position coordinate of the setting three-dimensional interaction operation body in the practical operation space, and the three-dimensional interaction operation
Second place coordinate of the body in pseudo operation space；
According to the first position coordinate and the second place coordinate, establish the practical operation space with it is described virtual
Mapping relations between operating space；
According to the mapping relations, by fantasy sport track described in the actual motion Track Pick-up.
Alternatively, it is additionally operable to：
The scaling instruction that the three-dimensional interaction operation body is sent is received, and obtains the three-dimensional interaction operation body and is moved to
The third place coordinate；
According to the third place coordinate and the first position coordinate, the practical operation space is reset, and build
Stand the pseudo operation space and the mapping relations for resetting the practical operation space；
Alternatively, it is additionally operable to：
The lock operation instruction transmitted by the three-dimensional interaction operation body is received, and obtains the three-dimensional interaction operation body
Latched position coordinate；And unlock operational order transmitted during the mobile three-dimensional interaction operation body is received, obtain solution lock-bit
Put coordinate；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, described in reset
Practical operation space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
In embodiments of the present invention, space conversion module 2621 receives the spatial data of three-dimensional interaction operation body, when
Locus coordinate, the posture that itself positions plane relative to stereoscopic display device can be independently obtained on three-dimensional interaction operation body
Or during profile, space conversion module 2621 is then obtained from the space that three-dimensional interaction operation body transmits by wireless communication unit and sat
Data are marked, wherein, received coordinate data is the coordinate based on positioning plane, will be by space conversion module 2621
The coordinate in pseudo operation space is converted to, is stored in the form of first in first out.The data characterization of this section of first in first out be before
Motion track information of a period of time three-dimensional interaction operation body in pseudo operation space.
In embodiments of the present invention, the interaction content processing module 2622 includes：
First judging submodule 26221, for judging whether the practical operation space weighs with the pseudo operation space
Close, if practical operation space and the pseudo operation space are misaligned, the three-dimensional interaction operation body movement locus is reflected
Penetrate as the movement locus of virtual cursor in the pseudo operation space,
Second judgment submodule 26222, for judging the three-dimensional interaction operation body movement locus or the pseudo operation
Whether the distance between operation object in space in the movement locus of virtual cursor and pseudo operation space is less than pre-determined distance.
In embodiments of the present invention, interaction content processing module 2622 reads movement locus number from space conversion module 2621
According to, and judge whether practical operation space overlaps with the pseudo operation space, if practical operation space and the virtual behaviour
Make that space is misaligned, then operating body movement locus is mapped as to the movement locus of virtual cursor in pseudo operation space, moreover, also
Judge that the track in pseudo operation space whether there is with the coordinate of the dummy object in interaction scenarios to contact or collide.
In embodiments of the present invention, the operational order includes activation instruction, and the operation object is included along described virtual
Multiple display objects that space depth direction is stacked, the alternative events trigger module 2623 are specifically used for：Described in execution
Activation instruction, shows object into line activating to described.
In embodiments of the present invention, the operational order includes cutting instruction, and the operation object is included in described virtual
Virtual human body tissue in operating space, the alternative events trigger module 2623 are specifically used for：The cutting instruction is performed, it is right
The virtual human body tissue is cut.
In embodiments of the present invention, alternative events trigger module 2623 receives sentencing for the transmission of interaction content processing module 2622
It is disconnected as a result, and trigger interactive operation when operation information meets preset condition, wherein, interactive operation is included according in operation information
Operational order determine.
In embodiments of the present invention, the equipment further includes：
Force feedback unit 264, in the interactive operation in triggering the interaction scenarios, to the three-dimensional interaction operation
Body sends force feedback vibration command, so that the three-dimensional interaction operation body carries out force feedback vibrations.
In embodiments of the present invention, the equipment further includes：
Communication unit 265, for establishing data communication between the stereoscopic display device and the three-dimensional interaction operation body.
It should be noted that the information in stereoscopic display device in the embodiment of the present invention between unit, module is handed over
Mutually, the content such as implementation procedure, due to being based on same design with the method for the present invention embodiment, particular content is equally applicable to three-dimensional aobvious
Show equipment, moreover, the unit or module in the embodiment of the present invention can be realized as single hardware or software, and can
The combination of the function of unit or module is realized using single hardware or software as needed.
In embodiments of the present invention, identify that three-dimensional interaction operation body is believed with operation of the stereoscopic display device in contactless state
Breath, and in the case where operation information meets preset condition, trigger interactive operation, can be especially virtual by actual motion trajectory map
Virtual cursor in operating space, and the operational order sent according to operating body control virtual cursor to stereoscopic display device
Operation object is operated, so as to fulfill solid interaction；Further, since operating body does not have any machinery to connect with stereoscopic display device
Touch, reduce friction loss, improve operating body and stereoscopic display device durability.
Figure 27 realizes example Three-dimensional interaction system structure diagram for the present invention.As shown in figure 27, including：Three-dimensional interaction operation
Body 271 and stereoscopic display device 272, wherein, 272 concrete structure of stereoscopic display device composition and function such as foregoing invention are implemented
Described in the stereoscopic display device of example, details are not described herein again.Three-dimensional interaction operation body 271, specifically includes：
Agreement bit location 2711, can produce specific signal, as ultrasonic wave TOA or TDOA, infrared markers image are known
The signal that not etc. technology does not produce, and coordinate with stereoscopic display device, three-dimensional interaction operation body is obtained relative to stereoscopic display with this
Equipment positions locus coordinate, posture or the profile of plane.The unit, which can work independently, obtains three-dimensional interaction operation body
Relative to locus coordinate, posture or the profile of stereoscopic display device positioning plane, such as install and be made of MEMS device
Inertial guidance system (such as gyroscope)；
Force feedback unit 2712, for improving interactive experience,
Operational order trigger element 2713, carries out triggering command to trigger specific interactive operation, typical case touches by operator
Forwarding method can be button, capacitance touch draw runner etc..
Communication unit 2714, for carrying out data connection with stereoscopic display device, realizes data communication.
In embodiments of the present invention, by identifying the behaviour of three-dimensional interaction operation body and stereoscopic display device in contactless state
Make information, and in the case where operation information meets preset condition, trigger interactive operation, so as to fulfill solid interaction；It is additionally, since operation
Body does not have any Mechanical Contact with stereoscopic display device, reduces friction loss, and improves operating body and stereoscopic display device durability.
The foregoing is merely embodiments of the present invention, are not intended to limit the scope of the invention, every to utilize this
The equivalent structure or equivalent flow shift that description of the invention and accompanying drawing content are made, it is relevant to be directly or indirectly used in other
Technical field, is included within the scope of the present invention.
Claims (21)
1. stereo interaction method, applied in the interaction scenarios of stereoscopic display device and three-dimensional interaction operation body, it is characterised in that：
Including：
Identify that the three-dimensional interaction operation body is in the operation information of contactless state, wherein, the contactless state refers to institute
The relatively described stereoscopic display device movement of three-dimensional interaction operation body, and the state not being in contact with the stereoscopic display device are stated,
The operation information includes the actual motion track of the relatively described stereoscopic display device of the three-dimensional interaction operation body；
Judge whether the operation information meets preset condition, if meeting the preset condition, trigger in the interaction scenarios
Interactive operation；And
In the interactive operation in triggering the interaction scenarios, force feedback vibration command is sent to the three-dimensional interaction operation body,
So that the three-dimensional interaction operation body carries out force feedback vibrations；
The stereo interaction method further includes：The void shown according to the actual motion Track Pick-up in the stereoscopic display device
Intend the fantasy sport track in operating space,
Wherein, it is described according to the actual motion Track Pick-up in the pseudo operation space that the stereoscopic display device is shown
Fantasy sport track, including：
Set practical operation space；
Obtain the three-dimensional interaction operation body relatively described stereoscopic display device in the practical operation space and move what is formed
The actual motion track；
The actual motion track is subjected to space reflection and generates the fantasy sport track,
Wherein, the setting practical operation space, specifically includes：
Receive the practical operation space that the three-dimensional interaction operation body is sent and instruction is set；
Set and instructed according to the practical operation space, obtain the actual position coordinate of the three-dimensional interaction operation body；
The practical operation space is set according to the actual position coordinate of the three-dimensional interaction operation body.
2. according to the method described in claim 1, it is characterized in that：The operation information further includes the three-dimensional interaction operation body
The operational order sent.
3. according to the method described in claim 2, it is characterized in that：It is described that the actual motion track is subjected to space reflection life
Into the fantasy sport track, specifically include：
Receive the initial position transmitted by the three-dimensional interaction operation body and instruction is set, the initial position sets instruction to be used to set
First position coordinate of the three-dimensional interaction operation body in the practical operation space is put, and the three-dimensional interaction operation body exists
Second place coordinate in pseudo operation space；
According to the first position coordinate and the second place coordinate, the practical operation space and the pseudo operation are established
Mapping relations between space；
According to the mapping relations, the actual motion track is subjected to space reflection and generates the fantasy sport track.
4. according to the method described in claim 3, it is characterized in that：The method further includes：
The scaling instruction that the three-dimensional interaction operation body is sent is received, and obtains the three-dimensional interaction operation body in the actual behaviour
Make the third place coordinate in space；
According to the third place coordinate and the first position coordinate, the practical operation space is reset, and establishes institute
State pseudo operation space and the mapping relations for resetting the practical operation space.
5. according to the method described in claim 3, it is characterized in that：The method further includes：
The lock operation instruction transmitted by the three-dimensional interaction operation body is received, and obtains the locking of the three-dimensional interaction operation body
Position coordinates；
When moving the three-dimensional interaction operation body, and receiving the unlock operational order that the three-dimensional interaction operation body is sent, obtain
Take unlocked position coordinate；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, the reality is reset
Operating space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
6. according to the method described in claim 2, it is characterized in that：It is described to judge whether the operation information meets default bar
Part, if meeting the preset condition, triggers the interactive operation in the interaction scenarios, specifically includes：
Judge whether the practical operation space overlaps with the pseudo operation space, if practical operation space with it is described virtual
Operating space is misaligned, then is the pseudo operation space by the actual motion trajectory map of the three-dimensional interaction operation body
The movement locus of interior virtual cursor, and the movement locus when the virtual cursor and the operation object in the pseudo operation space
The distance between when being less than pre-determined distance, the corresponding operation of the operational order is performed to the operation object.
7. according to the method described in claim 6, it is characterized in that：
If the practical operation space and the pseudo operation space coincidence, when the reality of the three-dimensional interaction operation body
When the distance between operation object in border movement locus and pseudo operation space is less than pre-determined distance, the operation object is held
The corresponding operation of the row operational order.
8. the method according to claim 6 or 7, it is characterised in that：The operational order includes activation instruction, the operation
Object includes the multiple display objects being stacked along the Virtual Space depth direction, and the three-dimensional interaction operation body performs institute
Activation instruction is stated, the display object is operated into line activating.
9. the method according to claim 6 or 7, it is characterised in that：The operational order includes cutting and instructs, the operation
Object is included in the virtual human body tissue in the pseudo operation space, and the three-dimensional interaction operation body performs the cutting and refers to
Order, cutting operation is carried out to the virtual human body tissue.
10. method according to any one of claims 1 to 7, it is characterised in that：Identifying at the three-dimensional interaction operation body
Before the operation information of contactless state, further include：
Establish data communication between the stereoscopic display device and the three-dimensional interaction operation body.
11. stereoscopic display device, for interacting operation with three-dimensional interaction operation body, the stereoscopic display device includes display
Unit, for showing interaction scenarios, it is characterised in that：Further include：
Recognition unit, for identifying that the three-dimensional interaction operation body is in the operation information of contactless state, wherein, it is described non-to connect
Tactile state refers to three-dimensional interaction operation body stereoscopic display device movement relatively, and not with the stereoscopic display device phase
The state of contact, the operation information include the actual motion rail of the relatively described stereoscopic display device of the three-dimensional interaction operation body
Mark；
Interactive unit, for judging whether the operation information meets preset condition, if meeting the preset condition, triggers institute
State the interactive operation in interaction scenarios；And
Force feedback unit, in the interactive operation in triggering the interaction scenarios, being sent to the three-dimensional interaction operation body
Force feedback vibration command, so that the three-dimensional interaction operation body carries out force feedback vibrations；
Wherein, the recognition unit includes：
Practical operation space setup module, refers to for receiving the practical operation space that the three-dimensional interaction operation body is sent and setting
Order, sets according to the practical operation space and instructs, and the actual position coordinate of the three-dimensional interaction operation body is obtained, according to described
The actual position coordinate of three-dimensional interaction operation body sets the practical operation space；
Actual motion track acquisition module, for obtaining the three-dimensional interaction operation body opposite institute in the practical operation space
State the actual motion track that the movement of stereoscopic display device is formed.
12. equipment according to claim 11, it is characterised in that：The operation information further includes the three-dimensional interaction operation
The operational order that body is sent.
13. equipment according to claim 12, it is characterised in that：The interactive unit includes：
Space conversion module, for the pseudo operation shown according to the actual motion Track Pick-up in the stereoscopic display device
Fantasy sport track in space；
Interaction content processing module, for judging whether the operation information meets preset condition,
Alternative events trigger module, for when meeting the preset condition, triggering the interactive operation in the interaction scenarios.
14. equipment according to claim 13, it is characterised in that：The space conversion module, is additionally operable to：
Receive the initial position transmitted by the three-dimensional interaction operation body and instruction is set, the initial position sets instruction to be used to set
First position coordinate of the three-dimensional interaction operation body in the practical operation space is put, and the three-dimensional interaction operation body exists
Second place coordinate in pseudo operation space；
According to the first position coordinate and the second place coordinate, the practical operation space and the pseudo operation are established
Mapping relations between space；
According to the mapping relations, the actual motion track is subjected to space reflection and generates the fantasy sport track.
15. equipment according to claim 14, it is characterised in that：The space conversion module, is additionally operable to:
The scaling instruction that the three-dimensional interaction operation body is sent is received, and obtains the three-dimensional interaction operation body in the actual behaviour
Make the third place coordinate in space；
The practical operation space is reset according to the third place coordinate and the first position coordinate, and described in foundation
Pseudo operation space and the mapping relations for resetting the practical operation space.
16. equipment according to claim 14, it is characterised in that：The space conversion module, is additionally operable to：
The lock operation instruction transmitted by the three-dimensional interaction operation body is received, and obtains the locking of the three-dimensional interaction operation body
Position coordinates；And unlock operational order transmitted during the mobile three-dimensional interaction operation body is received, obtain unlocked position and sit
Mark；
According to the first position coordinate, the latched position coordinate and the unlocked position coordinate, the reality is reset
Operating space, and establish the pseudo operation space and the mapping relations for resetting the practical operation space.
17. equipment according to claim 13, it is characterised in that：The interaction content processing module includes：
First judging submodule, for judging whether the practical operation space overlaps with the pseudo operation space, such as fruit
Border operating space and the pseudo operation space are misaligned, then reflect the actual motion track of the three-dimensional interaction operation body
Penetrate as the movement locus of virtual cursor in the pseudo operation space；
Second judgment submodule, for the actual motion track for judging the three-dimensional interaction operation body or the pseudo operation
Whether the distance between operation object in space in the movement locus of virtual cursor and pseudo operation space is less than pre-determined distance.
18. the equipment according to any one of claim 14 to 17, it is characterised in that：The operational order refers to including activation
Order, the operation object include the multiple display objects being stacked along the Virtual Space depth direction, the alternative events
Trigger module is specifically used for：The activation instruction is performed, the display object is operated into line activating.
19. the equipment according to any one of claim 14 to 17, it is characterised in that：The operational order refers to including cutting
Order, the operation object are included in the virtual human body tissue in the pseudo operation space, the alternative events trigger module tool
Body is used for：The cutting instruction is performed, cutting operation is carried out to the virtual human body tissue.
20. the equipment according to any one of claim 11 to 17, it is characterised in that：The equipment further includes：
Communication unit, for establishing data communication between the stereoscopic display device and the three-dimensional interaction operation body.
21. Three-dimensional interaction system, it is characterised in that：It is any one including three-dimensional interaction operation body, and in such as claim 11 to 20
The item stereoscopic display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510147807.2A CN106155281B (en) | 2015-03-31 | 2015-03-31 | Stereo interaction method, stereoscopic display device and its system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510147807.2A CN106155281B (en) | 2015-03-31 | 2015-03-31 | Stereo interaction method, stereoscopic display device and its system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106155281A CN106155281A (en) | 2016-11-23 |
| CN106155281B true CN106155281B (en) | 2018-05-01 |
Family
ID=57338065
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510147807.2A Expired - Fee Related CN106155281B (en) | 2015-03-31 | 2015-03-31 | Stereo interaction method, stereoscopic display device and its system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106155281B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106951087B (en) * | 2017-03-27 | 2020-02-21 | 联想(北京)有限公司 | Interaction method and device based on virtual interaction plane |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102591550A (en) * | 2011-01-04 | 2012-07-18 | 中国移动通信集团公司 | Zoom control method and device of terminal interface contents |
| CN103246351A (en) * | 2013-05-23 | 2013-08-14 | 刘广松 | User interaction system and method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103456223A (en) * | 2012-06-01 | 2013-12-18 | 苏州敏行医学信息技术有限公司 | Laparoscopic surgery simulation system based on force feedback |
-
2015
- 2015-03-31 CN CN201510147807.2A patent/CN106155281B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102591550A (en) * | 2011-01-04 | 2012-07-18 | 中国移动通信集团公司 | Zoom control method and device of terminal interface contents |
| CN103246351A (en) * | 2013-05-23 | 2013-08-14 | 刘广松 | User interaction system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106155281A (en) | 2016-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10764565B2 (en) | Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method | |
| US7259771B2 (en) | Image processing system, image processing apparatus, and display apparatus | |
| JP6057396B2 (en) | 3D user interface device and 3D operation processing method | |
| US10996757B2 (en) | Methods and apparatus for generating haptic interaction for virtual reality | |
| JP6629499B2 (en) | Program and image generation device | |
| CN105912110A (en) | Method, device and system for performing target selection in virtual reality space | |
| CN109313502B (en) | Tap event location using selection device | |
| US20180247463A1 (en) | Information processing apparatus, information processing method, and program | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| CN106919294A (en) | A kind of 3D touch-controls interactive device, its touch-control exchange method and display device | |
| WO2003010653A1 (en) | A computerized portable handheld means | |
| KR101441882B1 (en) | method for controlling electronic devices by using virtural surface adjacent to display in virtual touch apparatus without pointer | |
| US20210304509A1 (en) | Systems and methods for virtual and augmented reality | |
| KR20190078475A (en) | Virtual reality control system | |
| WO2013074989A1 (en) | Pre-button event stylus position | |
| CN107102750B (en) | The selection method of target in a kind of virtual three-dimensional space based on pen type interactive system | |
| GB2451461A (en) | Camera based 3D user and wand tracking human-computer interaction system | |
| JPH07253773A (en) | Three dimentional display device | |
| CN106155281B (en) | Stereo interaction method, stereoscopic display device and its system | |
| JP2007506164A (en) | Method and apparatus for controlling a virtual reality graphics system using interactive technology | |
| US20240103606A1 (en) | Systems and methods for object interactions | |
| TWI796022B (en) | Method for performing interactive operation upon a stereoscopic image and system for displaying stereoscopic image | |
| RU2406150C2 (en) | Method and system for viewing virtual three-dimensional objects | |
| KR20100004438A (en) | Method for handling 3d object | |
| JP6739539B2 (en) | Information processing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180711 Address after: 518000 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong Patentee after: SUPERD Co.,Ltd. Address before: 518053 East Guangdong H-1 East 101, overseas Chinese town, Nanshan District, Shenzhen. Patentee before: SHENZHEN SUPER PERFECT OPTICS Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180501 |