CN102508562A - Three-dimensional interaction system - Google Patents
Three-dimensional interaction system Download PDFInfo
- Publication number
- CN102508562A CN102508562A CN2011103435980A CN201110343598A CN102508562A CN 102508562 A CN102508562 A CN 102508562A CN 2011103435980 A CN2011103435980 A CN 2011103435980A CN 201110343598 A CN201110343598 A CN 201110343598A CN 102508562 A CN102508562 A CN 102508562A
- Authority
- CN
- China
- Prior art keywords
- hook stick
- unit
- dimensional
- screen
- hook
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 21
- 230000006698 induction Effects 0.000 claims abstract description 109
- 238000012545 processing Methods 0.000 claims abstract description 35
- 238000004891 communication Methods 0.000 claims abstract description 28
- 238000004364 calculation method Methods 0.000 claims abstract description 14
- 238000007373 indentation Methods 0.000 claims description 160
- 210000003128 head Anatomy 0.000 claims description 88
- 230000002452 interceptive effect Effects 0.000 claims description 29
- 230000008859 change Effects 0.000 claims description 26
- 238000009877 rendering Methods 0.000 claims description 26
- 238000004088 simulation Methods 0.000 claims description 14
- 230000033001 locomotion Effects 0.000 claims description 11
- 238000012360 testing method Methods 0.000 claims description 8
- 230000009471 action Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000009434 installation Methods 0.000 claims description 4
- 230000008447 perception Effects 0.000 claims description 3
- 238000001514 detection method Methods 0.000 abstract description 10
- 230000003287 optical effect Effects 0.000 abstract 3
- 238000000034 method Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 5
- 239000007787 solid Substances 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000005684 electric field Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 210000003205 muscle Anatomy 0.000 description 1
- 210000000518 sarcolemma Anatomy 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 238000010977 unit operation Methods 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention relates to a three-dimensional interaction system, which comprises operated equipment and an operating rod, wherein the operated equipment comprises an induction screen which can display a three-dimensional image of an operated unit, an interaction control device, a communication device for realizing information interaction between the interaction control device and the operating rod, and an image processing device. The interaction control device comprises a first position determination unit and a virtual touch detection unit, wherein the first position determination unit is used for determining a three-dimensional position of a touch part of the operating rod; and the virtual touch detection unit is used for judging whether the operating rod is in virtual touch with the operated unit in real time, and if yes, an optical parallax adjustment unit in the image processing device is activated. The image processing device comprises a depth calculation unit and the optical parallax adjustment unit, wherein the depth calculation unit is used for determining the depth of the surface of the operated unit relative to the induction screen, and informing the virtual touch detection unit; and the optical parallax adjustment unit is used for simulating depth variation of the operated unit when the operated unit is pressed. According to the invention, the three-dimensional interaction showed by combining three-dimensional display is realized, and a user can gain more sense of reality.
Description
Technical field
The present invention relates to three-dimensional interaction technique, relate in particular to a kind of three-dimensional interactive system.
Background technology
The various solutions of present man-machine interactive system mostly are based on the basis that 2D shows, that is to say that the direct display effect that user's operation is brought represents with 2D.Further, adopt shade, the nearly far away little sensation that waits transparent effect to come a kind of solid of approximate simulation.
Along with the development of 3D display technique, this display interface based on 2D will bring a series of operating result that does not meet convention.Because 3D brings operator's display effect directly perceived, all operation interfaces are protrusions, perhaps, and recessed screen.The finger of at present commonplace touch-screen or operating pen all can only carry out the operation of two dimension on screen; For real 3D operation interface; Float over the interface of aerial or recessed screen, this traditional mode all can let the operator feel really not touch actual interface.
Though being arranged in present virtual reality (VR) technology, data glove utilized etc. goes the technology that the object in the space is operated.But the realization of this technology is complicated, such as needing the very high data glove of precision, can sometimes also need special Reality Head-mounted Displays could shield the interference of actual environment to virtual environment to the computer system of whole Virtual Space modeling.Correspondingly, the user uses inconvenience, and cost is also quite expensive.Therefore at a lot of equipment particularly on the mobile device and be not suitable for using.
Summary of the invention
The technical matters that the present invention will solve provides a kind of hook stick that combines stereo display to simulate and use when three-dimensional mutual.
In order to address the above problem, the invention provides a kind of hook stick, comprise shell, also comprise:
The telescopic head that is connected with said shell with telescopic mode;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment; And
Positioning unit is used for position and/or the attitude of real-time detecting operation rod in the space, and sends detected three dimensional local information to the communication unit transmission.
Preferably, this hook stick also comprises:
Flexible sensing unit is used for the indentation length of real-time detecting operation rod telescopic head and sends the information of detected indentation length to communication unit sending.
Preferably, this hook stick also comprises:
The force feedback unit, the force feedback that is used for receiving according to said communication unit is instructed, and carries out the action of analog force feedback.
Preferably,
Said positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in the reference system that with plane, display screen place is benchmark under the hook stick original state.
Preferably,
Said telescopic head comprises the operation caput and is resisted against the elastomeric element between this operation caput and the flexible induction installation;
Said flexible sensing unit adopts pressure sensing mode to realize, is used to respond to the pressure of said elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
Preferably,
Said force feedback unit adopts electro-mechanical device to realize, is used for after receiving the force feedback instruction, simulating vibrations that are pressed by operating unit really.
Preferably,
Said telescopic head is a tip away from an end of shell.
The hook stick that such scheme provided possesses positioning unit and telescopic head; Can know the locus and the attitude of hook stick; Thereby can obtain simulation needed various parameters when three-dimensional mutual; And can indentation take place behind contact screen, make touch control operation let the user feel the more sense of reality.
The another technical matters that the present invention will solve provides and a kind ofly can combine stereo display to simulate three-dimensional mutual three-dimensional exchange method and accordingly by operating equipment.
In order to address the above problem, the invention provides a kind of three-dimensional exchange method, be used on by operating equipment simulation hook stick to stereo display on the induction screen by the operation of operating unit, this solid exchange method comprises:
According to being confirmed by the degree of depth of operating unit surface with respect to screen by the parallax of the stereo-picture of operating unit;
Confirm the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; The three-dimensional position of compare operation rod contact site with shown by the three-dimensional position on operating unit surface, the real-time judge hook stick whether with virtual touching taken place by operating unit;
Touch by operating unit like the decision operation rod, through to by the parallax of the stereo-picture of operating unit adjustment, the change in depth when simulation is pressed by operating unit.
Preferably,
The three-dimensional position of said hook stick contact site and all adopted relative coordinate to represent by the three-dimensional position on operating unit surface, this relative coordinate is that reference system is confirmed with plane, induction screen place.
Preferably,
The three dimensional local information of the hook stick contact site that said basis is obtained is in real time confirmed the three-dimensional position of hook stick contact site; Comprise: at least when said hook stick does not touch said induction screen; The three-dimensional position of said hook stick contact site obtains according to the three-dimensional coordinate information of the hook stick contact site that receives; Perhaps, obtain according to the azimuth information of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and contact site intrinsic distance calculation to this another position.
Preferably,
The three dimensional local information of the hook stick contact site that said basis is obtained is in real time confirmed the three-dimensional position of hook stick contact site; Comprise: when said hook stick touched said induction screen, the three-dimensional position of said hook stick contact site calculated according to the indentation length of hook stick head, the position angle of hook stick and the touch location of hook stick and induction screen.
Preferably, the indentation length of said hook stick head is obtained by following mode in real time:
The information of the indentation length of sending according to said hook stick is confirmed; Perhaps
Pressure sensitive Device Testing result according on the said induction screen calculates; Perhaps
Confirm the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, calculate the indentation length of said hook stick head then.
Preferably,
Said passing through to being adjusted by the parallax of the stereo-picture of operating unit, the change in depth when simulation is pressed by operating unit comprises:
With the hook stick contact site that obtains in real time with respect to the degree of depth of screen as by the degree of depth on operating unit surface, and adjust by the parallax of operating unit on stereo-picture according to this degree of depth.
Preferably,
Touch by operating unit like the decision operation rod, saidly also sent the force feedback instruction to said hook stick by operating equipment.
Preferably,
After the decision operation rod touched by operating unit, also according to by the change in depth on operating unit surface, whether the decision operation rod had been accomplished by the clicking operation of operating unit, in this way, then generates this is ordered by the click of operating unit.
Correspondingly, the present invention also provide in a kind of three-dimensional interactive system by operating equipment, comprise the induction screen, communicator and image processing apparatus, it is characterized in that, also comprise mutual control device, wherein:
Said induction screen is used to show the stereo-picture by operating unit;
Said communicator is used to realize the information interaction between mutual control device and the hook stick;
Said mutual control device comprises:
Position determination unit is used for confirming according to the three dimensional local information of the hook stick contact site that obtains in real time the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches; Be used for according to the three-dimensional position of hook stick contact site with shown by the three-dimensional position on operating unit surface; Whether with by operating unit virtual touching take place in the real-time judge hook stick, in this way, activates the parallax adjustment unit in the image processing apparatus;
Said image processing apparatus comprises:
The depth calculation unit is used for according to definite by the degree of depth of operating unit surface with respect to the induction screen by the parallax of the stereo-picture of operating unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for through to by the parallax of the stereo-picture of operating unit adjustment the change in depth when simulation is pressed by operating unit.
Preferably,
Said position determination unit is confirmed the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick does not touch said induction screen, obtain the three-dimensional position of said hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site obtains said hook stick contact site to the intrinsic distance calculation at this another position the three-dimensional position at another position on the hook stick that receives.
Preferably,
Said mutual control device also comprises: the actual detecting unit that touches is used for after detecting hook stick and touching screen, with detected touch location notice position determination unit;
Said position determination unit is confirmed the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick touches said induction screen, calculate the three-dimensional position of said hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
Preferably,
Said position determination unit is calculated the indentation length of the said hook stick head that the three-dimensional position of said hook stick contact site uses and is obtained in real time by following mode:
The information of the indentation length of sending according to said hook stick is confirmed; Perhaps
Pressure sensitive Device Testing result according on the said induction screen calculates; Perhaps
Confirm the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, calculate the indentation length of said hook stick head then.
Preferably,
Said parallax adjustment unit passes through being adjusted by the parallax of the stereo-picture of operating unit; Change in depth when simulation is pressed by operating unit; Comprise: the hook stick contact site that will obtain in real time, and is adjusted by the parallax of operating unit on stereo-picture according to this degree of depth as by the degree of depth on operating unit surface with respect to the degree of depth of screen.
Preferably,
The said virtual detecting unit that touches is after the decision operation rod touches by operating unit; Also according to by the change in depth on operating unit surface; Whether the decision operation rod has been accomplished by the clicking operation of operating unit, in this way, then generates this is ordered by the click of operating unit.
Preferably,
Said virtual when touching detecting unit real-time judge hook stick and touching by operating unit, also send the force feedback instruction to said hook stick through said communicator.
Preferably,
Said is smart mobile phone or panel computer by operating equipment.
Such scheme can the simulated operation rod to stereo display on the induction screen by the operation of operating unit, let the user feel the more sense of reality, hook stick of being experienced and screen meet reality alternately more.
The another technical matters that the present invention will solve provides another kind and can combine stereo display to simulate three-dimensional mutual three-dimensional exchange method and accordingly by operating equipment.
In order to address the above problem, the invention provides a kind of three-dimensional exchange method, be used on by operating equipment, stretching into the operation of responding to screen through stereo display simulated operation rod, this solid exchange method comprises:
Whether the detecting operation rod touches said induction screen;
When hook stick touched said induction screen, three dimensional local information and hook stick and the touch location of responding to screen according to the hook stick indentation part of obtaining in real time calculated said hook stick indentation virtual three-dimensional position partly;
According to the virtual three-dimensional position of hook stick indentation part, the image of real-time rendering hook stick indentation part, and this image that will draw is presented on the said induction screen.
Preferably,
The three dimensional local information of the hook stick indentation part that said basis is obtained in real time calculates the virtual three-dimensional position of hook stick indentation part, comprising:
According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate virtual three-dimensional position more at least on the hook stick indentation part; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably, the indentation length of said hook stick head is obtained by following mode in real time:
The information of the indentation length of sending according to said hook stick is confirmed; Perhaps
Pressure sensitive Device Testing result according on the said induction screen calculates; Perhaps
Confirm the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, calculate the indentation length of said hook stick head then.
Preferably,
The three dimensional local information of the hook stick indentation part that said basis is obtained in real time calculates the virtual three-dimensional position of hook stick indentation part, comprising:
Three dimensional local information according to the hook stick of real-time reception; Obtain or calculate the three-dimensional position of hook stick contact site; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly.
Preferably,
The image of the hook stick indentation part of said real-time rendering is a stereo-picture; This stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera; To respond to screen as the parallax free face, draw out the left image and the right image of said hook stick indentation part.
Preferably,
The three-dimensional position that uses in the said three-dimensional exchange method adopts the relative coordinate of confirming as reference system with plane, induction screen place to represent.
Correspondingly, the present invention also provide in a kind of three-dimensional interactive system by operating equipment, comprise the induction screen, communicator and image processing apparatus, it is characterized in that, also comprise mutual control device, wherein:
Said induction screen is used to show the stereo-picture by operating unit;
Said communicator is used to realize the information interaction between mutual control device and the hook stick;
Said mutual control device comprises:
Position determination unit is used for the touch location according to three dimensional local information and the hook stick and the induction screen of the hook stick indentation part of obtaining in real time, calculates the virtual three-dimensional position of hook stick indentation part;
The actual detecting unit that touches is used for touching induction during screen detecting hook stick, activates the image rendering unit in the image processing apparatus, and with the touch location notice position determination unit of hook stick and induction screen;
Said image processing apparatus comprises:
The image rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the said induction screen.
Preferably,
Said position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate virtual three-dimensional position more at least on the hook stick indentation part; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
Said position determination unit is obtained the indentation length of said hook stick head in real time by following mode:
The information of the indentation length of sending according to said hook stick is confirmed; Perhaps
Pressure sensitive Device Testing result according on the said induction screen calculates; Perhaps
Confirm the degree of depth of hook stick contact site and the angle of hook stick and induction screen according to the three-dimensional position of this hook stick that receives and the information of attitude, calculate the indentation length of said hook stick head then.
Preferably,
Said position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
Three dimensional local information according to the hook stick of real-time reception; Obtain or calculate the three-dimensional position of hook stick contact site; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The image of the hook stick indentation part of said image rendering unit real-time rendering is a stereo-picture; This stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera; To respond to screen as the parallax free face, draw out the left image and the right image of said hook stick indentation part.
Preferably,
Said is smart mobile phone or panel computer by operating equipment.
Such scheme can stretch into the operation of induction screen through stereo display simulated operation rod, lets the user feel the more sense of reality, hook stick of being experienced and screen meet reality alternately more.
Another technical matters that the present invention will solve provides a kind of three-dimensional interactive system that can let the user feel that the combination stereo display of more senses of reality is represented.
In order to address the above problem, the invention provides a kind of three-dimensional interactive system, comprise by operating equipment and hook stick;
Can show by the induction screen of the stereo-picture of operating unit, mutual control device, be used to realize the communicator of information interaction between mutual control device and the hook stick and image processing apparatus said being comprised by operating equipment;
Said mutual control device comprises:
Primary importance is confirmed the unit, is used for confirming according to the three dimensional local information of the hook stick contact site that obtains in real time the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches; Be used for according to the three-dimensional position of hook stick contact site with shown by the three-dimensional position on operating unit surface; Whether with by operating unit virtual touching take place in the real-time judge hook stick, in this way, activates the parallax adjustment unit in the image processing apparatus;
Said image processing apparatus comprises:
The depth calculation unit is used for according to definite by the degree of depth of operating unit surface with respect to the induction screen by the parallax of the stereo-picture of operating unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for through to by the parallax of the stereo-picture of operating unit adjustment the change in depth when simulation is pressed by operating unit.
Preferably, said hook stick comprises:
Positioning unit is used for position and/or the attitude of real-time detecting operation rod in the space, and sends detected three dimensional local information to the communication unit transmission;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment;
Said primary importance confirms that the three dimensional local information of the hook stick contact site that the unit obtains in real time is that positioning unit in the said hook stick sends.
Preferably,
Said positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in the reference system that with plane, display screen place is benchmark under the hook stick original state.
Preferably, said three-dimensional interactive system also comprises:
Positioning auxiliary device is used for the three-dimensional position of real-time perception hook stick with respect to the induction screen, and the information of the three-dimensional position that perceives is sent to said primary importance confirms the unit.
Preferably,
Said primary importance confirms that the unit confirms the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick does not touch said induction screen, obtain the three-dimensional position of said hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site obtains said hook stick contact site to the intrinsic distance calculation at this another position the three-dimensional position at another position on the hook stick that receives.
Preferably,
Said mutual control device also comprises: the actual detecting unit that touches, be used for after detecting hook stick and touching screen, and detected touch location notice primary importance is confirmed the unit;
Said primary importance confirms that the unit confirms the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick touches said induction screen, calculate the three-dimensional position of said hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
Preferably,
Said primary importance confirms that the unit calculates the indentation length of the said hook stick head that the three-dimensional position of said hook stick contact site uses; Be that the information of three-dimensional position and the attitude of this hook stick of sending according to hook stick or positioning auxiliary device is confirmed the degree of depth and the hook stick of hook stick contact site and responded to the angle of screen, calculate the indentation length of said hook stick head then.
Preferably,
Said parallax adjustment unit passes through being adjusted by the parallax of the stereo-picture of operating unit; Change in depth when simulation is pressed by operating unit; Comprise: the hook stick contact site that will obtain in real time, and is adjusted by the parallax of operating unit on stereo-picture according to this degree of depth as by the degree of depth on operating unit surface with respect to the degree of depth of screen.
Preferably,
The said virtual detecting unit that touches is after the decision operation rod touches by operating unit; Also according to by the change in depth on operating unit surface; Whether the decision operation rod has been accomplished by the clicking operation of operating unit, in this way, then generates this is ordered by the click of operating unit.
Preferably,
Said hook stick comprises:
The force feedback unit, the force feedback that is used for receiving according to said communication unit is instructed, and carries out the action of analog force feedback;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment;
Said virtual when touching detecting unit real-time judge hook stick and touching by operating unit, also send the force feedback instruction to said hook stick through said communicator.
Preferably,
Said hook stick comprises a telescopic head;
Said mutual control device also comprises:
The second place is confirmed the unit, is used for the touch location according to three dimensional local information and the hook stick and the induction screen of the hook stick indentation part of obtaining in real time, obtains the virtual three-dimensional position of hook stick indentation part;
The actual detecting unit that touches is used for touching induction during screen detecting hook stick, activates the image rendering unit in the image processing apparatus, and the touch location notice second place of hook stick and induction screen is confirmed the unit;
Said image processing apparatus also comprises:
The image rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the said induction screen.
Preferably,
The said second place confirms that the unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate virtual three-dimensional position more at least on the hook stick indentation part; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The indentation length of the hook stick head that uses when the said second place is confirmed the virtual three-dimensional position of unit calculating operation rod indentation part obtains by following mode: confirm the degree of depth and the hook stick of hook stick contact site and respond to the angle of screen according to the information of the three-dimensional position of this hook stick that receives and attitude, calculate the indentation length of said hook stick head then.
Preferably,
Said hook stick comprises:
Telescopic head;
Flexible sensing unit is used for the indentation length of real-time detecting operation rod telescopic head and sends the information of detected indentation length to communication unit sending;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment.
Preferably,
Said telescopic head comprises the operation caput and is resisted against the elastomeric element between this operation caput and the flexible induction installation;
Said flexible sensing unit adopts pressure sensing mode to realize, is used to respond to the pressure of said elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
Preferably,
Said hook stick comprises telescopic head;
Said induction screen surface has been set up a pressure sensitive device, and the pressure when being used for detecting operation rod and touching with the induction screen also sends to mutual control device with testing result, and this pressure is corresponding with the indentation length of hook stick head.
Preferably,
Said position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
Three dimensional local information according to the hook stick of real-time reception; Obtain or calculate the three-dimensional position of hook stick contact site; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
Preferably,
The image of the hook stick indentation part of said image rendering unit real-time rendering is a stereo-picture; This stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera; To respond to screen as the parallax free face, draw out the left image and the right image of said hook stick indentation part.
Preferably,
Said is smart mobile phone or panel computer by operating equipment.
Preferably,
The head of said hook stick is a tip away from an end of shell, and this tip has constituted said hook stick contact site.
Such scheme use a kind of special hook stick combine to have accordingly three-dimensional display function by operating equipment; Realized that a kind of solid that combines stereo display to show is mutual; Let the user feel the more sense of reality, the hook stick of being experienced with met reality alternately more by operating unit.
Description of drawings
Fig. 1 is the synoptic diagram of the embodiment of the invention to the touch control operation of the button of protrusion screen;
Fig. 2 is the synoptic diagram of the embodiment of the invention to the touch control operation of the button of recessed screen;
Fig. 3 a is the structural representation of the embodiment of the invention one hook stick;
Fig. 3 b is the connection synoptic diagram of each unit in the embodiment of the invention one hook stick;
Fig. 4 is that the embodiment of the invention one is by the structural representation of operating equipment;
Fig. 5 is the processing flow chart of being operated by the touching of operating unit of a pair of stereo display on screen of the embodiment of the invention;
Fig. 6 a and Fig. 6 b are the synoptic diagram of relation of parallax and the degree of depth of pixel;
Fig. 7 is the embodiment of the invention one stretches into the operation of induction screen through stereo display simulated operation rod a processing flow chart;
Fig. 8 is the synoptic diagram through the indentation length of the rod of the pressure sensitive device detecting operation on the screen.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, hereinafter will combine accompanying drawing that embodiments of the invention are elaborated.Need to prove that under the situation of not conflicting, embodiment among the application and the characteristic among the embodiment be combination in any each other.
Embodiment one
As depicted in figs. 1 and 2, three-dimensional interactive system of the present invention comprises hook stick and by operating equipment, this is comprised the induction screen that can carry out stereo display by operating equipment, as is smart mobile phone, panel computer etc.The operating unit (with the button is example, also can be button or other icons) of responding to screen (being designated hereinafter simply as screen) but going up stereo display possibly be protrusion and recessed screen In the view of the user.For be shown as the protrusion screen carried out touch control operation by operating unit the time; In order to let the user feel the more sense of reality; Reach by the operating unit surface at the head of hook stick, when virtual touching promptly taken place, can simulate this visible change when being pressed by operating unit; Simultaneously can also give the certain force feedback of user, make hook stick that the user experiences being met reality more by the touch-control of operating unit.And for be shown as recessed screen carried out touch control operation by operating unit the time; The head of hook stick reaches by before the operating unit surface will touch screen; In order to let the user feel the more sense of reality; Can be telescopic, draw the indentation part and the stereo display on screen of hook stick, calculate the three-dimensional position of this head when flexible simultaneously the head design of hook stick; Judge whether virtual touching can be taken place, take place to adopt above-mentioned identical mode to carry out being handled after virtual the touching by the servo-actuated demonstration of operating unit and force feedback.
In the literary composition, three dimensional local information can be three-dimensional position or any information such as attitude, indentation length etc. that are used for the Calculation of Three Dimensional position.Three-dimensional position can be represented like x with three-dimensional coordinate, y, z coordinate or the polar coordinates of representing with length and position angle.It is that reference system is confirmed that the coordinate of expression three-dimensional position can be responded to plane, screen place, promptly is the relative coordinate with respect to the induction screen.With the smart mobile phone is example, can but be not limited to the mid point of screen or certain end points as true origin, the direction of normal to screen is the Z axle, the plane that the plane at screen place is represented for the XY coordinate axis.
The synoptic diagram that please is connected with each unit shown in Fig. 3 b with reference to the structural representation shown in Fig. 3 a, this hook stick comprises shell 101, telescopic head 102, communication unit 103, positioning unit 104, force feedback unit 105 and flexible sensing unit 106, wherein:
The aforesaid operations rod can also comprise like servicing units such as battery, charging devices, introduces no longer one by one here.
As shown in Figure 4, comprised induction screen 10, communicator 20 and image processing apparatus 30 by operating equipment.Wherein:
Mutual control device 30 comprises:
Primary importance is confirmed unit 301, is used for confirming according to the three dimensional local information of the hook stick contact site that obtains in real time the three-dimensional position of hook stick contact site., can obtain not during contact screen at said hook stick according to the three-dimensional coordinate information of the hook stick contact site that receives; Perhaps, obtain according to the azimuth information of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and contact site intrinsic distance calculation to this another position.When the hook stick contact screen; Can calculate according to the indentation length of hook stick head, the position angle of hook stick and the touch location of hook stick and induction screen; Wherein, the information of the indentation length that can send according to hook stick again of the indentation length of hook stick head is confirmed.Need to prove that before hook stick touched screen, the three-dimensional position of hook stick contact site was a physical location, after hook stick touched screen, the three-dimensional position of hook stick contact site was a virtual location, and other places no longer specify in the literary composition.
The virtual detecting unit 302 that touches; Be used for according to the three-dimensional position of hook stick contact site with shown by the three-dimensional position on operating unit surface; Whether with by operating unit virtual touching take place in the real-time judge hook stick; In this way, activate the parallax adjustment unit in the image processing apparatus, and can send the force feedback instruction to hook stick through communicator.In addition, can also be according to by the change in depth on operating unit surface, whether the decision operation rod has been accomplished by the clicking operation of operating unit, in this way, then generates this is ordered by the click of operating unit.
The actual detecting unit 303 that touches is used for when detecting hook stick contact induction screen, activates the image rendering unit in the image processing apparatus, and the touch location notice primary importance of hook stick and induction screen is confirmed that the unit and the second place confirm the unit.
The second place is confirmed unit 304, is used for the three-dimensional position according to the hook stick contact site, and binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
The touch location of the three dimensional local information of the hook stick indentation part of obtaining in real time and hook stick and induction screen calculates hook stick indentation virtual three-dimensional position partly.For example; According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate on the hook stick indentation part virtual three-dimensional position of (like contact site) more at least; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Wherein, the virtual three-dimensional position of contact site also can obtain or calculate according to the three-dimensional position of the hook stick that obtains in real time and the information of attitude; The indentation length of hook stick head is confirmed according to the information of the indentation length that hook stick is sent.
Image processing apparatus 40 comprises again:
Above-mentioned image processing apparatus possibly also need carry out other Flame Image Process to wanting stereoscopic images displayed, only the unit relevant with present embodiment is described here.
Introduce the treatment scheme of by the touching of operating unit being operated of hook stick below to stereo display on screen, as shown in Figure 5, comprising:
Step 310 is according to being confirmed by the degree of depth of operating unit surface with respect to screen by the parallax of the stereo-picture of operating unit;
Present embodiment is the parallax formation stereo display effect through left image and right image in the stereo-picture.Fig. 6 a and Fig. 6 b are respectively that the pixel P with parallax d shows as synoptic diagram recessed and the protrusion screen when stereo display; Wherein, What parallax d was pixel P at the left image of stereo-picture and the coordinate on the right image is poor; According to the parallax d of pixel and the three-dimensional position of user's images of left and right eyes, just can calculate pixel P easily is vertical range with respect to the degree of depth of screen.The degree of depth just can got when being protruded by the relative screen of operating unit, can get negative, perhaps opposite when recessed.
The spacing of user's images of left and right eyes and viewing location can be set with reference to the empirical value of this area, no longer go through here.If the head tracking device is arranged, also can use the three-dimensional position of following the tracks of detected images of left and right eyes to come dynamically to calculate parallax, more accurate.
Because by the position of operating unit surface on screen is known, this step is confirmed to have been obtained by the three-dimensional position on operating unit surface by after the degree of depth of the relative screen in operating unit surface.
Step 320 is confirmed the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time;
The three dimensional local information of the hook stick contact site that hook stick sends can be the three-dimensional coordinate of hook stick contact site in the space, also can be other information that can extrapolate this three-dimensional coordinate.At hook stick not during contact screen; The three-dimensional position of hook stick contact site can obtain according to the three-dimensional coordinate information of the hook stick contact site that receives; Perhaps, obtain according to the azimuth information (like angle and the projection of hook stick on screen and the angle of X axle or Y axle of hook stick and screen) of the three-dimensional coordinate information at another position on the hook stick that receives, hook stick and contact site intrinsic distance calculation to this another position.This calculating can be accomplished in the positioning unit of hook stick, also can in by operating equipment, accomplish.
During the hook stick contact screen, also can adopt the mode of epimere to confirm the three-dimensional position of hook stick contact site.Because behind the hook stick contact screen; There are the touch location of hook stick and screen and the parameters such as indentation length of hook stick head to use; Therefore can be according to the three-dimensional position of the excellent contact site of touch location calculating operation of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen, the result is more accurate.Wherein, the information of the indentation length that can send according to said hook stick of the indentation length of hook stick head is confirmed.
Usually, think that virtual touching taken place for both at the three-dimensional position of hook stick contact site when being overlapped or passing through by the three-dimensional position on operating unit surface.
Step 340 through the change in depth when being pressed by the operating unit surface by the adjustment simulation of the parallax of the stereo-picture of operating unit, and is sent the force feedback instruction to hook stick.
In this step; Can also be according to by the change in depth on operating unit surface; Whether the decision operation rod has been accomplished by the clicking operation of operating unit (some button be depressed certain position then just be regarded as choosing), in this way, then generates this is ordered by the click of operating unit.
In this step; Can be with the hook stick contact site that obtains in real time with respect to the degree of depth of screen as by the degree of depth on operating unit surface; And adjust by the parallax of operating unit on stereo-picture according to this degree of depth, handle as this pixel coordinate by operating unit on left image and/or the left image being carried out translation.What demonstrate can be simulated the change in depth when being pressed by operating unit by operating unit.In another embodiment,, can simplify the demonstration of pilot process, the stereo-picture when directly demonstration is pressed stop position by operating unit if indentation length is less.In another embodiment, can also show one by one by the be pressed stereo-picture of stop position and middle some positions of operating unit.
, be the processing flow chart that stretches into the operation of induction screen through stereo display simulated operation rod please, comprise with reference to Fig. 7:
Step 420 according to the three dimensional local information of the hook stick indentation part of obtaining in real time and the touch location of hook stick and induction screen, calculates the virtual three-dimensional position of hook stick indentation part;
During the virtual three-dimensional position of calculating operation rod indentation part; Can be according to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate on the hook stick indentation part virtual three-dimensional position of (like contact site) more at least; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Also can be according to the three dimensional local information of the hook stick of real-time reception; Obtain or calculate the three-dimensional position of hook stick contact site; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly.Wherein, the information of the indentation length that can send according to said hook stick of the indentation length of hook stick head is confirmed.
When drawing, the three-dimensional position of images of left and right eyes will be responded to screen as the parallax free face as left and right camera in the time of can the user who set or tracking obtains being watched screen, can draw out the left and right sides image of this indentation part respectively.Accomplish after this step, screen is the stereo-picture of display operation rod indentation part, make the user look to seem hook stick really to visit into screen, strengthened the three-dimensional sense of reality when mutual of user.
Can find out that from such scheme present embodiment has been realized a kind of touch control operation that combines stereo display to show.In order to let the user feel the more sense of reality, and hook stick of being experienced and screen meet reality alternately more, in hook stick, be provided with the positioning unit that hook stick is carried out motion detection, in real time the position and the attitude of detecting operation rod.Please refer again to shown in Figure 1; For the button that is shown as the protrusion screen; Also there is not contact screen but human eye perceives during contact screen at hook stick; Detect the demonstration of knowing and change this button through virtual touching, make it seem really to be pressed, can award user's sense of touch through the force feedback unit simultaneously.And for the button that is shown as recessed screen; Please refer again to Fig. 2, at hook stick contact screen but human eye perceives when also not contacting button, the hook stick head can carry out indentation automatically along with operator's action; And send the information of indentation length to terminal device; Terminal device is drawn out the stereo-picture of this indentation part and is shown that on screen the user feels as if that this hook stick really stretches into screen and goes click keys the same, simultaneously when hook stick is made other actions; Such as move left and right, the pseudo operation rod also will move simultaneously.Stretch into behind the screen can through virtual touch to detect learn that hook stick point has suffered button, then can parallax be adjusted and the processing of force feedback to being undertaken by operating unit.
As the example of the change after simplification of present embodiment, can cancel and the force feedback related content, the force feedback unit is not set in hook stick, in by operating equipment, do not carry out relevant treatment yet.Other embodiment herewith.
Under certain application scenarios; Only relate to be shown as the protrusion screen by the operation of operating unit; Then the embodiment to this application scenarios can simplify on the basis of present embodiment; Can cancel and relevant device and the processing of flexible operation; Can cancel like telescopic head in the hook stick and flexible sensing unit, confirmed that by the second place in the image processing apparatus of operating equipment unit, image rendering unit can cancel, and can cancel the processing of calculating indentation length, drawing pseudo operation rod etc.
Under certain application scenarios; Only relate to be shown as recessed screen by the operation of operating unit; Then the embodiment to this application scenarios can simplify on the basis of present embodiment; Positioning unit in the hook stick can be cancelled and makes the sensor that movement locus detects, because only need can accomplish the virtual detection of touching by means of the touch location of attitude, indentation length and the induction screen and the hook stick of hook stick.
Embodiment two
Different with embodiment one is, present embodiment three-dimensional do not relate to alternately hook stick to stereo display on screen by the touching of operating unit operation, and only relate to the processing of stretching into the operation of induction screen through stereo display simulated operation rod.Therefore can on the basis of embodiment one, carry out some simplification.
The structure of hook stick can be identical with the hook stick of embodiment one.Also can do some simplification, for example, positioning unit can include only the sensor that gestures and detect.
Comprised induction screen, communicator and image processing apparatus equally by operating equipment.The induction screen is identical with embodiment one with communicator.
Mutual control device comprises:
The actual detecting unit that touches is used for when detecting hook stick contact induction screen, activates the image rendering unit in the image processing apparatus, and notifies position determination unit with the hook stick and the touch location of induction screen.
Position determination unit is used for the touch location according to three dimensional local information and the hook stick and the induction screen of the hook stick indentation part of obtaining in real time, calculates the virtual three-dimensional position of hook stick indentation part.For example; According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate on the hook stick indentation part virtual three-dimensional position of (like contact site) more at least; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.Wherein, the virtual three-dimensional position of contact site also can obtain or calculate according to the three-dimensional position of the hook stick that obtains in real time and the information of attitude; The indentation length of hook stick head is confirmed according to the information of the indentation length that hook stick is sent.
Image processing apparatus comprises:
The image rendering unit with the image rendering unit among the embodiment one, is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the induction screen.
The treatment scheme of operation that present embodiment stretches into the induction screen through stereo display simulated operation rod is with embodiment one.
Embodiment three
Present embodiment and embodiment one are basic identical, and difference is in the detection to the three-dimensional position of hook stick.In the present embodiment, be not used in the positioning unit of detection position and attitude in the hook stick, need to use other the three-dimensional coordinate of positioning auxiliary device co hook stick in the space.
This positioning auxiliary device is used for the sense operation rod with respect to the three-dimensional position of induction screen and the three dimensional local information that perceives sent to by operating equipment, its mode can but be not limited to be:
(a) tracking means; Like video camera (camera); Through this video camera hook stick is carried out Tracking Recognition, confirm the three dimensional local information of hook stick and send to, this three dimensional local information can comprise azimuthal information of the three-dimensional position and the hook stick of hook stick contact site or miscellaneous part.
(b) infrared inductor all will have this device on hook stick and the operated equipment, and one as generating means, and one as receiving device, by the three dimensional local information that is calculated hook stick by operating equipment or hook stick.
Above-mentioned positioning auxiliary device can also can send to earlier by the communicator of operating unit directly to being sent three dimensional local information by the mutual control device of operating equipment, offers this mutual control device by this communicator.
Present embodiment also can be used for change example and the embodiment two of embodiment one to the detection of the three-dimensional position of hook stick.Under the simplest a kind of mode, but hook stick does not have indentation head and flexible induction mechanism, positioning unit and force feedback unit, and just the lettering pen as common is the same.The position and the attitude of hook stick are detected by positioning auxiliary device; When solid is mutual, only need simulate to the protrusion screen by the touch control operation of operating unit, therefore all can be omitted with handling with the location of hook stick indentation part correlation and the unit of drafting on the operating equipment.
Embodiment four
Present embodiment and embodiment one are basic identical, and difference is not to be provided with in the hook stick indentation sensing unit.Touch the indentation length behind the screen for hook stick, calculate through other type.
As shown in Figure 8, present embodiment is being increased the special pressure sensitive device 101 of one deck by the surface of the induction screen 10 of operating equipment.For example; This pressure sensitive device can be a kind of special capacitance plate, and after hook stick touched this capacitance plate, this capacitance plate can change and the change of generation electric field along with the pressure of hook stick; After the change of this electric field is detected, can send to mutual control device.Because the indentation length of pressure and hook stick head has corresponding relation, the variation of the capacitance voltage of perception screen just can calculate the indentation length of hook stick head.And then the three-dimensional position of definite hook stick contact site.Also promptly, the indentation length of hook stick head also can calculate according to the pressure sensitive Device Testing result on the induction screen.
Present embodiment also can be used for change example and the embodiment two of embodiment one to the detection of the indentation length of hook stick.
Embodiment five
Present embodiment and embodiment one are basic identical, and difference is not to be provided with in the hook stick indentation sensing unit.Touch the three-dimensional position of the hook stick contact site behind the screen for hook stick, calculate through other type.
Because there is not the indentation sensing unit, so the present embodiment hook stick touches the information that can not obtain the indentation length of detected hook stick head behind the screen.But, because the positioning unit in the hook stick can detect the position and the attitude of hook stick in real time, therefore, can calculate indentation length according to the testing result of positioning unit.
The three-dimensional position of the hook stick that detects according to positioning unit and the information of attitude can obtain the degree of depth of hook stick contact site and the angle of hook stick and induction screen, can calculate the indentation length of hook stick head according to this degree of depth and angle.After obtaining this indentation length, the position angle of binding operation rod and the touch location of hook stick and induction screen can calculate the three-dimensional position of hook stick contact site.This mode combines the data of positioning unit and the data of actual touch location, can guarantee bearing accuracy, can avoid the appearance of bad display effects such as hook stick disconnection.
Present embodiment also can be used for the change example of embodiment one to the detection of the indentation length of hook stick.Understand easily, the three-dimensional position of the real-time detected hook stick of present embodiment positioning unit and the information of attitude also can utilize the servicing unit among the embodiment two to provide.
One of ordinary skill in the art will appreciate that all or part of step in the said method can instruct related hardware to accomplish through program, said program can be stored in the computer-readable recording medium, like ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of the foregoing description also can use one or more integrated circuit to realize, correspondingly, each the module/unit in the foregoing description can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
The above is merely the preferred embodiments of the present invention, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.All within spirit of the present invention and principle, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (20)
1. a three-dimensional interactive system is characterized in that, comprises by operating equipment and hook stick;
Can show by the induction screen of the stereo-picture of operating unit, mutual control device, be used to realize the communicator of information interaction between mutual control device and the hook stick and image processing apparatus said being comprised by operating equipment;
Said mutual control device comprises:
Primary importance is confirmed the unit, is used for confirming according to the three dimensional local information of the hook stick contact site that obtains in real time the three-dimensional position of hook stick contact site;
The virtual detecting unit that touches; Be used for according to the three-dimensional position of hook stick contact site with shown by the three-dimensional position on operating unit surface; Whether with by operating unit virtual touching take place in the real-time judge hook stick, in this way, activates the parallax adjustment unit in the image processing apparatus;
Said image processing apparatus comprises:
The depth calculation unit is used for according to definite by the degree of depth of operating unit surface with respect to the induction screen by the parallax of the stereo-picture of operating unit, and notifies the virtual detecting unit that touches; And
The parallax adjustment unit is used for through to by the parallax of the stereo-picture of operating unit adjustment the change in depth when simulation is pressed by operating unit.
2. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said hook stick comprises:
Positioning unit is used for position and/or the attitude of real-time detecting operation rod in the space, and sends detected three dimensional local information to the communication unit transmission;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment;
Said primary importance confirms that the three dimensional local information of the hook stick contact site that the unit obtains in real time is that positioning unit in the said hook stick sends.
3. three-dimensional interactive system as claimed in claim 2 is characterized in that:
Said positioning unit comprises makes the sensor that movement locus detects, and/or makes the sensor that the position angle is detected, and the initial position of this movement locus is set to the relative position in the reference system that with plane, display screen place is benchmark under the hook stick original state.
4. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Also comprise: positioning auxiliary device is used for the three-dimensional position of real-time perception hook stick with respect to the induction screen, and the information of the three-dimensional position that perceives is sent to said primary importance confirms the unit.
5. like claim 1 or 2 or 3 or 4 described three-dimensional interactive systems, it is characterized in that:
Said primary importance confirms that the unit confirms the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick does not touch said induction screen, obtain the three-dimensional position of said hook stick contact site according to the three-dimensional coordinate information of the hook stick contact site that receives at least; Perhaps, according to three-dimensional coordinate information, the azimuth information of hook stick and contact site obtains said hook stick contact site to the intrinsic distance calculation at this another position the three-dimensional position at another position on the hook stick that receives.
6. like claim 1 or 2 or 3 or 4 described three-dimensional interactive systems, it is characterized in that:
Said mutual control device also comprises: the actual detecting unit that touches, be used for after detecting hook stick and touching screen, and detected touch location notice primary importance is confirmed the unit;
Said primary importance confirms that the unit confirms the three-dimensional position of hook stick contact site according to the three dimensional local information of the hook stick contact site that obtains in real time; Comprise: when said hook stick touches said induction screen, calculate the three-dimensional position of said hook stick contact site according to the touch location of the position angle of the indentation length of hook stick head, hook stick and hook stick and induction screen.
7. three-dimensional interactive system as claimed in claim 6 is characterized in that:
Said primary importance confirms that the unit calculates the indentation length of the said hook stick head that the three-dimensional position of said hook stick contact site uses; Be that the information of three-dimensional position and the attitude of this hook stick of sending according to hook stick or positioning auxiliary device is confirmed the degree of depth and the hook stick of hook stick contact site and responded to the angle of screen, calculate the indentation length of said hook stick head then.
8. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said parallax adjustment unit passes through being adjusted by the parallax of the stereo-picture of operating unit; Change in depth when simulation is pressed by operating unit; Comprise: the hook stick contact site that will obtain in real time, and is adjusted by the parallax of operating unit on stereo-picture according to this degree of depth as by the degree of depth on operating unit surface with respect to the degree of depth of screen.
9. three-dimensional interactive system as claimed in claim 1 is characterized in that:
The said virtual detecting unit that touches is after the decision operation rod touches by operating unit; Also according to by the change in depth on operating unit surface; Whether the decision operation rod has been accomplished by the clicking operation of operating unit, in this way, then generates this is ordered by the click of operating unit.
10. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said hook stick comprises:
The force feedback unit, the force feedback that is used for receiving according to said communication unit is instructed, and carries out the action of analog force feedback;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment;
Said virtual when touching detecting unit real-time judge hook stick and touching by operating unit, also send the force feedback instruction to said hook stick through said communicator.
11., it is characterized in that like claim 1 or 2 or 3 or 4 described three-dimensional interactive systems:
Said hook stick comprises a telescopic head;
Said mutual control device also comprises:
The second place is confirmed the unit, is used for the touch location according to three dimensional local information and the hook stick and the induction screen of the hook stick indentation part of obtaining in real time, obtains the virtual three-dimensional position of hook stick indentation part;
The actual detecting unit that touches is used for touching induction during screen detecting hook stick, activates the image rendering unit in the image processing apparatus, and the touch location notice second place of hook stick and induction screen is confirmed the unit;
Said image processing apparatus also comprises:
The image rendering unit is used for the virtual three-dimensional position according to hook stick indentation part, the stereo-picture of real-time rendering hook stick indentation part, and this stereo-picture that will draw is presented on the said induction screen.
12. three-dimensional interactive system as claimed in claim 11 is characterized in that:
The said second place confirms that the unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
According to the indentation length of the hook stick head that obtains in real time, the position angle of hook stick and the touch location of hook stick and induction screen; Calculate virtual three-dimensional position more at least on the hook stick indentation part; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
13. three-dimensional interactive system as claimed in claim 12 is characterized in that:
The indentation length of the hook stick head that uses when the said second place is confirmed the virtual three-dimensional position of unit calculating operation rod indentation part obtains by following mode: confirm the degree of depth and the hook stick of hook stick contact site and respond to the angle of screen according to the information of the three-dimensional position of this hook stick that receives and attitude, calculate the indentation length of said hook stick head then.
14. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said hook stick comprises:
Telescopic head;
Flexible sensing unit is used for the indentation length of real-time detecting operation rod telescopic head and sends the information of detected indentation length to communication unit sending;
Communication unit is used to realize hook stick and by the information interaction between the operating equipment.
15. three-dimensional interactive system as claimed in claim 14 is characterized in that:
Said telescopic head comprises the operation caput and is resisted against the elastomeric element between this operation caput and the flexible induction installation;
Said flexible sensing unit adopts pressure sensing mode to realize, is used to respond to the pressure of said elastomeric element, is converted into corresponding electric signal and sends communication unit to send.
16. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said hook stick comprises telescopic head;
Said induction screen surface has been set up a pressure sensitive device, and the pressure when being used for detecting operation rod and touching with the induction screen also sends to mutual control device with testing result, and this pressure is corresponding with the indentation length of hook stick head.
17. three-dimensional interactive system as claimed in claim 11 is characterized in that:
Said position determination unit calculates hook stick indentation virtual three-dimensional position partly according to the three dimensional local information of the hook stick indentation part of obtaining in real time, comprising:
Three dimensional local information according to the hook stick of real-time reception; Obtain or calculate the three-dimensional position of hook stick contact site; Binding operation rod and the touch location of induction screen and the model of hook stick telescopic head calculate hook stick indentation virtual three-dimensional position partly again.
18. three-dimensional interactive system as claimed in claim 11 is characterized in that:
The image of the hook stick indentation part of said image rendering unit real-time rendering is a stereo-picture; This stereo-picture is that the three-dimensional position of images of left and right eyes when setting or following the tracks of the user who obtains and watch screen is as left and right camera; To respond to screen as the parallax free face, draw out the left image and the right image of said hook stick indentation part.
19. three-dimensional interactive system as claimed in claim 1 is characterized in that:
Said is smart mobile phone or panel computer by operating equipment.
20., it is characterized in that like claim 1 or 2 or 10 or 14 described three-dimensional interactive systems:
The head of said hook stick is a tip away from an end of shell, and this tip has constituted said hook stick contact site.
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103435980A CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
| US13/567,904 US20130117717A1 (en) | 2011-11-03 | 2012-08-06 | 3d user interaction system and method |
| KR1020120117778A KR101518727B1 (en) | 2011-11-03 | 2012-10-23 | A stereoscopic interaction system and stereoscopic interaction method |
| TW101139929A TWI530858B (en) | 2011-11-03 | 2012-10-29 | A three-dimensional interactive system and three-dimensional interactive method |
| EP12190884.2A EP2590060A1 (en) | 2011-11-03 | 2012-10-31 | 3D user interaction system and method |
| JP2012239871A JP2013097805A (en) | 2011-11-03 | 2012-10-31 | Three-dimensional interactive system and three-dimensional interactive method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103435980A CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102508562A true CN102508562A (en) | 2012-06-20 |
| CN102508562B CN102508562B (en) | 2013-04-10 |
Family
ID=46220662
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103435980A Active CN102508562B (en) | 2011-11-03 | 2011-11-03 | Three-dimensional interaction system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102508562B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853364A (en) * | 2012-11-29 | 2014-06-11 | 联想(北京)有限公司 | Tactile feedback method, electronic device and tactile feedback system |
| CN103995584A (en) * | 2014-04-29 | 2014-08-20 | 深圳超多维光电子有限公司 | Three-dimensional interactive method, display device, handling rod and system |
| CN104134235A (en) * | 2014-07-25 | 2014-11-05 | 深圳超多维光电子有限公司 | Real space and virtual space fusion method and real space and virtual space fusion system |
| CN105578174A (en) * | 2016-01-26 | 2016-05-11 | 神画科技（深圳）有限公司 | Interactive 3D display system and 3D image generation method thereof |
| CN106371736A (en) * | 2016-01-08 | 2017-02-01 | 北京智谷睿拓技术服务有限公司 | Interaction method, interaction equipment and operating rod |
| CN106951074A (en) * | 2013-01-23 | 2017-07-14 | 青岛海信电器股份有限公司 | A kind of method and system for realizing virtual touch calibration |
| CN107885432A (en) * | 2017-11-24 | 2018-04-06 | 杭州荔宝信息技术有限公司 | A kind of fetus three-dimension virtual reality man-machine interaction method and system |
| CN109491565A (en) * | 2018-10-30 | 2019-03-19 | 武汉思普崚技术有限公司 | The module information display methods and equipment of object in three-dimensional scenic |
| US10579145B2 (en) | 2016-01-27 | 2020-03-03 | Ebay Inc. | Simulating touch in a virtual environment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1910543A (en) * | 2004-10-12 | 2007-02-07 | 日本电信电话株式会社 | 3D pointing method, 3D display control method, 3D pointing device, 3D display control device, 3D pointing program, and 3D display control program |
| US20070132721A1 (en) * | 2005-12-09 | 2007-06-14 | Edge 3 Technologies Llc | Three-Dimensional Virtual-Touch Human-Machine Interface System and Method Therefor |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN101587386A (en) * | 2008-05-21 | 2009-11-25 | 深圳华为通信技术有限公司 | Method for processing cursor, Apparatus and system |
| CN102184063A (en) * | 2011-06-17 | 2011-09-14 | 北京欧顿科技有限公司 | Man-machine interactive system |
-
2011
- 2011-11-03 CN CN2011103435980A patent/CN102508562B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1910543A (en) * | 2004-10-12 | 2007-02-07 | 日本电信电话株式会社 | 3D pointing method, 3D display control method, 3D pointing device, 3D display control device, 3D pointing program, and 3D display control program |
| US20070132721A1 (en) * | 2005-12-09 | 2007-06-14 | Edge 3 Technologies Llc | Three-Dimensional Virtual-Touch Human-Machine Interface System and Method Therefor |
| CN101587386A (en) * | 2008-05-21 | 2009-11-25 | 深圳华为通信技术有限公司 | Method for processing cursor, Apparatus and system |
| CN101393497A (en) * | 2008-10-30 | 2009-03-25 | 上海交通大学 | Multi-point touch method based on binocular stereo vision |
| CN102184063A (en) * | 2011-06-17 | 2011-09-14 | 北京欧顿科技有限公司 | Man-machine interactive system |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103853364A (en) * | 2012-11-29 | 2014-06-11 | 联想(北京)有限公司 | Tactile feedback method, electronic device and tactile feedback system |
| CN106951074B (en) * | 2013-01-23 | 2019-12-06 | 青岛海信电器股份有限公司 | method and system for realizing virtual touch calibration |
| CN106951074A (en) * | 2013-01-23 | 2017-07-14 | 青岛海信电器股份有限公司 | A kind of method and system for realizing virtual touch calibration |
| CN103995584B (en) * | 2014-04-29 | 2017-11-17 | 深圳超多维光电子有限公司 | Stereo interaction method and its display device, operation stick and system |
| CN103995584A (en) * | 2014-04-29 | 2014-08-20 | 深圳超多维光电子有限公司 | Three-dimensional interactive method, display device, handling rod and system |
| CN104134235A (en) * | 2014-07-25 | 2014-11-05 | 深圳超多维光电子有限公司 | Real space and virtual space fusion method and real space and virtual space fusion system |
| CN104134235B (en) * | 2014-07-25 | 2017-10-10 | 深圳超多维光电子有限公司 | Real space and the fusion method and emerging system of Virtual Space |
| CN106371736B (en) * | 2016-01-08 | 2019-11-08 | 北京智谷睿拓技术服务有限公司 | Exchange method, interactive device and operation stick |
| US10275051B2 (en) | 2016-01-08 | 2019-04-30 | Beijing Zhigu Rui Tuo Tech Co., Ltd. | Interaction method, interaction device, and operation stick |
| CN106371736A (en) * | 2016-01-08 | 2017-02-01 | 北京智谷睿拓技术服务有限公司 | Interaction method, interaction equipment and operating rod |
| CN105578174B (en) * | 2016-01-26 | 2018-08-24 | 神画科技（深圳）有限公司 | Interactive 3D display system and its 3D rendering generation method |
| CN105578174A (en) * | 2016-01-26 | 2016-05-11 | 神画科技（深圳）有限公司 | Interactive 3D display system and 3D image generation method thereof |
| US10579145B2 (en) | 2016-01-27 | 2020-03-03 | Ebay Inc. | Simulating touch in a virtual environment |
| US11029760B2 (en) | 2016-01-27 | 2021-06-08 | Ebay Inc. | Simulating touch in a virtual environment |
| CN107885432A (en) * | 2017-11-24 | 2018-04-06 | 杭州荔宝信息技术有限公司 | A kind of fetus three-dimension virtual reality man-machine interaction method and system |
| CN109491565A (en) * | 2018-10-30 | 2019-03-19 | 武汉思普崚技术有限公司 | The module information display methods and equipment of object in three-dimensional scenic |
| CN109491565B (en) * | 2018-10-30 | 2020-10-02 | 武汉思普崚技术有限公司 | Method and equipment for displaying component information of object in three-dimensional scene |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102508562B (en) | 2013-04-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102426486B (en) | Stereo interaction method and operated apparatus | |
| CN102508562B (en) | Three-dimensional interaction system | |
| TWI530858B (en) | A three-dimensional interactive system and three-dimensional interactive method | |
| CN102779000B (en) | User interaction system and method | |
| CN102830795B (en) | Utilize the long-range control of motion sensor means | |
| US20150220158A1 (en) | Methods and Apparatus for Mapping of Arbitrary Human Motion Within an Arbitrary Space Bounded by a User's Range of Motion | |
| JP3176588U (en) | Remote touch circuit and attachment | |
| WO2016120804A1 (en) | Method and system for receiving gesture input via virtual control objects | |
| US20190384404A1 (en) | Virtual reality | |
| CN108431734A (en) | Touch feedback for non-touch surface interaction | |
| KR102147430B1 (en) | virtual multi-touch interaction apparatus and method | |
| CN103744518A (en) | Stereoscopic interaction method, stereoscopic interaction display device and stereoscopic interaction system | |
| KR20110102365A (en) | Immersive display system for interacting with three-dimensional content | |
| CN103180893A (en) | Method and system for use in providing three dimensional user interface | |
| US20190050132A1 (en) | Visual cue system | |
| CN111344663B (en) | Rendering device and rendering method | |
| EP3591503B1 (en) | Rendering of mediated reality content | |
| EP2558924B1 (en) | Apparatus, method and computer program for user input using a camera | |
| CN102508561B (en) | Operating rod | |
| US11397478B1 (en) | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment | |
| CN110968190B (en) | IMU for touch detection | |
| US20150033157A1 (en) | 3d displaying apparatus and the method thereof | |
| CN102508563B (en) | Stereo interactive method and operated device | |
| CN205039917U (en) | Sea floor world analog system based on CAVE system | |
| CN110968248B (en) | Generating a 3D model of a fingertip for visual touch detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Song Lei Inventor after: Liu Ning Inventor after: Ge Zhang Inventor before: Song Lei Inventor before: Liu Ning |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: SONG LEI LIU NING TO: SONG LEI LIU NING GE ZHANG |
|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180716 Address after: 518000 Room 201, building A, No. 1, Qian Wan Road, Qianhai Shenzhen Hong Kong cooperation zone, Shenzhen, Guangdong (Shenzhen Qianhai business secretary Co., Ltd.) Patentee after: Shenzhen super Technology Co., Ltd. Address before: 518053 H-1 Tung 101, overseas Chinese town, Nanshan District, Shenzhen, Guangdong. Patentee before: Shenzhen SuperD Photoelectronic Co., Ltd. |