Summary of the invention
Embodiment of the present invention proposes a kind of 3D glasses, and the user can carry out interaction by these 3D glasses and the 3D content of seeing.
Embodiment of the present invention has also proposed a kind of 3D display system, the user can by the 3D glasses carry out interaction with the 3D content seen.
The technical scheme of embodiment of the present invention comprises:
A kind of 3D glasses, these 3D glasses comprise light control module, gesture identification module and information calculation process module, wherein:
The light control module is used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user;
The gesture identification module is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to information calculation process module;
Information calculation process module is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.
Described light control module be passive type red-blue colour filter 3D eyeglass, passive type be red-green colour filter 3D eyeglass, passive type be red-blue or green colour filter 3D eyeglass, polarization type 3D eyeglass or flash type 3D eyeglass.
The gesture identification module is used for catching the user in real time and browses the gesture mobile message that this 3D display interface is made;
Described information calculation process module, be used for according to described gesture mobile message, determine the interactive operation order corresponding to this gesture mobile message, and further control the 3D display unit in real time in the space virtual pointer element of described 3D display interface demonstration corresponding to user's hand, thereby movement locus and the user's hands movement track of realizing the space virtual pointer element on the 3D display interface are consistent.
Described gesture mobile message comprises motion track information or the gesture state information of hand, described gesture state information comprise stretch the palmate attitude, the state of clenching fist, V-shaped gesture state or hold up the state of a finger.
Described information calculation process module, be used for by USB, HDMI (High Definition Multimedia Interface), bluetooth, infrared, wireless family digital interface, mobile communication cell data network or wifi mode described interactive operation order or 3D display interface update signal being sent to the 3D display unit.
Described gesture identification module is used for catching the user and browses accurate positioning action and/or the non-accurate positioning action that this 3D display interface is made, and wherein accurately positioning action comprises: click the button of 3D display interface or the specific region on the selection 3D display interface; Described non-accurate positioning action comprises: hand hovers, hand from right to left paddling, hand from left to right paddling, hand from top to bottom paddling, hand paddling or two hands separately or gather or are waved from top to bottom.
A kind of 3D glasses, these 3D glasses comprise light control module and gesture identification module, wherein: the light control module is used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user; The gesture identification module is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to the information calculation process module that is connected with described 3D glasses;
Wherein:
Information calculation process module is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.
Described gesture identification module is connected with information calculation process module by bluetooth, infrared, mobile communication cell data network, wifi mode or USB mode.
Described information calculation process module is portable terminal, be integrated in computing unit in the 3D display unit, computer or based on the information service platform of cloud computing.
The gesture identification module is used for catching the user in real time and browses the gesture mobile message that this 3D display interface is made;
Information calculation process module, be used for according to described gesture mobile message, determine the interactive operation order corresponding to this gesture mobile message, and further control the 3D display unit in real time in the space virtual pointer element of described 3D display interface demonstration corresponding to user's hand, thereby movement locus and the user's hands movement track of realizing the space virtual pointer element on the 3D display interface are consistent.
A kind of 3D display system comprises 3D glasses and 3D display unit, wherein:
The 3D display unit is used for sending 3D display interface light; The interactive operation order that reception is sent by the 3D glasses, and send corresponding to the 3D display interface light after this interactive operation order of execution;
The 3D glasses are used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user; Catch the user and browse the gesture mobile message that this 3D display interface is made, determine the interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.
A kind of 3D display system comprises 3D glasses, information calculation process module and 3D display unit;
Wherein:
The 3D display unit is used for sending 3D display interface light; The interactive operation order that reception is sent by information calculation process module, and send corresponding to the 3D display interface light after this interactive operation order of execution;
The 3D glasses are used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user; Catch the user and browse the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to the information calculation process module that is connected with described 3D glasses;
Information calculation process module is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.
Can find out from technique scheme, in embodiment of the present invention, the 3D glasses comprise light control module, gesture identification module and information calculation process module, wherein: the light control module, be used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user; The gesture identification module is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to information calculation process module; Information calculation process module is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.This shows, use after the embodiment of the present invention, when the user watches the 3D content by 3D display unit such as 3D TV or 3D projections, can utilize the 3D glasses by gesture is caught, the 3D content of seeing is carried out interaction.
Embodiment
For making the purpose, technical solutions and advantages of the present invention clearer, the present invention is described in further detail below in conjunction with accompanying drawing.
In embodiment of the present invention, a kind of 3D glasses and 3D display system are proposed.The user can carry out interaction by these 3D glasses and the 3D content of seeing.
Particularly, the user by embedding the gesture identification module in the 3D glasses, can carry out interaction by gesture for the 3D content of watching naturally in the 3D content of watching the 3D display unit such as 3D TV or 3D projector equipment to provide by the 3D glasses.
The 3D eyewear applications that embodiment of the present invention can be proposed is in various virtual environments.Generally speaking, the user need to just can enter in the virtual environment by special interactive device.Complete virtual reality system can by virtual environment, take high-performance computer as core the virtual environment processor, take the 3D glasses as core vision system, take speech recognition, sound is synthetic with sound localization as the auditory system of core, body dimension Attitude Tracking equipment take azimuth tracker, data glove and data suit as main body, and functional units formations such as the sense of taste, sense of smell, sense of touch and force feedback system.
In one embodiment, embodiment of the present invention has proposed brand-new, the complete consumer level virtual reality equipment solution of a cover.By this solution, the user can and can provide the relevant sensing equipment of natural interaction by the 3D glasses, realize that the user fully is immersed in the three-dimensional natural human-machine interaction of brand-new immersion 3D interface by first person, and comprise with it the information interaction of the natures such as gesture interaction.
Fig. 1 is the structure chart according to embodiment of the present invention 3D display system.
As shown in Figure 1, this 3D display system comprises 3D glasses 101, calculation process module 102 and 3D display unit 103, wherein:
3D display unit 103 is used for sending 3D display interface light;
3D display unit 103 can obtain 3D display interface signal from various signal sources, and these 3D display interface signals are converted into 3D display interface light.Such as, 3D display unit 103 can be obtained 3D display interface signal from calculation process module 102 or other signal source, and by various ways such as liquid crystal layer and polarizing coatings this 3D display interface signal is converted into light signal.
3D glasses 101 are used for receiving 3D display interface light from 3D display unit 103, so that the 3D display interface appears at the moment in the user; Catch the user and browse the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to the information calculation process module 102 that is connected with described 3D glasses.
3D glasses 101 can with 3D display unit 103 coordinated, the display frame of control 3D display unit 103 enters the light of user's right and left eyes, the picture that user's right and left eyes is seen has small difference, thereby sees the 3D content.Such as 3D glasses 101 can with 3D display unit 103, before user, present the 3D display interface by various ways such as passive type 3D technology, polarization type 3D technology or flash type 3D technology.
In one embodiment, when the signal source of 3D display unit 103 is not information calculation process module 102, information calculation process module 102 is determined the interactive operation orders corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 103.At this moment, the 3D display interface signal that 3D display unit 103 can utilize this interactive operation order control to obtain from its signal source is carried out interactive operation, and the 3D display interface light that will carry out after this interactive operation order sends to 3D glasses 101.In this embodiment, information calculation process module 102 does not provide 3D display interface signal to 3D display unit 103, and be the interactive operation order of determining corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 103.At this moment, 3D display unit 103 is carried out this interactive operation order for the 3D display interface signal that obtains from its signal source, and send corresponding to the 3D display interface light of carrying out after this interactive operation order, the 3D display interface light after this interactive operation order of described execution can be presented to 3D display interface after the user upgrades by 3D glasses 101 again.
In another embodiment, when the signal source of 3D display unit 103 is information calculation process module 102, the interactive operation order that information calculation process module 102 is determined corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal sent to 3D display unit 103,3D display unit 103 sends to 3D glasses 101 with 3D display interface update signal light again.In this embodiment, information calculation process module 102 also further provides 3D display interface signal and 3D display interface update signal to 3D display unit 103 except determining the interactive operation order corresponding to this gesture mobile message.At this moment, information calculation process module 102 specifically may be embodied as any information acquisition device, such as portable terminal, computer, perhaps based on information service platform of cloud computing etc.At this moment, information calculation process module 102 can be processed corresponding interaction process order by its built-in operating system and finish certain computing (handset dialing for example, browsing page etc.), and by the corresponding 3D display interface of wired or wireless mode real-time update signal, and output 3D display interface signal is shown to 3D display unit 103.The corresponding 3D picture of the cooperation respective type light control module of the renewal of in real time reception calculation process module 102 generations of 3D display unit 103 is to the user.
Preferably, 3D glasses 101 form parallax by control corresponding to the picture that the fine difference of the shown picture of micro-display of right and left eyes is seen user's eyes, brain can understand the parallax of eyes and use judgment object far and near with produce stereoscopic vision.
Preferably, communication mode between information calculation process module 102 and the 3D display unit 103 can have multiple implementation form, includes, but are not limited to: wireless broadband transmission, wifi transmission, Bluetooth transmission, infrared transmission, mobile communication transmission, USB transmission or wire transmission etc.
Information calculation process module 102, can pass through USB, HDMI (High Definition Multimedia Interface), bluetooth, infrared, wireless family digital interface, mobile communication cell data network or wifi mode, described interactive operation order or 3D display interface update signal are sent to the 3D display unit.
Particularly, these 3D glasses 101 can comprise light control module 1011 and gesture identification module 1012.Wherein:
Light control module 1011 is used for receiving 3D display interface light from 3D display unit 103, so that the 3D display interface appears at the moment in the user;
Gesture identification module 1012 is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to the information calculation process module 102 that is connected with described 3D glasses 101.
Particularly, light control module 1011 may be embodied as passive type red-blue colour filter 3D eyeglass, passive type be red-green colour filter 3D eyeglass, passive type be red-blue or green colour filter 3D eyeglass, polarization type 3D eyeglass or flash type 3D eyeglass, etc.
Preferably, communication mode between gesture identification module 1012 and the information calculation process module 102 can have multiple implementation form, includes, but are not limited to: wireless broadband transmission, wifi transmission, Bluetooth transmission, infrared transmission, mobile communication transmission, USB transmission or wire transmission etc.
Particularly, gesture identification module 1012 can comprise optical depth transducer and data transmission module.Obtain in real time user's both hands or singlehanded depth image by the optical depth transducer, and by data transmission module with these depth image real-time Transmission to information calculation process module 102, carry out analyzing and processing by information calculation process module 102 and obtain user's gesture interaction intent information.
The 3D glasses 101 of embodiment of the present invention specifically may be embodied as multiple physical form, can comprise the elements such as mirror holder, eyeglass.Wherein: the picture frame section of the spectacle frame of 3D glasses 101 can be formed with upper ledge section and lower frame section, be located in the vertical hole of lens set that upper ledge section and lower frame section surround for lens set, and upper ledge section and lower frame section can form breach in side, be provided with sandwich sheet in the breach place again, and make the upper clamp segments of sandwich sheet and lower clamp segments be connected with respectively upper limb, lower edge in breach, other is provided with fixture, and makes fixture be provided with trepanning, with upper clamp segments and the lower clamp segments of socket sandwich sheet.Accordingly, by the sheathed sandwich sheet of fixture, can make the upper clamp segments of sandwich sheet, the contracting of lower clamp segments bundle, and then fold the breach of picture frame section, will be installed in the effect of the firm assembling of eyeglass in the vertical hole of picture frame section lens set to reach facility.
In one embodiment, gesture identification module 1012 can be positioned in the middle of the mirror holder of 3D glasses 101, on the socket sandwich sheet, wait a plurality of positions, thereby be convenient to catch human action.
After user's hand enters the investigative range of gesture identification module 1012, the range image sequence of user's hand will be caught and transmit to gesture identification module 1012 in real time to information calculation process module 102, information calculation process module 102 obtains the motion track of user's hand by the range image sequence of a series of software algorithm real-time analysis user hands, and then analyzes the gesture interaction intention of judging the user.
In one embodiment, gesture identification module 1012 is used for catching the user in real time and browses the gesture mobile message that this 3D display interface is made;
Described information calculation process module 102, be further used for according to described gesture mobile message, determine the interactive operation order corresponding to this gesture mobile message, and control 3D display unit 103 in real time in the space virtual pointer element of described 3D display interface demonstration corresponding to user's hand, thereby movement locus and the user's hands movement track of realizing the space virtual pointer element on the 3D display interface are consistent.
The gesture mobile message that gesture identification module 1012 is caught can comprise motion track information or the gesture state information of hand, this state for example clench fist state, palm extended state, V-shaped gesture state, thumb up or the state of other finger etc.Judge based on the state information of the locus of user's hand and user's hand and user's mutual intention to be transferred to the 3D display unit thereby real-time rendering generates the display frame of upgrading in wired or wireless mode.
Information calculation process module 102 can be identified the definite interactive operation order corresponding to this gesture mobile message of interactive software algorithm by a series of users, in addition, these users identify interactive software can also provide the User Defined operation-interface, the certain gestures track of liking such as the user represents certain user-defined operational order, thus the personalized customizable characteristics of the system of realization.
More specifically, the user moves interactive operation for the gesture of 3D display interface and is divided into two classes: a class is the non-accurate positioning action of identification, such as " page turning ", and " advancing ", orders such as " retreating ".Another kind of is to realize accurate positioning action, such as clicking the button in the interactive interface or selecting an operation such as specific region.
For the identification of non-accurate positioning action, only need the motion track information of record analysis hand to get final product.Such as, non-accurate positioning action can comprise: for example hand from right to left paddling, hand from left to right paddling, hand from top to bottom paddling and, hand from top to bottom paddling or, and two hands separate, gather etc.
In order to realize the accurately identification of operation, need the movement locus of real-time tracking user hand and corresponding to the pointer element on the interactive interface to determine the accurate interactive elements of the wish of user on interactive interface position, draw interactive command by information calculation process module 102 Analysis deterrmination user hand tracks intention, thereby realize the accurate operation to the interface.
In the said process, can identify the gesture that presets the user in the interactive software and the corresponding relation of each concrete interactive operation order the user.And this corresponding relation preferably can be edited, thereby can conveniently increase emerging interactive operation order, perhaps based on the gesture of user habit change corresponding to the interactive operation order.
Exemplarily, the below lifts hand, movement, does click action as example illustrative system workflow take the user.
After the user who has on 3D glasses 101 lifts the investigative range that hand enters gesture identification module 1011, the range image sequence of the current visual field of gesture identification module 1011 Real-time Obtainings also is transferred to information calculation process module 102 with it, the range image sequence that corresponding coupling recognizer real-time analysis in the information calculation process module 102 receives, analysis is identified as the validity feature tracing object with it after detecting user's hand, utilize its depth image data real-time analysis to obtain its three dimensional local information, at this moment it is corresponding with user's hand a virtual mouse to occur in the three-dimensional tridimensional virtual space environment in the user visual field, and the user controls the movement of this virtual mouse just as the hand that draws oneself up.
Preferably, there is a virtual push button on upper left side, the user visual field, and the user moves to this virtual push button place with this virtual mouse of hand control, and at this moment the virtual mouse form changes, and clicking operation can be carried out in this position of prompting user.At this moment the user does a click action with hand, information calculation process module 102 is by analyzing the movement locus that analyzes user's hand from the range image sequence of user's hand of gesture identification module 1011, and by a series of redundant actions matching algorithm analyses judge draw the user be intended to alternately the clicking operation order.
When the signal source of 3D display unit 103 is not information calculation process module 102, at this moment information calculation process module 102 sends to 3D display unit 103 with this clicking operation order, and the interaction results real-time rendering after should being intended to alternately after 3D display unit 103 will be carried out is again presented to the user.
When the signal source of 3D display unit 103 is information calculation process module 102, the interactive operation order that information calculation process module 102 is determined corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal sent to 3D display unit 103,3D display unit 103 sends to 3D glasses 101 with 3D display interface update signal light again.
In structure shown in Figure 1, light control module 1011 and gesture identification module 1012 are integrated in the 3D glasses 101, and information calculation process module arrangement is arrived outside the 3D glasses 101, such consideration is for the weight that reduces 3D glasses 101 and/or reduces 3D glasses 101 structural complexities.
In fact, embodiment of the present invention also can be integrated into the function of information calculation process module in the 3D glasses 101.
Fig. 2 is another structure chart according to embodiment of the present invention 3D display system.
As shown in Figure 2, the 3D of this system glasses 201 and 3D display unit 203, wherein:
3D display unit 203 is used for sending 3D display interface light;
3D glasses 201 are used for receiving 3D display interface light from 3D display unit 203, so that the 3D display interface appears at the moment in the user; Catch the user and browse the gesture mobile message that this 3D display interface is made, determine the interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 203; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to 3D display unit 203 shown.
Wherein, these 3D glasses 201 comprise light control module 2013, gesture identification module 2011 and information calculation process module 2012, wherein:
Light control module 2013 is used for receiving 3D display interface light from 3D display unit 203, so that the 3D display interface appears at the moment in the user;
Gesture identification module 2011 is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to information calculation process module 2012;
Information calculation process module 2012 is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 203; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to 3D display unit 203 shown.
In one embodiment, when the signal source of 3D display unit 203 is not information calculation process module 2012, information calculation process module 2012 is determined the interactive operation orders corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 203.At this moment, the 3D display interface signal that 3D display unit 203 can utilize this interactive operation order control to obtain from its signal source is carried out interactive operation, and the 3D display interface light that will carry out after this interactive operation order sends to 3D glasses 201.In this embodiment, information calculation process module 2012 does not provide 3D display interface signal to 3D display unit 203, and be the interactive operation order of determining corresponding to this gesture mobile message, and described interactive operation order is sent to 3D display unit 203.At this moment, 3D display unit 203 is carried out this interactive operation order for the 3D display interface signal that obtains from its signal source, and send corresponding to the 3D display interface light of carrying out after this interactive operation order, the 3D display interface light after this interactive operation order of described execution can be presented to 3D display interface after the user upgrades by 3D glasses 201 again.
In another embodiment, when the signal source of 3D display unit 203 is information calculation process module 2012, the interactive operation order that information calculation process module 2012 is determined corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal sent to 3D display unit 203,3D display unit 203 sends to 3D glasses 201 with 3D display interface update signal light again.In this embodiment, information calculation process module 2012 also further provides 3D display interface signal and 3D display interface update signal to 3D display unit 103 except determining the interactive operation order corresponding to this gesture mobile message.At this moment, information calculation process module 102 specifically may be embodied as any information acquisition device, such as portable terminal, computer, perhaps based on information service platform of cloud computing etc.At this moment, information calculation process module 102 can be processed corresponding interaction process order by its built-in operating system and finish certain computing (handset dialing for example, browsing page etc.), and by the corresponding 3D display interface of wired or wireless mode real-time update signal, and output 3D display interface signal is shown to 3D display unit 103.The corresponding 3D picture of the cooperation respective type light control module of the renewal of in real time reception calculation process module 102 generations of 3D display unit 103 is to the user.
Fig. 3 is for using the method flow diagram that 3D glasses and 3D content are carried out interaction according to embodiment of the present invention.
As shown in Figure 3, the method comprises:
Step 301:3D display unit provides 3D interface display signal to the 3D glasses.
Step 302:3D glasses present the 3D interface according to 3D interface display signal to the user.
Step 303:3D glasses are caught the user and are browsed the limbs space mobile message of making at this 3D interface.
Step 304:3D glasses are determined the interactive operation order corresponding to this limbs space mobile message, and described interactive operation order is sent to the 3D display unit; The 3D display interface signal that the 3D display unit utilizes this interactive operation order control to obtain from its signal source is carried out interactive operation, and the 3D display interface light that will carry out after this interactive operation order sends to the 3D glasses.
In above-mentioned flow process, when 3D interface display signal is provided by the 3D glasses, step 304 can replace with: the 3D glasses are determined the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.
Fig. 4 is for using the schematic diagram that 3D glasses and 3D content are carried out interaction according to embodiment of the present invention.
In sum, in embodiment of the present invention, the 3D glasses comprise light control module, gesture identification module and information calculation process module, wherein: the light control module, be used for receiving 3D display interface light from the 3D display unit, so that the 3D display interface appears at the moment in the user; The gesture identification module is used for catching the user and browses the gesture mobile message that this 3D display interface is made, and described gesture mobile message is sent to information calculation process module; Information calculation process module is used for definite interactive operation order corresponding to this gesture mobile message, and described interactive operation order is sent to the 3D display unit; Perhaps be used for to determine the interactive operation order corresponding to this gesture mobile message, generate 3D display interface update signal based on this interactive operation order, and 3D display interface update signal is sent to the 3D display unit shown.This shows, use after the embodiment of the present invention, when the user watches the 3D content by 3D display unit such as 3D TV or 3D projections, can carry out interaction to the 3D content of seeing by gesture.
The above is preferred embodiment of the present invention only, is not for limiting protection scope of the present invention.Within the spirit and principles in the present invention all, any modification of doing, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.