CN102769764B - Be applied to method and the relevant apparatus of three dimensional display - Google Patents
Be applied to method and the relevant apparatus of three dimensional display Download PDFInfo
- Publication number
- CN102769764B CN102769764B CN201110125237.9A CN201110125237A CN102769764B CN 102769764 B CN102769764 B CN 102769764B CN 201110125237 A CN201110125237 A CN 201110125237A CN 102769764 B CN102769764 B CN 102769764B
- Authority
- CN
- China
- Prior art keywords
- information
- displaying
- user
- image
- shift amount
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to a kind of method and the relevant apparatus that are applied to three dimensional display, display 3-dimensional image, and respond to user to the response of 3-dimensional image to obtain locating information corresponding to 3-dimensional image.
Description
Technical field
The present invention has about a kind of method and the relevant apparatus that are applied to three dimensional display, and relate to especially a kind of in conjunction with 3-dimensional image with sense the method for locating and relevant apparatus.
Background technology
Dimension display technologies can show 3-dimensional image, for user brings abundanter sensory experience, has become the Research Emphasis of present information manufacturer.
When showing the 3-dimensional image of jobbie, the left image of this object and right image are shown left eye to user (audience) and right eye by three dimensional display respectively; Owing to there being parallax (parallax) between left image and right image, user just can see the three-dimensional imaging of object.
But, the 3-dimensional image position having many factors can affect user to watch; 3-dimensional image position for passing on parallactic shift amount in 3-dimensional image data content is understood and user is actual watches 3-dimensional image position difference to some extent.This not only can affect the result of broadcast of 3-dimensional image, and user also cannot be correctly interactive with 3-dimensional image.
Summary of the invention
Therefore, the invention provides a kind of can in conjunction with the technology of 3-dimensional image image space and audience position, allow user can be correctly interactive with the virtual environment of 3-dimensional image framework.
An object of the present invention is to provide a kind of method being applied to a three dimensional display, comprising: the 3-dimensional image showing one or more test object with three dimensional display, and each test object 3-dimensional image is relevant to one and presets parallactic shift amount; Induction user responds the back-signalling of test object 3-dimensional image, and senses the test position fix information (comprising the distance between 3-dimensional image and screen) of user; Wherein, preset, between parallactic shift amount and test position fix information, there is a particular kind of relationship, therefore locating information corresponding to different parallactic shift amount can be described with a functional relation.
The present invention can utilize the functional relation between parallactic shift amount and locating information to allow user can be interactive with 3-dimensional image.For example, the 3-dimensional image of an available three dimensional display display preset number interactive object, each interactive object dimensional image association is in a pre-set programs also corresponding one second parallactic shift amount; And each second parallactic shift amount can be substituting to functional relation to provide the reference location information of a correspondence.Respond the interactive locating information of interactive object dimensional image with sensor induction user, then the reference location information corresponding to interactive locating information and each interactive object dimensional image is compared.If interactive locating information meets reference location information corresponding to a certain interactive object, three dimensional display just can carry out this pre-set programs conformed to associated by interactive object.
That is, three dimensional display can present the virtual interactive object of multiple solid with 3-dimensional image, and predicts according to the correction of functional relation the three-dimensional imaging position (i.e. reference location information) that user experiences.As user and each interactive object interaction, sensor goes out an interactive locating information according to the motion detection of user; If the interactive locating information detected meets the reference location information of a certain interactive object, three dimensional display just can perform the program of this interactive object association.So, user just can carry out three-dimensional interactive with three dimensional display.
In one embodiment, do not meet each reference location information when comparison result shows interactive locating information, can prompting be sent, make user adjust user position, and again sense the interactive locating information of this user.
In another embodiment, each reference location information is not met when comparison result shows interactive locating information, can according to the interactive locating information of user and particular kind of relationship to provide an interactive parallactic shift amount, and make the parallactic shift amount of interactive object dimensional image equal interactive parallactic shift amount, make the interactive locating information of the reference location information conforms user of its correspondence.
In one embodiment, sensor is provided with multiple camera lens; This multiple camera lens acquisition user image to produce multiple sensing image, and provides the locating information of sensing according to the difference between these sensing images.When producing those sensing images, the difference between those sensing images also can be utilized in the lump to focus.
In one embodiment, sensor comprises a reflector and a receiver.Reflector sends location ripple to user, and receiver receives location wave reflection ripple; According to reflected wave, the locating information of sensing just can be provided.Location ripple can be electromagnetic wave, infrared light-wave or sound wave, ultrasonic waves, seismic wave etc.
The 3-dimensional image position that the present invention can utilize the functional relation anticipated user between parallactic shift amount and locating information to experience, and then adjustment 3-dimensional image, allow user can experience 3-dimensional image in the position of expection.When object is shown in display one, if wish, user can experience its three-dimensional imaging in a given display location, just displaying locating information corresponding for display location can be substituted into functional relation, to obtain the displaying parallactic shift amount of answering for a pair.Three dimensional display is according to showing that the 3-dimensional image of object is shown in the display of parallactic shift amount, and user just correctly can see in display location the three-dimensional imaging showing object.
Three dimensional display can comprise multiple loud speaker, and the present invention also can adjust the play parameter of each loud speaker according to the locating information of sensor sensing, correct the three-dimensional sound field of loud speaker, allow user can experience due stereo sound effect in desired location.
Another object of the present invention is to provide a kind of method being applied to a three dimensional display, comprising: with a three dimensional display display preset number test 3-dimensional image, each test 3-dimensional image corresponding one presets parallactic shift amount; And, the test position fix information of a correspondence is obtained respectively according to the back-signalling of user to each test 3-dimensional image.According to each default parallactic shift amount and each test position fix information, just can calculate a functional relation, different parallactic shift amount to be associated with corresponding locating information.
Functional relation can be used for adjustment/correction 3-dimensional image, and comprising: obtain a displaying image data, this shows in image data have the second preset number three-dimensional display image, and locating information shown by each three-dimensional display image respectively correspondence one.Each displaying locating information is substituting to the displaying parallactic shift amount that functional relation provides a correspondence respectively; According to each displaying parallactic shift amount, just adjustable shows each three-dimensional display image in image data, allows user show that the display location corresponding to locating information watches each three-dimensional display image.
The present invention also can utilize three-dimensional sound field to carry out the correction of 3-dimensional image.When showing test 3-dimensional image, play the second preset number test voice data with three dimensional display, each sound test data corresponding presets audio offset information.A functional relation is calculated to describe the locating information corresponding to different audio offset information according to each default audio offset information and each test position fix information.This functional relation can be used for correcting/adjustment voice data, and stereo sound effect corresponding to enable voice data can meet the virtual environment that 3-dimensional image construction goes out.Obtain the displaying voice data of to be adjusted/broadcasting, this is shown that the displaying locating information that voice data is corresponding is substituting to functional relation to provide the displaying audio offset information of a correspondence.According to showing audio offset information, just adjustable shows voice data.
Another object of the present invention is to provide a kind of device being applied to three-dimensional broadcasting, comprise an image processing module, an image correction module, an image adjusting module, the sound correction module that an acoustic processing module, a selectivity are arranged and the sound adjusting module that a selectivity is arranged.Image processing module receives a preset number test 3-dimensional image and obtains a relevant preset number default parallactic shift amount.Image correction module receives parallactic shift amount, and receives the test position fix information of a correspondence for each default parallactic shift amount.Wherein, each default parallactic shift amount is associated with a test 3-dimensional image, and each test position fix information is then provided by sensor, corresponding to the response of user to each test 3-dimensional image.Image correction module more calculates a functional relation according to each default parallactic shift amount and each test position fix information, so that different vision offset amount is associated with corresponding locating information.
Image adjusting module receives one and shows image data, and this shows that image data corresponding second preset number shows locating information.Each displaying locating information is substituting to functional relation by image correction module, provides the displaying parallactic shift amount of a correspondence, received by image adjusting module for each displaying locating information.Image adjusting module also shows image data according to each displaying parallactic shift amount adjustment.
Acoustic processing module receives a preset number default audio offset information, closes and is connected in a preset number test voice data and test 3-dimensional image; Sound correction module receives each test position fix information and the second preset number default audio offset information, and each default audio offset information is associated with a test voice data, and is associated with test 3-dimensional image.Sound correction module calculates one second functional relation according to each default audio offset information and each test position fix information, so that different audio offset information is associated with corresponding locating information.
Show that image data is also associated with a displaying voice data, this shows that voice data corresponds to one second and shows locating information.By second, sound correction module shows that locating information is substituting to the second functional relation to provide the displaying audio offset information of an association, and image adjusting module according to each displaying parallactic shift amount with show that audio offset information adjusts and show image data.
Sound adjusting module receives shows voice data, and receives the displaying audio offset information that sound correction module provides.Sound adjusting module adjusts according to each displaying audio offset information and each displaying parallactic shift amount shows voice data.
In order to have better understanding to above-mentioned and other aspect of the present invention, preferred embodiment cited below particularly, and coordinating accompanying drawing, being described in detail below:
Accompanying drawing explanation
The relation of Figure 1A to Fig. 1 C signal parallactic shift amount and three-dimensional imaging position.
Fig. 2 A to 2B and Fig. 3 A to 3B illustrate the various factor affecting three-dimensional imaging position.
Fig. 4 A to 4C is the schematic diagram carrying out sensing location according to one embodiment of the invention.
Fig. 5 is to sense the flow process of positioning correcting three-dimensional imaging position according to one embodiment of the invention.
Fig. 6 is the flow process carrying out three-dimensional interactive according to one embodiment of the invention.
Fig. 7 is the schematic diagram setting up three-dimensional sound field according to one embodiment of the invention.
Fig. 8 is to sense the flow process of the three-dimensional sound field of positioning correcting according to one embodiment of the invention.
Fig. 9 plays application apparatus schematic diagram according to the three-dimensional of one embodiment of the invention.
Main element symbol description
10: device
12: control module
13: image processing module
14: image correction module
16: image adjusting module
17: acoustic processing module
18: sound correction module
20: sound adjusting module
100,200,300: flow process
102-110,202-208,302-310: step
IR, IR1-IR2, IRt, IRc (.): right image
IL, IL1-IL2, ILt, ILc (.): left image
Xa-Xc, Xs, Xt, Xc (.): side-play amount
Ya-Yc, Ys, Yt, Yc (.), Yi: distance value
Pt: test position fix information
Fcn (.): program
Pc (.), Pi: locating information
SC, SC2: screen
OB: object
Iob, Iobt, Iob (.): imaging
MS: sensor
PR: right picture
PL: left picture
CR: right camera lens
CL: left camera lens
SK1-SK5: loud speaker
Embodiment
Side-play amount between left image and right image can be called as three dimensional depth (3D depth), and it is relevant with the position of the three-dimensional imaging of audience's perception.Please refer to Figure 1A to Fig. 1 C, the three-dimensional imaging position that what it was illustrated is corresponding to different side-play amount.As shown in Figure 1A, if the left image IL of jobbie in screen SC is to the right, right image IR is to the left, and offset X a between the two can make the imaging Iob position of this object before screen SC, with screen SC at a distance of-distance value Ya.Suppose the invariant position of audience, if left image IL and right image IR moves respectively to centre and makes the size of offset X a reduce, the size of distance value Ya also can be reduced jointly, and the three-dimensional imaging Iob of object can move closer to screen SC.As shown in Figure 1B, if the offset X b between left image IL and right image IR is 0, just dropping place is in screen SC for the three-dimensional imaging Iob that it is formed, and the distance value Yb at screen SC interval is 0.As shown in Figure 1 C, if left image IL image to the left and right IR is to the right, offset X c between the two will make imaging Iob position after screen SC, standoff distance value Yc now and between screen SC.
From the example of Figure 1A to 1C, change the side-play amount between left and right image, just can adjust the position (with regard to screen or user) of its three-dimensional imaging.But, other factor is also had can to affect the image space of 3-dimensional image; Fig. 2 A to 2B and Fig. 3 A to 3B illustrate to affect other factors of 3-dimensional image position respectively.
Affect the size that one of the factor of 3-dimensional image image space is display screen.In fig. 2, image IL and IR in left and right is shown in a smaller screen SC; In 2B figure, left and right image IL and IR is then shown in equal proportion a larger screen SC 2, and the side-play amount also equal proportion amplification between it.Although audience and screen pitch are from identical, for larger screen SC 2, the three-dimensional imaging Iob that it presents can relatively audience.
Another factor affecting 3-dimensional image image space is the distance between audience and screen.In Fig. 3 A and 3B, left and right image IL and IR is all shown in the screen SC of same size, and both left and right image offset amounts remain unchanged.From Fig. 3 B, the distant distance in Fig. 3 A between audience and screen, jointly, the position of three-dimensional imaging Iob also changes thereupon.In addition, as audience's binocular interval from etc. factor also can affect its 3-dimensional image position (distance) seen.
From discussing above, the 3-dimensional image position having many factors can affect user to watch; 3-dimensional image position for passing on parallactic shift amount in 3-dimensional image data content is understood and user is actual watches 3-dimensional image position difference to some extent.This not only can affect the result of broadcast of 3-dimensional image, and user also cannot be correctly interactive with 3-dimensional image.
The three dimensional display system of one embodiment of the invention utilizes the Display Technique of three dimensional display to make audience produce the impression of three dimensional depth to image, simultaneously and utilize sensor to detect the position of audience relative to screen, and then in conjunction with the position of video imaging and audience position, and the image allowing audience and three dimensional display play produces interactive effect.Please refer to Fig. 4 A to 4C, it is the schematic diagram carrying out sensing location according to one embodiment of the invention.For realizing the present invention, a three-dimensional display screen SC comprises or the sensor MS that arranges in pairs or groups, such as photography (as) machine.In the embodiment of Fig. 4 A to 4C, sensor MS is provided with left camera lens CL and right camera lens CR.As shown in Figure 4 A, for the object OB with sensor MS distance value Ys, such as of photography audience before screen, left camera lens CL shot object OB and the left image IL1 produced is positioned at left picture PL, right camera lens CR shot object OB and the right image IR1 produced is positioned at right picture PR.Due to the difference of left and right camera lens CL and CR position between the two, therefore produce offset X s between left and right image IL1 and IR1 on picture PL and the PR of left and right.
As shown in Figure 4 B, two camera lenses of sensor are just like the eyes of the mankind, if the distance value Ys between object OB and sensor MS becomes greatly, as the left and right image IL2 and IR2 of left and right camera lens CL and CR difference shot object OB, the offset X s between image IL2 and the IR2 of left and right can diminish.It can thus be appreciated that the position (as distance value Ys) of object OB is the difference (as offset X s) be associated with between its left and right image.As shown in Figure 4 C, the distance value Ys (1) that larger offset X s (1) is corresponding shorter, the distance value Ys (2) that less offset X s (2) is corresponding longer, side-play amount and distance value have a kind of functional relation between the two.This functional relation closes the size being connected in a three-dimensional display screen SC, that is the functional relation that different screens obtains may be different.Just can determine the relative position distance of proximity sensor MS (such as say be) of object OB according to the offset X s between left and right image, sensor MS, and for the locating information that object OB provides correspondence, comprise distance value Ys.Moreover in one embodiment, sensor MS also can focus according to the side-play amount of left and right image in the lump; That is, when absorbing the image of object, judge whether correctly to focus on this object according to the side-play amount between its left and right image.
In the another kind of embodiment of the present invention (not shown), sensor MS can be one or more reflector and one or more receiver, but not photographing (as) machine realizes.Reflector sends location ripple to object, and receiver receives location wave reflection ripple; According to reflected wave (the such as difference of comparison and location ripple and reflected wave, or the reflected wave of more different receiver reception), the locating information of sensing just can be provided.Location ripple can be electromagnetic wave, infrared light-wave or sound wave, ultrasonic waves, seismic wave etc.
User (audience) position that three-dimensional display system system provided by the invention utilizes sensor to try to achieve, and consider the previously described actual three-dimensional imaging position of experiencing of user, via the position of adjustment three-dimensional imaging and/or the mode of adjustment user position, user's (by eyes or by limb action) correctly can experience three-dimensional imaging, and then interaction can be carried out with three-dimensional imaging, to reach the telepresenc of virtual reality.
Please refer to Fig. 5, what it was illustrated is according to the flow process 100 of one embodiment of the invention, in order to by three-dimensional display and sensing positioning combination; Its key step can be described below:
Step 102: display test 3-dimensional image.Such as, left and right image ILt and the IRt of an object can be produced in the screen SC of three dimensional display; There is parallactic shift amount Xt between image ILt and the IRt of left and right, allow user be experienced imaging Iobt, namely using imaging Iobt as test 3-dimensional image.
Step 104: three dimensional display can point out user to make some specific back-signallings according to its viewed clear three-dimensional imaging Iobt, such as some respond actions: special gesture, touching or pat its viewed three-dimensional imaging; Or, in another example, when can clearly this three-dimensional imaging of perception time, user initiatively provides a back-signalling.In one embodiment, sensor MS detects test position fix information Pt; The distance value Yt of sensing user and sensor is included in this test position fix information Pt.In one embodiment, sensor MS system detects the specific response action of user and senses its position, and then obtains this locating information Pt.In another embodiment, the specific back-signalling system of user can be passed to three dimensional display by other modes, such as user presses the button of remote controller to pass on response.
Specifically, sensor MS can utilize the edge of the various reference points of user (as health, shoulder and/or arm, finger) and/or position to sense test position fix information Pt.For example, camera lens CL and the CR in available Fig. 4 C captures user's image to produce left and right image, and provides test position fix information Pt according to the difference of left and right image.
Step 106: set up functional relation between the two according to the distance value Yt in the parallactic shift amount Xt of three-dimensional test image and test position fix information Pt, makes this functional relation can describe locating information (comprising distance value) corresponding to various parallactic shift amount.In fact, step 102 and 104 pulls over to carry out, and such as, can adopt the 3-dimensional image with different parallactic shift amount Xt when carrying out in a step 102 at every turn, with the imaging Iobt that forming position is different; At step 104, actual impression according to user senses each parallactic shift amount Xt corresponding different locating information Pt and distance value Yt, with the particular kind of relationship that " parallactic shift amount Xt and the distance value Yt " that accumulate many groups is in step 106 corresponding, and then the general functional relation drawn between the two of deriving.
Step 108: judge whether to continue the corresponding relation between accumulation " parallactic shift amount Xt and distance value Yt ", if not yet terminate, then continue to pull over and carry out step 102 and 104.If the functional relation between parallactic shift amount and distance value/locating information has been set up, carry out step 110.
Step 110: process ends 100.
Utilize the functional relation obtained in flow process 100, the present invention just can allow user can be correctly interactive with the dummy object of 3-dimensional image/virtual environment.Please refer to Fig. 6, what it was illustrated is the flow process 200 of carrying out three-dimensional virtual environment interaction according to one embodiment of the invention.The key step of flow process 200 can be described as follows.
Step 202: the 3-dimensional image showing one or more interactive object with the screen SC of three dimensional display, as imaging Iob (n) and Iob (n ').Each imaging Iob (n) is formed with IRc (n) by left and right image ILc (n), corresponding parallactic shift amount Xc (n) between the image of left and right.Each parallactic shift amount Xc (n) can be substituting to the functional relation of step 106 to provide corresponding distance value Yc (n) and reference location information Pc (n).Each imaging Iob (n) is associated with a pre-set programs fcn (n).Pre-set programs fcn (n) can be the various operations that three dimensional display can carry out, such as, say it is regulate the brightness of display, contrast, time-out to play, continue to play, select to play chapters and sections etc.; Moreover three dimensional display also can be the content provided for playing a main frame, and the operation that pre-set programs fcn (n) can perform for this main frame.For example, this main frame can be a game host (game console), when performing pre-set programs, can change the displaying contents that it provides, the three-dimensional virtual scene allowing three dimensional display show changes to some extent, uses interactive with user in response to the triggering of user.
Step 204: the interactive locating information Pi of induction user.
Step 206: reference location information Pc (n) of interactive locating information Pi and each imaging Iob (n) is compared.If comparison result shows interactive locating information Pi and meets reference location information Pc (n0) corresponding to a certain interactive object, proceed to step 208; Otherwise, can pull over to step 204, continue the subsequent action of induction user.The object of the step 206 of the present embodiment is tried to achieve in many objects of three-dimensional interactive scene, user for touching particular artifact (certain specific three dimensional image).
Step 208: because interactive locating information Pi meets reference location information Pc (n0), such as say that error is between the two in an error range preset, three dimensional display just can perform the pre-set programs fcn (n0) associated by it.This step even Pi that anticipates meets reference location information Pc (n0), then represent user in response to the three-dimensional object corresponding to position Pc (n0) imaging.
In one embodiment, when the interactive locating information of user does not meet the reference location information of any interactive object, user can be represented and do not want to carry out any interaction.For example, when user triggers interaction, just may to adjust sitting posture, answer the call, have a drink etc.; Via the comparison of interactive locating information, just can learn that user will trigger any pre-set programs.Moreover if there is multiple interactive object (interactive imaging), user can only and one of them (or some) interaction.
In one embodiment, do not meet each reference location information when comparison result shows interactive locating information, can prompting be sent, make user adjust user position, and again sense the interactive locating information of this user.
Implement in profit at another, each reference location information is not met when comparison result shows interactive locating information, can according to the interactive locating information of user and particular kind of relationship to provide an interactive parallactic shift amount, and make the parallactic shift amount of interactive object dimensional image equal interactive parallactic shift amount, make the interactive locating information of the reference location information conforms user of its correspondence.
After carrying out flow process 100, can set up functional relation between the parallactic shift amount X of 3-dimensional image and the actual distance value Y experienced of user.When being shown as picture Iob (n) in step 202., just can learn user can observe this imaging Iob (n) under which position, which distance value according to parallactic shift amount Xc (n).If user carries out interaction with imaging Iob (n) under this position, this distance value, just represent user and will trigger program fcn (n) corresponding to imaging Iob (n).Accordingly, the 3-dimensional image that user just can play with three dimensional display carries out three-dimensional interactive.
As Fig. 2 A to 2B and Fig. 3 A to 3B once discussed, the parallactic shift amount only according to left and right image accurately can not learn user can see three-dimensional imaging under which position, which distance value, also just correctly cannot allow user and three-dimensional scenic interaction.Because the parallactic shift amount of the three-dimensional imaging produced by different size screen is different, the distance value of foundation is also different; Moreover in fact user also can affect distance value with the distance of screen.The present embodiment of the present invention actual sensed user can observe distance value and the position of imaging in flow process 100, corrects the functional relation between parallactic shift amount and distance value/image space accordingly, and then the three-dimensional interactive of flow process 200 is achieved.
For example, if parallactic shift amount Xc (n) of imaging Iob (n) originally should image in a certain distance value Y_expect, but the distance value Y_actual of actual imaging because of factors such as Fig. 2 A to 2B, Fig. 3 A to 3B with distance value Y_expect difference to some extent.But, the functional relation set up via the present invention, can be asked by parallactic shift amount Xc (n) and calculate distance value Y_actual.When user carries out interaction (sending interactive signal) in distance value Y_actual place, just can learn that user will carry out interaction with imaging Iob (n).Therefore, the distance value Y_expect of expection can not affect interactive correctness; Even if distance value Y_expect is different from the actual distance value Y_actual experienced of user, the present invention still can be correctly interactive with user.
Except being combined with 3-dimensional image sensing location, sensing location also can be combined with three-dimensional sound field by the present invention further.Please refer to Fig. 7, it sets up the schematic diagram of three-dimensional sound field according to one embodiment of the invention with multi-loudspeaker SK1 to SK5.Except screen SC and sensor MS, three dimensional display also can be arranged in pairs or groups the loud speaker SK1 to SK5 of diverse location, with the broadcasting coordinating three-dimensional display to carry out stereo sound effect.The image data of three-dimensional display can set up three-dimensional imaging with visual parallactic shift amount, the voice data of three-dimensional sound field then moulds the stereo sound effect in virtual three dimensional space with audio offset information (comprising the skew in frequency, phase place, delay and/or volume) acoustically, allow user can in the position of acoustically to experience virtual source of sound.But, the distance value that three-dimensional imaging distance value and user that parallactic shift amount is set up actually observe can difference to some extent, and audio offset information also can be different from the sound source position of the actual uppick of user for the sound source position of foundation.And the present invention just can sense according to the location of sensor MS the functional relation corrected between audio offset information and sound source position.
For example, the step 106 of flow process 100 has set up the functional relation between parallactic shift amount and image-forming range value, and the present invention can directly utilize this functional relation to adjust/revise the audio offset information of voice data, the sound source position that audio offset information is set up meets the sound source position of user's actual location.Or, similar step 102 and 104, the present invention also can play test voice data and give user, responded or indicate the sound source position of its uppick by user, (even can sensor MS sense the action of user to obtain information), to obtain the test position fix information that user locates sound source position.According to audio offset information and the test position fix information of test voice data, just can set up the functional relation between audio offset information and source of sound locating information, be similar to step 106.
Just as flow process 200, the present invention also can utilize the functional relation in three-dimensional sound field between audio offset information and source of sound locating information to come to carry out interaction with user.Such as say, if the corresponding audio offset information of the voice data of an interactive source of sound, reference location information corresponding to it can be drawn by functional relation.Detect the action of user as sensor MS and when corresponding interactive locating information is provided, if interactive locating information meets reference location information, just can play the voice data of this interactive source of sound.The interaction of three-dimensional sound field can coordinate the interaction of 3-dimensional image, increases the entertaining on using.For example, available 3-dimensional image shows a virtual small bell, when user touches this virtual small bell, just can play the tinkle of bells voice data of virtual small bell, and the sound source position of this sound can be consistent with the image space of virtual small bell.
With parallactic shift amount in 3-dimensional image data and sensing locating information between functional relation, and/or the functional relation in three-dimensional sound field voice data between audio offset information and sensing locating information, adjustable image data of the present invention and voice data, the three-dimensional imaging distance value that parallactic shift amount is set up can meet the distance value that user observes, and the sound source position that sound offset information is set up also can meet the sound source position of user's uppick.
Please refer to Fig. 8, its signal be according to one embodiment of the invention voice data adjustment flow process 300.The key step of flow process 300 can be described as follows:
Step 302: play test voice data, this test voice data system sets up stereo sound effect according to the test audio offset information of a correspondence.
Step 304: by the source of sound of user's assignment test voice data, and the location action of user can be sensed or respond a locating information by user, as test position fix data.
Step 306: whether the sound source position that comparison user locates in test position fix data meets the sound source position of test audio offset information for setting up.If both are not inconsistent (error is between the two more than a tolerance value), proceed to step 308.If both conform to, then proceed to step 310.
Step 308: the test audio offset information of adjustment test voice data, to change the sound source position that test audio offset information is set up, and repeats step 302.Can utilize the functional relation between audio offset information and source of sound locating information to adjust and test audio offset information, the sound source position that test audio offset information is set up can meet the sound source position that user locates in test position fix data.Equivalence, adjustment test audio offset information, namely changes the play parameter of each loud speaker, as volume, delay, phase place and/or frequency.
Step 310: process ends 300.
Please refer to Fig. 9, what it was illustrated is according to the device 10 of one embodiment of the invention; Device 10 is applied to three-dimensional display, to adjust/to revise the imaging/audio position of 3-dimensional image data and voice data according to user's locating information of sensing.Control module 12, one image processing module 13, image correction module 14, image adjusting module 16, acoustic processing module 17, sound correction module 18 and a sound adjusting module 20 is provided with in device 10.Control module 12 controls the running of other each modules.As the step 102 in flow process 100 and 104, image processing module 13 receives test 3-dimensional image and obtains relevant default parallactic shift amount; Image correction module 14 receives the parallactic shift amount of test 3-dimensional image, and receives test position fix information corresponding to each parallactic shift amount by sensor MS, and namely user is to the locating information of test 3-dimensional image.Accordingly, image correction module 14 just can calculate a functional relation (as step 106) according to each default parallactic shift amount with corresponding test position fix information, so that different parallactic shift amount is associated with corresponding locating information.
When showing the displaying image data of a three-dimensional, image adjusting module 16 just can adjust the side-play amount of showing image data according to the running of image correction module 14.Image adjusting module 16 receives shows image data, and this shows the displaying locating information of image data one or more 3-dimensional image corresponding, each show locating information represent an object to be presented answer the position of imaging.Each displaying locating information is substituting to functional relation to provide corresponding displaying parallactic shift amount by image correction module 14, and received by image adjusting module 16.That is, to allow user watch three-dimensional imaging on the position representated by displaying locating information, between the left and right image of this three-dimensional imaging, parallactic shift amount should meet the displaying parallactic shift amount that image correction module 14 calculates.And image adjusting module 16 is exactly each parallactic shift amount will shown according to each displaying parallactic shift amount adjustment in image data.Because each screen size is fixed, the side-play amount that can adjust when producing 3-dimensional image has maximum restriction, therefore, in another embodiment, instruction can also be sent or information makes user adjust its location a little, within the maximum restriction that can adopt at this screen to make the side-play amount corresponding to locating information by display.
For example, the three-dimensional display image data of three dimensional display display can be obtained by the instant nomogram of three dimensional virtual models (render), therefore can, in the parameter such as focus, angle foundation side-play amount during three dimensional virtual models nomogram being changed to nomogram, make three-dimensional imaging energy position show the position of specifying in locating information.Or the optical parametric (as angle, direction etc.) of its broadcasting left and right image of three dimensional display adjustable, to adjust the parallactic shift amount between the image of left and right, and then revises the distance value of three-dimensional imaging.
Be similar to the operation principles of image correction module 14, acoustic processing module 17 receives presets audio offset information, closes respectively and is connected in test voice data; After broadcasting test voice data, sound correction module 18 can receive for each audio offset information in test voice data the test position fix information that user locates source of sound.Sound correction module 18 calculates one second functional relation according to each audio offset information with corresponding test position fix information, so that different audio offset information is associated with corresponding locating information.
When playing the displaying voice data showing image data association, sound correction module 18 will show that the displaying locating information that voice data is corresponding is substituting to the second functional relation to provide the displaying audio offset information of an association.Sound adjusting module 20 receives shows voice data, and receive the displaying audio offset information that sound correction module 18 provides, with according to showing audio offset information and/or showing that the functional relation of parallactic shift amount and/or image correction module 14 adjusts the audio side-play amount of showing voice data.Voice data after sound adjusting module 20 adjusts may be output to the loud speaker (the loud speaker SK1 to SK5 as Fig. 7) of three dimensional display, and the sound source position allowing displaying locating information wish set up can meet the sound source position that user listens to.In like manner, image adjusting module 16 also can adjust displaying image data according to the second functional relation of each displaying parallactic shift amount and/or displaying audio offset information and/or sound correction module 18 in the lump, and export the image data after adjustment to three dimensional display, allow and show that locating information meets the actual position seen of user for the three-dimensional imaging position (distance value) set up.
Device 10 can be implemented in the control wafer of three dimensional display, and image correction module 14, image adjusting module 16, sound correction module 18 can be realized with software, firmware and/or hardware with sound adjusting module 20.Sound correction module 18 and/or sound adjusting module 20 also can omit.
When showing interactive image Iob (n) in the embodiment in fig 6, the desired distance value Y_expect of parallactic shift amount Xc (n) and the distance value Y_actual of actual imaging can be different; Even if both are different, the present invention still correctly can realize three-dimensional interactive.In Fig. 9 embodiment, the present invention adjusts parallactic shift amount further to change the distance value Y_actual of actual imaging, makes the desired distance value Y_expect of imaging can equal the actual distance value Y_actual experienced of user.Certainly, Fig. 6 and Fig. 9 embodiment can be combined with each other collocation.
In summary, the present invention be sensing location show with 3-dimensional image/sound plays and combines, and three-dimensional broadcasting can be made to meet the sensation of user, the virtual environment interaction also allowing user correctly play with three-dimensional to set up.
In sum, although the present invention with preferred embodiment disclose as above, so itself and be not used to limit the present invention.Persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when being used for a variety of modifications and variations.Therefore, protection scope of the present invention is as the criterion when being defined by claims.
Claims (18)
1. be applied to a method for a three dimensional display, comprise:
Utilize this three dimensional display to produce a 3-dimensional image of a test object, this 3-dimensional image has presets parallactic shift amount about one;
Respond to a back-signalling of a user, the blur-free imaging that this back-signalling relates to this 3-dimensional image is made; And
In response to this back-signalling, sensing has the test position fix information about this user, and wherein this default parallactic shift amount and this test position fix information have a particular kind of relationship,
Wherein said method also comprises:
Play multiple test voice data with this three dimensional display, respectively this sound test data corresponding presets audio offset information;
According to each, this this test position fix information of default audio offset information and each calculates a functional relation to describe the many locating information corresponding to different audio offset information;
Obtain a displaying voice data, this displaying voice data corresponding shows locating information;
This displaying locating information is substituting to this functional relation to provide the displaying audio offset information of a correspondence; And
This displaying voice data is adjusted according to this displaying audio offset information.
2. the method for claim 1, is characterized in that, also comprises:
Produce many 3-dimensional images, this many 3-dimensional image has about different multiple preset parallactic shift amounts;
Respond to many back-signallings of a user;
Sensing has the many test position fix information about this user; And
This particular kind of relationship is tried to achieve, for the different locating information described corresponding to different parallactic shift amount according to this multiple preset parallactic shift amount and this many test position fix information.
3. the method for claim 1, is characterized in that, also comprises:
The 3-dimensional image of how interactive object is produced, respectively the corresponding one second parallactic shift amount of this 3-dimensional image with this three dimensional display;
According to respectively this second parallactic shift amount and this particular kind of relationship to provide a corresponding reference location information;
Sense at least one interactive locating information of this user;
This at least one interactive locating information and each this reference location information are compared.
4. method as claimed in claim 3, is characterized in that, also comprise:
At least one back-signalling of induction user, this at least one back-signalling has the 3-dimensional image about this how interactive object; And
After this at least one back-signalling, sense this at least one interactive locating information of this user.
5. method as claimed in claim 3, is characterized in that, also comprise:
Do not meet respectively this reference location information when a comparison result shows this interactive locating information, send a prompting and make user adjust a user position; And
Again sense an interactive locating information of this user.
6. method as claimed in claim 3, is characterized in that, also comprise:
Respectively this reference location information is not met, according to this interactive locating information of this user and this particular kind of relationship to provide an interactive parallactic shift amount when a comparison result shows this interactive locating information; And
One second parallactic shift amount of the 3-dimensional image adjusting this how interactive object at least one becomes this interactive parallactic shift amount, makes this interactive locating information of this user of reference location information conforms of its correspondence.
7. method as claimed in claim 3, is characterized in that, also comprise:
Each this how interactive object is made to be associated with a pre-set programs respectively; And
If a comparison result show this interactive locating information meet many reference location information one of them, then make this three dimensional display carry out this pre-set programs conformed to associated by interactive object.
8. the method for claim 1, is characterized in that, also comprises:
Acquisition user image is to produce multiple sensing image;
This test position fix information is provided according to the difference between those sensing images.
9. method as claimed in claim 8, is characterized in that, also comprise:
When producing those sensing images, the difference between those sensing images is utilized to focus.
10. the method for claim 1, is characterized in that, this test position fix packets of information sensing this user contains:
A location ripple is sent to this user;
Receive a reflected wave of this location ripple; And
This test position fix information is provided according to this reflected wave.
11. the method for claim 1, is characterized in that, also comprise:
When object is shown in display one, show that locating information substitutes into this particular kind of relationship to provide the displaying parallactic shift amount of a correspondence by one; And
According to this displaying parallactic shift amount, show the 3-dimensional image of this displaying object with this three dimensional display.
12. the method for claim 1, is characterized in that, this three dimensional display comprises multiple loud speaker, and the method also comprises:
The play parameter of respectively this loud speaker is adjusted according to this displaying locating information.
13. 1 kinds of methods being applied to a three dimensional display, comprise:
Utilize this three dimensional display to show and test 3-dimensional image more, each this test 3-dimensional image corresponding one presets parallactic shift amount; And
Obtain a corresponding test position fix information respectively according to the back-signalling of user to each this test 3-dimensional image, the blur-free imaging that this back-signalling relates to this each test 3-dimensional image is made;
Described method also comprises:
When showing this many tests 3-dimensional image, playing test voice data more with this three dimensional display, respectively this sound test data corresponding presets audio offset information;
According to each, this this test position fix information of default audio offset information and each calculates a functional relation to describe the many locating information corresponding to different audio offset information;
Obtain a displaying voice data, this displaying voice data corresponding shows locating information;
This displaying locating information is substituting to this functional relation to provide the displaying audio offset information of a correspondence; And
This displaying voice data is adjusted according to this displaying audio offset information.
14. methods as claimed in claim 13, is characterized in that, also comprise:
According to each, this this test position fix information of default parallactic shift amount and each calculates a functional relation so that different parallactic shift amount is associated with corresponding locating information.
15. methods as claimed in claim 14, is characterized in that, also comprise:
Obtain a displaying image data, this displaying image data corresponding second shows locating information;
Show that locating information is substituting to this functional relation to provide the displaying parallactic shift amount of a correspondence respectively by each second; And
Foundation respectively this displaying parallactic shift amount adjusts this displaying image data.
16. methods as claimed in claim 13, is characterized in that, also comprise:
With a sensor induction user to the response of each this test 3-dimensional image to obtain respectively this test position fix information.
17. 1 kinds are applied to the three-dimensional device play, comprise:
One image processing module, receives a preset number test 3-dimensional image and obtains a relevant preset number default parallactic shift amount;
One image correction module, receive this preset number default parallactic shift amount, and receive a preset number test position fix information, about a user is to the response of this preset number test 3-dimensional image, and calculating a functional relation according to each this default parallactic shift amount and each this test position fix information, this user of this response has the blur-free imaging testing 3-dimensional image about this preset number to make; And
One image adjusting module, receive one and show that the second preset number that image data is corresponding shows that locating information shows parallactic shift amount with the second corresponding preset number, foundation respectively this displaying parallactic shift amount adjusts this displaying image data,
Wherein, described device also comprises:
One acoustic processing module, receives a preset number default audio offset information, closes and is connected in a preset number test voice data and this preset number test 3-dimensional image;
One sound correction module, receives each this test position fix information, calculates one second functional relation according to each this default audio offset information and each this test position fix information, so that different audio offset information is associated with corresponding locating information,
This displaying image data is also associated with a displaying voice data, and this displaying voice data corresponds to one second and shows locating information; This second displaying locating information is also substituting to this second functional relation to provide the displaying audio offset information of an association by this sound correction module, and this image adjusting module is more according to respectively this displaying parallactic shift amount and this displaying audio offset information adjust this displaying image data
Described device also comprises:
One sound adjusting module, receives described displaying voice data, and adjusts this displaying voice data according to this displaying audio offset information.
18. devices as claimed in claim 17, is characterized in that, this sound adjusting module also adjusts this displaying voice data according to each this displaying audio offset information and each this displaying parallactic shift amount.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110125237.9A CN102769764B (en) | 2011-05-03 | 2011-05-03 | Be applied to method and the relevant apparatus of three dimensional display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110125237.9A CN102769764B (en) | 2011-05-03 | 2011-05-03 | Be applied to method and the relevant apparatus of three dimensional display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102769764A CN102769764A (en) | 2012-11-07 |
| CN102769764B true CN102769764B (en) | 2015-09-09 |
Family
ID=47096997
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110125237.9A Expired - Fee Related CN102769764B (en) | 2011-05-03 | 2011-05-03 | Be applied to method and the relevant apparatus of three dimensional display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102769764B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI577194B (en) * | 2015-10-22 | 2017-04-01 | 山衛科技股份有限公司 | Environmental voice source recognition system and environmental voice source recognizing method thereof |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105872518A (en) * | 2015-12-28 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Method and device for adjusting parallax through virtual reality |
| CN106851469A (en) * | 2017-02-16 | 2017-06-13 | 深圳创维－Rgb电子有限公司 | It is a kind of to adjust the method and apparatus that audio amplifier exports audio |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1973555A (en) * | 2004-06-24 | 2007-05-30 | 索尼爱立信移动通讯有限公司 | Proximity assisted 3D rendering |
| CN101266546A (en) * | 2008-05-12 | 2008-09-17 | 深圳华为通信技术有限公司 | Method for accomplishing operating system three-dimensional display and three-dimensional operating system |
| CA2767511A1 (en) * | 2009-07-09 | 2011-01-13 | Samsung Electronics Co., Ltd. | Signal processing method and apparatus therefor using screen size of display device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101350931B (en) * | 2008-08-27 | 2011-09-14 | 华为终端有限公司 | Method and device for generating and playing audio signal as well as processing system thereof |
| KR101324440B1 (en) * | 2009-02-11 | 2013-10-31 | 엘지디스플레이 주식회사 | Method of controlling view of stereoscopic image and stereoscopic image display using the same |
| CN101984670B (en) * | 2010-11-16 | 2013-01-23 | 深圳超多维光电子有限公司 | Stereoscopic displaying method, tracking stereoscopic display and image processing device |
| CN102006494A (en) * | 2010-11-26 | 2011-04-06 | 北京新岸线网络技术有限公司 | Method and device for adjusting three-dimensional (3D) video signal |
-
2011
- 2011-05-03 CN CN201110125237.9A patent/CN102769764B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1973555A (en) * | 2004-06-24 | 2007-05-30 | 索尼爱立信移动通讯有限公司 | Proximity assisted 3D rendering |
| CN101266546A (en) * | 2008-05-12 | 2008-09-17 | 深圳华为通信技术有限公司 | Method for accomplishing operating system three-dimensional display and three-dimensional operating system |
| CA2767511A1 (en) * | 2009-07-09 | 2011-01-13 | Samsung Electronics Co., Ltd. | Signal processing method and apparatus therefor using screen size of display device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI577194B (en) * | 2015-10-22 | 2017-04-01 | 山衛科技股份有限公司 | Environmental voice source recognition system and environmental voice source recognizing method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102769764A (en) | 2012-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8648917B2 (en) | Imaging apparatus, image processing apparatus, and image processing method, and program | |
| KR101666919B1 (en) | Electronic device and control method for electronic device | |
| CN110809115B (en) | Shooting method and electronic equipment | |
| US20110235807A1 (en) | Audio output device | |
| KR20170079198A (en) | Mobile terminal and operating method thereof | |
| US11428951B2 (en) | Glasses-free 3D display mobile device, setting method of the same, and using method of the same | |
| EP3132305B1 (en) | Glasses-free 3d display mobile device, setting method of the same, and using method of the same | |
| CN103888703A (en) | Shooting method and camera shooting device with recording enhanced | |
| CN103002376A (en) | Method for orientationally transmitting voice and electronic equipment | |
| CN102769764B (en) | Be applied to method and the relevant apparatus of three dimensional display | |
| WO2022262839A1 (en) | Stereoscopic display method and apparatus for live performance, medium, and system | |
| WO2020255766A1 (en) | Information processing device, information processing method, program, projection device, and information processing system | |
| US10397723B2 (en) | Apparatus, system, and method of processing data, and recording medium | |
| CN108769636A (en) | Projecting method and device, electronic equipment | |
| TWI470995B (en) | Method and associated apparatus of three-dimensional display | |
| CN110324555A (en) | Video communication device and method | |
| CN110324559A (en) | Video communication device and method | |
| CN111866674B (en) | Speaker assembly control method, device and storage medium | |
| EP2509325A2 (en) | Image processing apparatus, image processing method, and program | |
| KR20190133591A (en) | Aperture device, camera, and terminal including the same | |
| CN116261094A (en) | Sound system capable of dynamically adjusting target listening point and eliminating interference of environmental objects | |
| CN103986959A (en) | Automatic parameter adjusting method and device of smart television equipment | |
| CN116018824A (en) | Information processing method, program and sound reproducing device | |
| US9860480B2 (en) | Method for processing information and electronic device | |
| TWI842055B (en) | Audio system with dynamic target listening spot and ambient object interference cancelation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150909 Termination date: 20190503 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |