CN102970565B - Video processing apparatus and video processing method - Google Patents
Video processing apparatus and video processing method Download PDFInfo
- Publication number
- CN102970565B CN102970565B CN201210099542.XA CN201210099542A CN102970565B CN 102970565 B CN102970565 B CN 102970565B CN 201210099542 A CN201210099542 A CN 201210099542A CN 102970565 B CN102970565 B CN 102970565B
- Authority
- CN
- China
- Prior art keywords
- spectators
- ken
- relative importance
- video
- importance value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/398—Synchronisation thereof; Control thereof
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
Abstract
According to one embodiment, a video processing apparatus includes a viewer detector that performs face recognition using video photographed by a camera and acquires position information of viewers, a viewer selector that gives priority levels to the viewers on the basis of a predetermined prioritization rule and selects a predetermined number of viewers out of the viewers in order from a viewer having the highest priority level, a viewing area information calculator that calculates, using position information of the selected viewers, a control parameter for setting a viewing area in which the selected viewers are set, a viewing area controller that controls the viewing area according to the control parameter, a display that displays plural parallax images that the viewers present in the viewing area can observe as a stereoscopic video, and an apertural area controller that outputs the plural parallax images displayed on the display in a predetermined direction.
Description
The cross reference of related application
The Japanese patent application 2011-189548 that the application applied for based on August 31st, 2011, enjoys benefit of priority from this application.The application, with reference to this application, comprises the full content of this application.
Technical field
Embodiments of the present invention relate to video process apparatus and method for processing video frequency.
Background technology
In recent years, spectators do not use special glasses and can be day by day universal to the 3-dimensional video display device (so-called bore hole 3D TV) of three-dimensional video-frequency with naked eye.Multiple images that this 3-dimensional video display device display viewpoint is different.Further, the light of these images such as controls outbound course by disparity barrier (parallaxbarrier), cylindrical lens (lenticular lens) etc., and imports two of spectators.As long as the location-appropriate of spectators, then spectators just can use left eye and right eye sees to different anaglyphs, thus three-dimensionally can identify video.The region that such spectators can observe three-dimensional video-frequency is called the ken.
This ken is limited region, and spectators can not see three-dimensional video-frequency when being in outside the ken.Therefore, 3-dimensional video display device has the position the function (face tracking function) controlling the ken in the mode that spectators enter in the ken of detecting spectators.
But, when there are multiple spectators, be not that whole spectators include in the ken.On the other hand, among spectators, there is the people that preferentially include in the ken and the people that can not include in the ken.Such as, do not need preferentially to include in the ken only by the people before 3-dimensional video display device.
Summary of the invention
The present invention in view of the above problems, its object is to provide the spectators high to relative importance value always can show video process apparatus and the method for processing video frequency of high-quality three-dimensional video-frequency.
According to execution mode, this video process apparatus comprises: spectators' test section, uses the video photographed by video camera to carry out face recognition, to obtain the positional information of spectators; Spectators' selection portion, when described spectators are multiple, based on the relative importance value assessment rules of regulation, evaluate relative importance value to multiple described spectators, specifies the spectators of number from multiple described spectators by relative importance value selective sequential from high to low; Ken information calculating part, using the positional information of the described spectators selected, calculating the controling parameters of the ken for setting the described spectators including selection in; Ken control part, controls the ken according to described controling parameters; Display part, multiple anaglyphs that the spectators that display is positioned at the described ken can watch as three-dimensional video-frequency; And opening control part, the multiple anaglyphs shown at described display part are exported along prescribed direction.
According to the video process apparatus of said structure, the spectators high to relative importance value always can show high-quality three-dimensional video-frequency.
Accompanying drawing explanation
Fig. 1 is the outside drawing of the video process apparatus 100 that a kind of execution mode relates to.
Fig. 2 is the block diagram of the schematic configuration that the video process apparatus 100 that a kind of execution mode relates to is shown.
(a) ~ (c) of Fig. 3 is the figure of the part from top view liquid crystal panel 1 and cylindrical lens 2.
Fig. 4 is the vertical view of an example of the multiple kens 21 illustrated in the listening area P of video process apparatus.
Fig. 5 is the block diagram of the schematic configuration that the video process apparatus 100 ' that variation relates to is shown.
Fig. 6 is the flow chart that the method for processing video frequency that a kind of execution mode relates to is shown.
(a) ~ (c) of Fig. 7 is the vertical view of the ken that the method for processing video frequency setting utilizing a kind of execution mode to relate to is shown.
(a) ~ (c) of Fig. 8 is the figure for illustration of being evaluated relative importance value to spectators by relative importance value assessment rules.
Embodiment
Below, with reference to while attached, embodiments of the present invention are described particularly.
Fig. 1 is the outside drawing of the video display devices 100 that a kind of execution mode relates to, and Fig. 2 is the block diagram that its schematic configuration is shown.Video display devices 100 possesses liquid crystal panel 1, cylindrical lens 2, video camera 3, light accepting part 4 and controller 10.
The spectators that liquid crystal panel (display part) 1 display is in the ken can as multiple anaglyphs of three-dimensional video-frequency viewing.This liquid crystal panel 1 is the panel of such as 55 inches of sizes, is configured with 11520 (=1280 × 9) individual pixel in the horizontal direction, is configured with 720 pixels in vertical direction.In addition, three sub-pixels, i.e. R sub-pixel, G sub-pixel and B sub-pixel is vertically formed in each pixel.Light is irradiated to liquid crystal panel 1 from the back lighting device (not shown) being arranged at the back side.Each pixel makes the light transmission of the brightness corresponding with the parallax image signal (aftermentioned) supplied from controller 10.
Cylindrical lens (opening control part) 2 exports the multiple anaglyphs in the upper display of liquid crystal panel 1 (display part) along prescribed direction.This cylindrical lens 2 has multiple protuberances that the horizontal direction along liquid crystal panel 1 configures, and its quantity is 1/9 of the horizontal direction pixel count of liquid crystal panel 1.And, in the mode of the corresponding protuberance of every nine pixels configured in the horizontal direction, cylindrical lens 2 is affixed to the surface of liquid crystal panel 1.Light through each pixel exports the direction of specifying to directive property near the summit of protuberance.
The liquid crystal panel 1 of present embodiment can show three-dimensional video-frequency with many parallaxes modes (integral image (integral image) mode) more than three parallaxes or two parallax modes, in addition, also can show common two-dimensional video.
In the following description, illustrate that each protuberance of corresponding liquid crystal panel 1 arranges nine pixels and can adopt the example of many parallaxes mode of nine parallaxes.In many parallaxes mode, show the first anaglyph ~ the 9th anaglyph respectively corresponding with each protuberance nine pixels.First anaglyph ~ the 9th anaglyph refers to from nine viewpoints side by side of the horizontal direction along liquid crystal panel 1 observes subject and the image obtained respectively.Spectators, by via cylindrical lens 2, observe an anaglyph in the first anaglyph ~ the 9th anaglyph with left eye respectively, with another anaglyph of right eye sees, thus three-dimensionally can watch video.According to many parallaxes mode, then the quantity of parallax more increases, and more can expand the ken.The ken refers to from can the region of stereo view video during the forward observation liquid crystal panel 1 of liquid crystal panel 1.
On the other hand, in two parallax modes, four pixels respectively in corresponding with each protuberance nine pixels show right eye anaglyph, show left eye anaglyph in other five pixels.Left eye with and right eye anaglyph refer to the image that the viewpoint in left side from two viewpoints side by side in the horizontal direction and the viewpoint on right side are observed subject respectively and obtained.Spectators by seeing left eye anaglyph, seeing right eye anaglyph with right eye with left eye via cylindrical lens 2 respectively, thus three-dimensionally can watch video.When adopting two parallax modes, the third dimension of the video of display more easily obtains than many parallaxes mode, but the ken narrows compared with many parallaxes mode.
In addition, liquid crystal panel 1 shows identical image in nine pixels corresponding with each protuberance, also can show two dimensional image.
In addition, in the present embodiment, according to the relative position relation between the protuberance of cylindrical lens 2 and the anaglyph of display, namely how anaglyph is shown corresponding with each protuberance nine pixels, thus can the variable control ken.Below, be described for the control of many parallaxes mode to the ken.
Fig. 3 is the figure of the part from top view liquid crystal panel 1 and cylindrical lens 2.The region representation ken of the shade of Fig. 3, when three-dimensionally watching video during liquid crystal panel 1 viewed from the ken.Other regions be produce inverse to look, the region of crosstalk, and be the region being difficult to three-dimensionally watch video.
Fig. 3 shows the relative position relation between liquid crystal panel 1 and cylindrical lens 2, and more particularly show the distance of liquid crystal panel 1 and cylindrical lens 2 or the ken with the side-play amount of the horizontal direction of liquid crystal panel 1 and cylindrical lens 2 and situation about changing.
In fact, the contraposition and pasting accurately of cylindrical lens 2 and liquid crystal panel 1, is thus difficult to physically change the relative position between liquid crystal panel 1 and cylindrical lens 2.
Therefore, in the present embodiment, by making the display position skew of the first anaglyph ~ the 9th anaglyph of each pixel display at liquid crystal panel 1, thus making the relative position relation between liquid crystal panel 1 and cylindrical lens 2 change on the surface, carrying out the adjustment of the ken thus.
Such as, compared with respectively the first anaglyph ~ the 9th anaglyph being presented at the situation ((a) of Fig. 3) of nine pixels corresponding with each protuberance, when making anaglyph entirety offset display to the right ((b) of Fig. 3), the ken moves to the left.On the contrary, when making anaglyph entirety offset display to the left, the ken moves to the right.
In addition, in near central authorities in the horizontal direction, do not make anaglyph offset, when the outside more to liquid crystal panel 1, make anaglyph larger skew be to show laterally ((c) of Fig. 3), the ken moves along the direction close to liquid crystal panel 1.In addition, as long as the pixel between the different anaglyph of the amount of the pixel between the anaglyph of skew and the anaglyph do not offset, skew carries out suitable interpolation according to the pixel of surrounding.In addition, contrary with (c) of Fig. 3, do not make anaglyph offset near central authorities in the horizontal direction, when the outside more to liquid crystal panel 1, make anaglyph to central side larger offset to show, the ken moves along away from the direction of liquid crystal panel 1.
Like this, by offseting the entirety of anaglyph or a part, thus can make the ken relative to liquid crystal panel 1 in left-right direction or fore-and-aft direction move.In figure 3 for the purpose of simplifying the description, a ken is only shown, but in fact, as shown in Figure 4, multiple ken 21 is present in listening area P, and they move linkedly.The ken controls by the controller 10 of aftermentioned Fig. 2.In addition, the listening area beyond the ken 21 is the inverse viewed area 22 being difficult to see good three-dimensional video-frequency because of the inverse generation depending on, crosstalk etc.
Get back to Fig. 1, each inscape of video process apparatus 100 is described.
Video camera 3 is mounted with the regulation elevation angle near the lower central of liquid crystal panel 1, to take the prescribed limit in the front of liquid crystal panel 1.The video photographed is provided to controller 10, for detecting the information relevant to spectators such as the position of spectators, the face of spectators.Video camera 3 also can take any one in dynamic image and still image.
Light accepting part 4 is such as located at the left side of the bottom of liquid crystal panel 1.And light accepting part 4 receives the infrared signal of the remote controller transmission used from spectators.This infrared signal comprises and represents it is display three-dimensional video-frequency or two-dimensional video, adopt any, the signal that whether carries out the control of the ken etc. of many parallaxes mode and two parallax modes when showing three-dimensional video-frequency.
Then, being described in detail to the inscape of controller 10.As shown in Figure 2, controller 10 has tuning decoder 11, anaglyph converter section 12, spectators' test section 13, ken information calculating part 14, Image Adjusting portion 15, spectators' selection portion 16 and storage part 17.Controller 10 is such as mounted as an IC (Integrated Circuit: integrated circuit), and it is configured in the dorsal part of liquid crystal panel 1.Certainly, also by a part for the mode mount controller 10 of software.
Tuning decoder (acceptance division) 11 receives the broadcast wave frequency-selecting that input, decodes by the vision signal of encoding.When being superimposed with the signal of data broadcast of electric program guide (EPG) etc. to broadcast wave, tuning decoder 11 extracts it.Or tuning decoder 11 is not receive by the vision signal of encoding from broadcast wave but from the picture output device of optical disk reproducing apparatus, personal computer etc., and to its decoding.The signal of decoding also referred to as baseband video signal, and is provided to anaglyph converter section 12.In addition, do not receive broadcast wave at video display devices 100, vision signal that special display receives from picture output device, also tuning decoder 11 instead can be arranged only there is decoding function decoder as acceptance division.
The vision signal that tuning decoder 11 receives can be two-dimensional video signal, also can be the three dimensional video signal comprising the image of left eye use and right eye with frame encapsulation (FP), side by side (SBS) or upper and lower (TAB) mode etc.In addition, vision signal also can be the three dimensional video signal of the image comprising more than three parallaxes.
Anaglyph converter section 12 in order to three-dimensionally display video, and is supplied to Image Adjusting portion 15 after baseband video signal is converted to multiple parallax image signal.Contents processing is different according to adopting many parallaxes modes and any in two parallax modes for anaglyph converter section 12.In addition, be two-dimensional video signal or three dimensional video signal according to baseband video signal, the contents processing of anaglyph converter section 12 is different.
When employing two parallax mode, anaglyph converter section 12 generate with left eye use and the corresponding respectively left eye of right eye anaglyph with and right eye parallax image signal.More specifically, as described below.
In employing two parallax mode and have input comprise left eye with and the three dimensional video signal of image of right eye, the left eye that anaglyph converter section 12 generates the form that can show at liquid crystal panel 1 with and right eye parallax image signal.In addition, when input comprise the three dimensional video signal of the image of more than three, such as anaglyph converter section 12 uses wherein arbitrary two, generation left eye with and right eye parallax image signal.
In contrast, in employing two parallax mode and when have input the two-dimensional video signal not comprising parallax information, anaglyph converter section 12 based on the depth value of each pixel in vision signal generate left eye with and right eye parallax image signal.Depth value represents to see that each pixel is positioned at the moment relative to liquid crystal panel 1 or the value of which kind of degree of depth.Depth value also can be evaluated to vision signal in advance, also can based on the feature of vision signal carry out detection of dynamic, composition identification and people face detection etc. to generate depth value.In left eye anaglyph, show to the pixel deflection right side needing the pixel observed to observe than depth at the moment.Therefore, anaglyph converter section 12 carries out the process pixel observed in vision signal offset to the right at the moment, generates left eye parallax image signal.The larger side-play amount of depth value is larger.
On the other hand, when adopting many parallaxes mode, anaglyph converter section 12 generates first anaglyph ~ nine parallax image signal corresponding respectively with the first anaglyph ~ the 9th anaglyph.More specifically, as described below.
In employing many parallaxes mode and when have input the three dimensional video signal of the image comprising below two-dimensional video signal or eight parallaxes, anaglyph converter section 12 with generate according to two-dimensional video signal left eye with and right eye parallax image signal in the same manner as based on depth information, generate the first anaglyph ~ the 9th parallax image signal.
In employing many parallaxes mode and when have input the three dimensional video signal of the image comprising nine parallaxes, anaglyph converter section 12 uses its vision signal to generate the first anaglyph ~ the 9th parallax image signal.
Spectators' test section 13 uses the video photographed by video camera 3 to carry out face recognition, obtains information (such as, facial information, the positional information of spectators of spectators.Below be generically and collectively referred to as " spectators' identifying information ".), be supplied to spectators' selection portion 16 described later.Even if spectators move, spectators' test section 13 also can be followed the trail of, thus can grasp the audiovisual time of each spectators.
The positional information display of spectators is as such as with the position on the central authorities of liquid crystal panel 1 be initial point X-axis (horizontal direction), Y-axis (vertical direction) and Z axis (direction orthogonal with liquid crystal panel 1).The position of the spectators 20 shown in Fig. 4 represents with coordinate (X1, Y1, Z1).More specifically, first spectators' test section 13 identifies spectators by detecting face from the video photographed with video camera 3.Next, the position (X1, Y1) of spectators' test section 13 in the position calculation X-axis and Y-axis of the spectators video, calculates the position (Z1) on Z axis according to the size of face.When there being multiple spectators, spectators' test section 13 also can detect predetermined quantity such as 10 spectators.In this case, when the number ratio 10 of the face detected is large, according to the position of ascending sequence detection 10 spectators in the position such as close to liquid crystal panel 1, namely on Z axis.
Ken information calculating part 14 uses the positional information of the spectators selected by spectators' selection portion 16 described later, calculates the controling parameters of the ken for setting the spectators including selection in.This controling parameters is such as the amount that anaglyph is offset illustrated by Fig. 3, and it is the combination of a parameter or multiple parameter.And the controling parameters calculated is supplied to Image Adjusting portion 15 by ken information calculating part 14.
More specifically, in order to set the ken wanted, ken information calculating part 14 uses controling parameters and ken database corresponding to the ken that sets with this controling parameters.This ken database is previously stored in storage part 17.Ken information calculating part 14 passes through retrieval ken database, to find out the ken of the spectators that can include selection in.
In addition, when not having spectators to be selected by spectators' selection portion 16, ken information calculating part 14 calculates for setting controling parameters spectators as much as possible being included in the ken in the ken.
Image Adjusting portion (ken control part) 15 in order to control the ken, and according to the controling parameters that calculates parallax image signal offset or interpolation adjustment after, be supplied to liquid crystal panel 1.Liquid crystal panel 1 shows the image corresponding with the parallax image signal after adjustment.
Spectators' selection portion 16, based on the relative importance value assessment rules for evaluating relative importance value to spectators, evaluates relative importance value to the spectators detected by spectators' test section 13.Then, spectators' selection portion 16 specifies the spectators of number (one or more) from spectators by relative importance value selective sequential from high to low, the positional information of the spectators selected is supplied to ken information calculating part 14.
In addition, relative importance value assessment rules can be preset, and can select the rule wanted by user according to menu screen etc. from multiple relative importance value assessment rules, also can set regulation relative importance value assessment rules when goods shipment.
In addition, when not setting relative importance value assessment rules, spectators' selection portion 16 represents to ken information calculating part 14 notice does not select spectators to be that the spectators that do not select of content notify.
Storage part 17 is nonvolatile memories of flash memory etc., and it is except storing ken database, also stores user's registration information described later, the preferential audience information of 3D, initial audiovisual position etc.In addition, this storage part 17 also can be located at the outside of controller 10.
Above, the structure of video process apparatus 100 is illustrated.Show in the present embodiment by using cylindrical lens 2 to make anaglyph offset with the example controlling the ken, but also can control the ken with additive method.Such as, also can replace cylindrical lens 2 and disparity barrier is provided as opening control part 2 '.Fig. 5 is the block diagram of the schematic configuration of the video process apparatus 100 ' illustrated as the modified embodiment of the present embodiment shown in Fig. 2.As shown in Figure 5, the controller 10 ' of video process apparatus 100 ' possesses ken control part 15 ', to replace Image Adjusting portion 15.This ken control part 15 ' controls opening control part 2 ' according to the controling parameters utilizing ken information calculating part 14 to calculate.When this variation, controling parameters is distance, liquid crystal panel 1 and opening control part 2 ' side-play amount etc. in the horizontal direction between liquid crystal panel 1 and opening control part 2 '.
In this variation, control the ken by the outbound course controlling the anaglyph shown at liquid crystal panel 1 with opening control part 2 '.Like this, the process also can not carrying out anaglyph is offset and utilize ken control part 15 ' to control opening control part 2 '.
Then, using the flow chart of Fig. 6, being described adopting the method for processing video frequency of the video process apparatus 100 (100 ') formed as mentioned above.
(1) spectators' test section 13 uses the video photographed by video camera 3 to carry out face recognition, obtains spectators' identifying information (step S1).
(2) spectators' test section 13 judges whether spectators are multiple (step S2).Consequently, if spectators are people, then spectators' identifying information of these spectators is supplied to spectators' selection portion 16 by spectators' test section 13.On the other hand, if spectators are multiple people, then spectators' identifying information of the multiple spectators detected all is supplied to spectators' selection portion 16 by spectators' test section 13.
(3) spectators' selection portion 16 is when only supplying the viewer's location information of people's amount from spectators' test section 13, select these spectators (people), and spectators' identifying information of these spectators is supplied to ken information calculating part 14 (step S3).
(4) ken information calculating part 14 calculates controling parameters (step S4), and selected spectators (people) are included in (such as, the center of the ken, position of the three-dimensional video-frequency seeing first water by this controling parameters for setting.Same below.) the ken.
(5) spectators' selection portion 16 is when spectators are multiple, determines whether the relative importance value assessment rules (step S5) be set with for evaluating relative importance value to spectators.
(6) when not setting relative importance value assessment rules, spectators' selection portion 16 will not select the context notification of spectators to ken information calculating part 14 (step S6).
(7) ken information calculating part 14 calculates the controling parameters (step S7) for setting the ken including spectators as much as possible in.
(8) spectators' selection portion 16 evaluates relative importance value based on relative importance value assessment rules to spectators, from spectators, specify the spectators of number by relative importance value selective sequential from high to low, and spectators' identifying information (positional information) of selected spectators is supplied to ken information calculating part 14 (step S8).
About the concrete method spectators detected being evaluated to relative importance value, such as when the relative importance value assessment rules making the spectators of the frontal being positioned at liquid crystal panel 1 preferential, spectators' selection portion 16 uses the positional information of the spectators supplied from spectators' test section 13, evaluates high relative importance value according to the spectators from the frontal being positioned at liquid crystal panel 1 to the order of the spectators being positioned at skew direction.Then, spectators' selection portion 16 specifies the spectators of number (one or more) according to the selective sequential of the highest spectators of relative importance value.In addition, relative importance value assessment rules in addition also hypothesis have various rule, after other concrete examples are described in the lump.
(9) ken information calculating part 14 calculates for setting the controling parameters (step S9) selected spectators being included in the ken in the ken.
In addition, the situation (namely can not find the situation of the ken including selected theater in) of selected theater can not be included in the ken under, ken information calculating part 14 calculates controling parameters, and the order by the highest spectators of relative importance value is included in the ken of the spectators of selection as much as possible by this controling parameters for setting.Such as, first, except the spectators that relative importance value in the spectators of selection is minimum, attempt calculating for setting the controling parameters remaining spectators all being included in the ken in the ken.Even if when controling parameters can not be calculated like this, except the spectators that relative importance value in remaining spectators is minimum, attempt calculating controling parameters.Calculating by repeating this, always spectators high for relative importance value can be included in the ken.
In addition, no matter whether spectators' entirety that ken information calculating part 14 also can be selected is included in the ken and calculate controling parameters, the spectators having evaluated the highest relative importance value in selected spectators are included in the ken of the position of the three-dimensional video-frequency seeing first water by this controling parameters for setting.
In addition, ken information calculating part 14 also when the quantity of the spectators selected by spectators' selection portion 16 is people, can calculate the controling parameters of the ken for setting the position these spectators being included in the three-dimensional video-frequency seeing first water.
(10) Image Adjusting portion 15 uses controling parameters adjustment image (parallax image signal) calculated in step S4, step S7 or step S9, and is supplied to liquid crystal panel 1 (step S10).
In addition, when the video process apparatus 100 ' that variation relates to, ken control part 15 ' uses the controling parameters calculated in step S4, step S7 or step S9, controls opening control part 2 '.
(11) liquid crystal panel 1 shows the image (step S11) after being adjusted by Image Adjusting portion 15 in step slo.
In addition, when the video process apparatus 100 ' that variation relates to, liquid crystal panel 1 shows the image supplied from anaglyph converter section 12.
Then, use (a), (b) and (c) of Fig. 7, the setting of the ken adopting above-mentioned method for processing video frequency is specifically described.
(a), (b) and (c) of Fig. 7 illustrates the ken (Sa, Sb, Sc) of video process apparatus 100 (100 '), spectators (four people) and setting.Between each figure, quantity and the position of spectators are identical.In addition, represent relative importance value to the alphabet of spectators' mark, relative importance value uprises by the order of A, B, C, D.
(a) of Fig. 7 illustrates an example of the ken through step S6 and step S7 setting.As shown in (a) of Fig. 7, three spectators enter in ken Sa.In this case, owing to not setting relative importance value assessment rules, so do not consider the relative importance value of spectators, set the ken in the mode of the quantity maximizing the spectators included in the ken.
(b) and (c) of Fig. 7 illustrates the ken through step S8 and step S9 setting.In (b) of Fig. 7, compared with (a) of Fig. 7, the number including the spectators of the ken in reduces, but higher two spectators of relative importance value enter ken Sb.In addition, in (c) of Fig. 7, compared with (b) of Fig. 7, the number included in the ken reduces further, but the mode that the highest spectators of relative importance value are positioned at the center of the ken sets ken Sc.
Then, concrete example (a) ~ (h) of relative importance value assessment rules is enumerated.
A (), compared with the end of liquid crystal panel 1, the possibility that the side being positioned at the spectators in front has higher audiovisual enthusiasm is larger.Therefore, as shown in (a) of Fig. 8, in this relative importance value assessment rules, evaluate high relative importance value by the spectators from the frontal being positioned at liquid crystal panel 1 to the order of spectators of the end being positioned at liquid crystal panel 1.
When adopting this relative importance value assessment rules, spectators' selection portion 16 such as uses the positional information of spectators, obtain the face angulation (maximum 90 °) of the display surface of liquid crystal panel 1 and the vertical direction by the center of spectators and liquid crystal panel 1, from the spectators that this angle is larger, evaluate higher relative importance value successively.
B () makes the spectators close to best audiovisual distance (distances between liquid crystal panel 1 and spectators) on the basis seeing three-dimensional video-frequency preferential.As shown in (b) of Fig. 8, in this relative importance value assessment rules, evaluate high relative importance value from audiovisual on the basis seeing three-dimensional video-frequency successively apart from the spectators close to best audiovisual distance (best audiovisual distance d).In addition, the value of best audiovisual distance d depends on the various parameters of the size of liquid crystal panel etc., is thus set to the goods for each video process apparatus and different values.
When adopting this relative importance value assessment rules, spectators' selection portion 16 obtains the difference of position on the Z axis that contains in the positional information of spectators and best audiovisual distance d, and evaluates higher relative importance value successively from the spectators that this difference is less.
C spectators that () audiovisual time is longer, the possibility this program to higher audiovisual enthusiasm is larger.Therefore, in this relative importance value assessment rules, from the spectators that the audiovisual time is longer, evaluate higher relative importance value.The audiovisual time such as with the time started of the program in audiovisual for benchmark calculates.The time started of the program in audiovisual can obtain from electric program guide (EPG) etc.In addition, the time that also can carry out frequency-selecting to the program in audiovisual audiovisual time is that benchmark calculates.In addition, the audiovisual time also can the power supply of video display devices 100 to be access in and the time starting video display is that benchmark calculates.
When adopting this relative importance value assessment rules, spectators' selection portion 16 calculates the audiovisual time for each spectators, and evaluates high relative importance value successively from the spectators that the audiovisual time is longer.
D () holds the surgical procedure remote controller of remote controller to select audiovisual channel, because of but the possibility of center spectators is larger.Therefore, in this relative importance value assessment rules, to holding the spectators of remote controller or evaluating the highest relative importance value closest to the spectators of remote controller.
When adopting this relative importance value assessment rules, spectators' test section 13 identifies the spectators holding remote controller, and spectators' identifying information of these spectators is supplied to spectators' selection portion 16.As the recognition methods of spectators holding remote controller, there is such as the following method: detect the infrared ray sent from remote controller or the mark preset at remote controller with video camera 3, with identify from the nearest spectators of remote control position method or utilize image recognition Direct Recognition to hold the method for the spectators of remote controller.And, the relative importance value that spectators' selection portion 16 is the highest to the spectators' evaluation holding remote controller.In addition, spectators' selection portion 16 also to the spectators except the spectators holding remote controller, such as, can evaluate higher relative importance value successively from the spectators closest to remote controller.
(e) with information relevant for the user of video process apparatus 100 can be stored in storage part 17 as user's registration information.This user's registration information, except name, facial photo, can also comprise the information of 3D audiovisual relative importance value etc. of relative importance value of age, height, expression audiovisual three-dimensional video-frequency.In this relative importance value assessment rules, make the spectators that this 3D audiovisual relative importance value is higher preferential.
When adopting this relative importance value assessment rules, spectators' test section 13 obtains the facial information of each spectators from the video photographed with video camera 3.And spectators' test section 13 by mating the facial photo of the user's registration information of (matching) with facial information to each spectators retrieval, thus reads the 3D audiovisual relative importance value of these spectators from storage part 17.And the information providing that block position information and 3D audiovisual relative importance value obtain by the corresponding each spectators of spectators' test section 13 is to spectators' selection portion 16.Spectators' selection portion 16, based on the information supplied from spectators' test section 13, evaluates high relative importance value successively from the spectators that 3D audiovisual relative importance value is high.In addition, also can to the relative importance value not having the spectators of user's registration information to evaluate low (or minimum).
F () video display devices 100 has the video that photographed by video camera 3 (hereinafter also referred to " camera video ".) be shown in the function of liquid crystal panel 1.As shown in (c) of Fig. 8, in camera video, can in face's supplementary frame pattern of the spectators identified, to select the spectators specified.In this relative importance value assessment rules, high relative importance value is evaluated to the spectators selected on camera video.
More specifically, user selects spectators on camera video.Thus, the facial information of the spectators of selection is stored in storage part 17 as the preferential audience information of 3D.In addition, the selection of spectators can be changed on camera video.And, if there are the spectators consistent with the facial information of the preferential audience information of the 3D being stored in storage part 17, then the relative importance value that spectators' selection portion 16 is the highest to these spectators evaluation.
In addition, as shown in (c) of Fig. 8, on camera video, order of priority can be evaluated to select to multiple spectators.In this case, spectators' selection portion 16 utilizes priority rating on camera video to evaluate relative importance value to spectators.Like this, based on 3D preferential audience information, relative importance value is evaluated to spectators.
G (), according to the configuration state of the furniture of video process apparatus 100 and sofa, chair etc., is supposed not to be front from liquid crystal panel 1 but from the more situation of skew direction audiovisual.In such a situation, the frequency gets higher that sets along the skew direction of liquid crystal panel 1 of the ken.Therefore, in this relative importance value assessment rules, the spectators making to be positioned at the place being set as the ken are continually preferential.
When adopting this relative importance value assessment rules, the controling parameters calculated such as all is stored in storage part 17 when each calculating controling parameters by ken information calculating part 14.And spectators' selection portion 16, according to the controling parameters given settings ken being often stored in storage part 17, evaluates the relative importance value higher than the spectators be positioned at outside this ken to the spectators being positioned at this ken.
H the position etc. of the easiest audiovisual also can be set as initial audiovisual position by the user of () video process apparatus 100.In this relative importance value assessment rules, user presets initial audiovisual position, and uses the spectators being positioned at this initial audiovisual position preferential.
When adopting this relative importance value assessment rules, storage part 17 preserves the information relevant to the initial audiovisual position that user sets.Spectators' selection portion 16 reads the initial audiovisual position of setting from storage part 17, and evaluates high relative importance value to the spectators being positioned at this audiovisual position.
As mentioned above, according to video process apparatus of the present embodiment and method for processing video frequency, even there are multiple spectators and a spectators' part does not include the situation in the ken in, by spectators high for relative importance value being included in the ken, thus the spectators of high relative importance value can see high-quality three-dimensional video-frequency.
In addition, in the present embodiment, when being set with relative importance value assessment rules, the ken is controlled in mode spectators high for relative importance value included in the ken.Therefore, result can improve the performance of face tracking.That is, although such as there is no spectators, when spectators' test section flase drop measures spectators, cause adjusting the ken to such spectators in common face tracking.Relative to this, according to present embodiment, according to the relative importance value assessment rules etc. making the high spectators of the 3D audiovisual relative importance value of user's registration information, the spectators that select on camera video preferential, then can ignore spectators as above, thus suitably can carry out the adjustment of the ken.
Although the description of several execution mode of the present invention, but these execution mode is pointed out as an example, and be not intended to limit scope of invention.These execution modes can be implemented in other various modes, can carry out various omissions, replacement, change in the scope of thought not departing from invention.These execution modes or its distortion, be contained in scope of invention, thought, is equally also contained in the invention described in claims with in the scope of its equivalence.
Claims (20)
1. a video process apparatus, is characterized in that, comprising:
Spectators' test section, uses the video photographed by video camera to carry out face recognition, to obtain the positional information of spectators;
Spectators' selection portion, when described spectators are multiple, based on the relative importance value assessment rules of regulation, evaluate relative importance value to multiple described spectators, specifies the spectators of number from multiple described spectators by relative importance value selective sequential from high to low;
Ken information calculating part, using the positional information of the described spectators selected, calculating the controling parameters of the ken for setting the described spectators including selection in;
Ken control part, controls the ken according to described controling parameters;
Display part, multiple anaglyphs that the spectators that display is positioned at the described ken can watch as three-dimensional video-frequency; And
Opening control part, exports the multiple anaglyphs shown at described display part along prescribed direction,
When being set with described relative importance value assessment rules, control the ken in mode spectators high for described relative importance value included in the ken.
2. video process apparatus according to claim 1, is characterized in that,
Described ken information calculating part, when the described spectators' entirety selected not being included in the ken, calculates the controling parameters of the ken for setting the described spectators including selection as much as possible from the spectators that relative importance value is the highest successively in.
3. video process apparatus according to claim 1, is characterized in that,
Described ken information calculating part calculates for setting the controling parameters spectators being assessed as the highest relative importance value in the described spectators selected being included in the ken of the position of the three-dimensional video-frequency seeing first water.
4. video process apparatus according to claim 1, is characterized in that,
When not setting described relative importance value assessment rules, whether described spectators' selection portion be do not select the spectators that or not of spectators to notify to described ken information calculating part content of announcement,
Described ken information calculating part, when not selecting spectators to notify described in receiving, calculates the controling parameters for setting the ken including multiple described spectators as much as possible in.
5. video process apparatus according to claim 1, is characterized in that,
Described ken information calculating part, when the quantity of the spectators detected by described spectators' test section or the quantity of spectators selected by described spectators' selection portion are people, calculates the controling parameters of the ken for setting the position these spectators being included in the three-dimensional video-frequency seeing first water.
6. video process apparatus according to claim 1, is characterized in that,
Described spectators' selection portion evaluates high relative importance value according to the spectators from the front being positioned at described display part to the order of spectators of the end being positioned at described display part.
7. video process apparatus according to claim 1, is characterized in that,
Described spectators' selection portion from audiovisual distance from best audiovisual apart from close to spectators be assessed as high relative importance value successively, described audiovisual distance is the distance between described display part and described spectators, and described best audiovisual distance is audiovisual distance best on viewing three-dimensional video-frequency.
8. video process apparatus according to claim 1, is characterized in that,
Described spectators' selection portion evaluates high relative importance value successively from the spectators that the audiovisual time is long.
9. video process apparatus according to claim 1, is characterized in that,
Described spectators' selection portion is to holding the spectators of remote controller or evaluating the highest relative importance value closest to the spectators of remote controller.
10. video process apparatus according to claim 1, is characterized in that,
Described video process apparatus also comprises: storage part, and described storage part is preserved and comprised the facial photo of user and the user's registration information of 3D audiovisual relative importance value,
Described spectators' test section obtains the facial information of multiple described spectators respectively from the video photographed by described video camera, and by retrieving the facial photo of the described user's registration information mated with described facial information to spectators described in each, the described 3D audiovisual relative importance value of these spectators is read from described storage part
Described spectators' selection portion evaluates high relative importance value successively from the spectators that described 3D audiovisual relative importance value is high.
11. video process apparatus according to claim 1, is characterized in that,
Described video process apparatus also comprises: storage part, and the facial information of the spectators that the video photographed by described video camera, i.e. camera video are selected is preserved as the preferential audience information of 3D by described storage part,
Described spectators' selection portion, based on the preferential audience information of described 3D preserved at described storage part, evaluates relative importance value to multiple described spectators.
12. video process apparatus according to claim 1, is characterized in that,
Described video process apparatus also comprises: storage part, and described storage part preserves the described controling parameters that described ken information calculating part calculates,
Described spectators' selection portion according to the controling parameters given settings ken often of preserving at described storage part, and evaluates the relative importance value higher than the spectators be positioned at outside this ken to the spectators being positioned at this ken.
13. video process apparatus according to claim 1, is characterized in that,
Described video process apparatus also comprises: storage part, and described storage part preserves the information relevant to the initial audiovisual position that user sets,
Described spectators' selection portion reads described initial audiovisual position from described storage part, and evaluates high relative importance value to the spectators being positioned at this audiovisual position.
14. video process apparatus according to claim 1, is characterized in that,
Described ken control part
According to described controling parameters, adjust the display position of the multiple described anaglyph shown at described display part, or
According to described controling parameters, control the outbound course of the multiple described anaglyph shown at described display part.
15. 1 kinds of method for processing video frequency, is characterized in that, comprising:
The video photographed by video camera is used to carry out face recognition, to obtain the positional information of spectators;
When described spectators are multiple, based on the relative importance value assessment rules of regulation, evaluate relative importance value to multiple described spectators, from multiple described spectators, specify the spectators of number by relative importance value selective sequential from high to low;
Using the positional information of the described spectators selected, calculating the controling parameters of the ken for setting the described spectators including selection in; And
The ken is controlled according to described controling parameters,
When being set with described relative importance value assessment rules, control the ken in mode spectators high for described relative importance value included in the ken.
16. method for processing video frequency according to claim 15, is characterized in that,
When the described spectators' entirety selected not being included in the ken, calculate the controling parameters of the ken for setting the described spectators including selection as much as possible from the spectators that relative importance value is the highest successively in.
17. method for processing video frequency according to claim 15, is characterized in that,
Calculate and have the spectators of the highest relative importance value to include the controling parameters of the ken of the position of the three-dimensional video-frequency seeing first water in the evaluation in the described spectators selected for setting.
18. method for processing video frequency according to claim 15, is characterized in that,
When not setting described relative importance value assessment rules, calculate for setting the ken including multiple described spectators as much as possible in.
19. method for processing video frequency according to claim 15, is characterized in that,
Described method for processing video frequency also comprises: the user's registration information of the facial photo and 3D audiovisual relative importance value that comprise user is stored in storage part in advance,
The facial information of multiple described spectators is obtained respectively from the video photographed by described video camera, and by retrieving the facial photo of the described user's registration information mated with described facial information to spectators described in each, the described 3D audiovisual relative importance value of these spectators is read from described storage part
Higher relative importance value is evaluated successively from the spectators that described 3D audiovisual relative importance value is high.
20. method for processing video frequency according to claim 15, is characterized in that,
Described method for processing video frequency also comprises: the facial information of the video photographed by described video camera, the spectators namely selected on camera video is stored in storage part in advance as the preferential audience information of 3D,
Based on the preferential audience information of described 3D preserved at described storage part, relative importance value is evaluated to multiple described spectators.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2011-189548 | 2011-08-31 | ||
| JP2011189548A JP5134714B1 (en) | 2011-08-31 | 2011-08-31 | Video processing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102970565A CN102970565A (en) | 2013-03-13 |
| CN102970565B true CN102970565B (en) | 2015-03-04 |
Family
ID=47693081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210099542.XA Expired - Fee Related CN102970565B (en) | 2011-08-31 | 2012-04-06 | Video processing apparatus and video processing method |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20130050445A1 (en) |
| JP (1) | JP5134714B1 (en) |
| CN (1) | CN102970565B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5050094B2 (en) * | 2010-12-21 | 2012-10-17 | 株式会社東芝 | Video processing apparatus and video processing method |
| TWI637348B (en) * | 2013-04-11 | 2018-10-01 | 緯創資通股份有限公司 | Apparatus and method for displaying image |
| KR101618463B1 (en) * | 2014-12-09 | 2016-05-04 | 한국과학기술연구원 | System and method for measuring viewing zone characteristics of autostereoscopic 3d image display |
| KR102415502B1 (en) * | 2015-08-07 | 2022-07-01 | 삼성전자주식회사 | Method and apparatus of light filed rendering for plurality of user |
| US10735707B2 (en) * | 2017-08-15 | 2020-08-04 | International Business Machines Corporation | Generating three-dimensional imagery |
| JP7427413B2 (en) | 2019-10-21 | 2024-02-05 | Ｔｉａｎｍａ Ｊａｐａｎ株式会社 | Stereoscopic display system |
| CN113438464A (en) * | 2021-06-22 | 2021-09-24 | 纵深视觉科技(南京)有限责任公司 | Switching control method, medium and system for naked eye 3D display mode |
| CN114356088B (en) * | 2021-12-30 | 2024-03-01 | 纵深视觉科技(南京)有限责任公司 | Viewer tracking method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101750746A (en) * | 2008-12-05 | 2010-06-23 | 财团法人工业技术研究院 | Three-dimensional image displayer |
| CN102123291A (en) * | 2011-02-12 | 2011-07-13 | 中山大学 | Intelligent naked-eye stereoscopic display system and control method thereof |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3361205B2 (en) * | 1995-02-08 | 2003-01-07 | 日本放送協会 | 3D image display device |
| JPH1074267A (en) * | 1996-07-03 | 1998-03-17 | Canon Inc | Display control device and its method |
| JPH10150676A (en) * | 1996-09-17 | 1998-06-02 | Terumo Corp | Image display device |
| JPH10174127A (en) * | 1996-12-13 | 1998-06-26 | Sanyo Electric Co Ltd | Method and device for three-dimensional display |
| US6931596B2 (en) * | 2001-03-05 | 2005-08-16 | Koninklijke Philips Electronics N.V. | Automatic positioning of display depending upon the viewer's location |
| JP2007322452A (en) * | 2006-05-30 | 2007-12-13 | Matsushita Electric Ind Co Ltd | Image display device and its method, and storage medium |
| JP2009010776A (en) * | 2007-06-28 | 2009-01-15 | Sony Corp | Imaging device, photography control method, and program |
| US8100372B2 (en) * | 2008-10-10 | 2012-01-24 | Michael Vlies | Display mount for corner installations |
| JP2011145349A (en) * | 2010-01-12 | 2011-07-28 | Nikon Corp | Display device |
| JP2012010085A (en) * | 2010-06-24 | 2012-01-12 | Sony Corp | Three-dimensional display device and control method of three-dimensional display device |
-
2011
- 2011-08-31 JP JP2011189548A patent/JP5134714B1/en not_active Expired - Fee Related
-
2012
- 2012-02-27 US US13/406,285 patent/US20130050445A1/en not_active Abandoned
- 2012-04-06 CN CN201210099542.XA patent/CN102970565B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101750746A (en) * | 2008-12-05 | 2010-06-23 | 财团法人工业技术研究院 | Three-dimensional image displayer |
| CN102123291A (en) * | 2011-02-12 | 2011-07-13 | 中山大学 | Intelligent naked-eye stereoscopic display system and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| US20130050445A1 (en) | 2013-02-28 |
| JP2013051622A (en) | 2013-03-14 |
| CN102970565A (en) | 2013-03-13 |
| JP5134714B1 (en) | 2013-01-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102970565B (en) | Video processing apparatus and video processing method | |
| CN102970569B (en) | Viewing area adjusting device, video processing device, and viewing area adjusting method | |
| US20130113899A1 (en) | Video processing device and video processing method | |
| US9030467B2 (en) | Electronic apparatus and method for displaying graphical user interface as 3D image | |
| US10694173B2 (en) | Multiview image display apparatus and control method thereof | |
| KR102121389B1 (en) | Glassless 3d display apparatus and contorl method thereof | |
| US8477181B2 (en) | Video processing apparatus and video processing method | |
| CN102970561B (en) | Video processing apparatus and video processing method | |
| US9179141B2 (en) | Three-dimensional image display apparatus and viewing position check method | |
| KR20110044573A (en) | Display device and image display method thereof | |
| KR102174258B1 (en) | Glassless 3d display apparatus and contorl method thereof | |
| KR102143473B1 (en) | Multi view image display apparatus and multi view image display method thereof | |
| CN102970567B (en) | Video processing apparatus and video processing method | |
| JP5127967B1 (en) | Video processing apparatus and video processing method | |
| CN102970562B (en) | Video processing apparatus, video processing method and remote controller | |
| CN107258079A (en) | For the methods, devices and systems for the crosstalk for reducing automatic stereoscopic display device | |
| JP5500645B2 (en) | Video adjustment device, television receiver, and program | |
| KR101980275B1 (en) | Multi view image display apparatus and display method thereof | |
| KR20110135053A (en) | Method for approving image quality of 3 dimensional image and digital broadcast receiver thereof | |
| JP2011193057A (en) | Three-dimensional image display apparatus, and image processing apparatus | |
| JP5032694B1 (en) | Video processing apparatus and video processing method | |
| KR20110037068A (en) | An apparatus for displaying stereoscopic image and a method for controlling video quality | |
| JP5433766B2 (en) | Video processing apparatus and video processing method | |
| JP2013055675A (en) | Image processing apparatus and image processing method | |
| WO2013006731A1 (en) | Three-dimensional image display using a dynamically variable grid |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150304 Termination date: 20160406 |