CN103475831A - Caption control method applied to display device and component - Google Patents

Caption control method applied to display device and component Download PDF

Info

Publication number
CN103475831A
CN103475831A CN2012101842099A CN201210184209A CN103475831A CN 103475831 A CN103475831 A CN 103475831A CN 2012101842099 A CN2012101842099 A CN 2012101842099A CN 201210184209 A CN201210184209 A CN 201210184209A CN 103475831 A CN103475831 A CN 103475831A
Authority
CN
China
Prior art keywords
captions
presentation mode
eye picture
left eye
right eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012101842099A
Other languages
Chinese (zh)
Inventor
郑昆楠
陈仲怡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MStar Software R&D Shenzhen Ltd
MStar Semiconductor Inc Taiwan
Original Assignee
MStar Software R&D Shenzhen Ltd
MStar Semiconductor Inc Taiwan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MStar Software R&D Shenzhen Ltd, MStar Semiconductor Inc Taiwan filed Critical MStar Software R&D Shenzhen Ltd
Priority to CN2012101842099A priority Critical patent/CN103475831A/en
Publication of CN103475831A publication Critical patent/CN103475831A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention relates to a caption control method which is applied to a display device and used for dynamic regulation of captions of an original image. The original image comprises a right-eye image and a left-eye image. The right-eye image comprises right-eye caption information. The left-eye image comprises left-eye caption information. The caption control method comprises the following steps: an adjusted caption display mode is selected; displacement of the right-eye caption information and the left-eye caption information is determined; and the displacement is adjusted selectively according to the adjusted caption display mode and a three-dimensional depth so as to make the adjusted caption displayed by the right-eye image and the left-eye image has an adjusted caption three-dimensional depth, wherein the adjusted caption display mode comprises a static display mode and a dynamic 3D display mode.

Description

Be applied to captions control method and the element of display unit
Technical field
The present invention is a kind of control method and element of signal of video signal, and particularly relevant for a kind of captions control method and element that is applied to display unit.
Background technology
Under drive due to the 3D film, its Related product, for example the 3D television set, also start flourish.After the signal of video signal input 3D television set for example, produced by 3D image source (supporting the player of 3D image), the 3D TV can be presented in the 3D picture on the 3D television set and appreciate the 3D film for the audience according to signal of video signal.
In general, after 3D television reception signal of video signal, see through the left eye and the right eye that alternately show left eye picture and right eye picture and alternately shield accordingly the audience on screen, or left eye picture and right eye picture are play with horizontal interleaving mode (Row Interlaced Format) simultaneously, and utilize micro-light polarizing film (micro polarizer) and make audience's left eye only can see the left eye picture in audience's end, audience's right eye only can be seen the right eye picture.Due to the difference slightly of object in left eye picture and right eye picture, the audience can see the 3D film that 3D presents.
In the manufacturing process of signal of video signal, need first utilize the video camera of two diverse locations to take same object, the First video camera is clapped to obtain the left eye picture, and second video camera clapped to obtain the right eye picture.And in the process rear processed of signal of video signal, except to be that time interleaving or level are staggered by left eye picture and right eye picture process, also optionally in left eye picture and right eye picture, increase captions (subtitle), make the audience can understand the conversation content of image.And, after having made after signal of video signal, when the 3D image source gets final product the transmitting image signal to the 3D TV, make the 3D TV to play the 3D film according to signal of video signal.
If during 3D image source output image signal, the ad-hoc location at left eye picture and right eye picture adds captions, existing 3D TV treatment mechanism can't change the subtitle position in left eye picture and right eye picture, and the image characteristics of captions, for example changes the 2D captions into the 3D captions.
In other words, when 3D image source output image signal has comprised captions, existing 3D TV, only as the receiving system of signal of video signal, can't change position and the image characteristics of captions.To cause in some cases the audience can't adapt to the presentation mode of captions when appreciating the 3D film, and cause eyes discomfort and the tired situation of eyes extremely.
Summary of the invention
The objective of the invention is to propose a kind of captions control method and element that is applied to display unit.After display unit receives the original image signal of image source output, fechtable goes out the captions in left eye picture and right eye picture, and changes the 3D degree of depth of captions, makes captions can allow the audience select to present or present in the 2D mode in the 3D mode.
The present invention is relevant for a kind of captions control method, be applied to a display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, and this captions control method comprises the following steps: to select captions presentation mode after an adjustment; Judge a displacement of this right eye caption information and this left eye caption information; And optionally according to captions presentation mode after this adjustment and a three dimensional depth, adjust this displacement, what this right eye picture and this left eye picture were presented one adjusts afterwards captions and has captions three dimensional depth after an adjustment; Wherein, after this adjustment, the captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
The present invention is relevant for a kind of captions control method, be applied to a display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, and this captions control method comprises the following steps: the displacement according to this right eye caption information and this left eye caption information, to judge an original captions presentation mode; Select whether to change this original captions presentation mode; And optionally produce a three dimensional depth adjust according to this this displacement, what this right eye picture and this left eye picture were presented one adjusts afterwards captions and has captions three dimensional depth after an adjustment; Wherein, this original captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
The present invention also proposes a kind of captions control element that is applied to display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, this captions control element comprises: a captions acquisition unit, from this left eye picture capture this left eye caption information and certainly this right eye picture capture this right eye caption information, and according to a displacement of this right eye caption information and this left eye caption information, to judge an original captions presentation mode, one screen processing, in order to produce a three dimensional depth, an and captions superposition unit, produce one in order to selectivity according to this three dimensional depth and adjust rear left eye picture and the rear right eye picture of an adjustment, wherein, after the adjustment that after right eye picture and this adjustments, the left eye picture presents after this adjustment, captions have captions three dimensional depth after an adjustment.
The present invention also proposes a kind of captions control method, being applied to the 2D video conversion that a display unit will possess a single picture is a 3D image that possesses a right eye picture and a left eye picture, and this captions control method comprises the following steps: to capture the captions in this single picture; And optionally by this captions superposition in this right eye picture and this left eye picture, this right eye picture and this left eye picture are presented one adjust after captions there is captions three dimensional depth after an adjustment; Wherein, after this adjustment, the captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
For there is to better understanding above-mentioned and other aspect of the present invention, preferred embodiment cited below particularly, and coordinate accompanying drawing, be described in detail below:
The accompanying drawing explanation
When Figure 1A and 1B illustrate are watched same object for eyes, the imaging schematic diagram of indivedual eyes.
Fig. 2 A, 2B, 2C, 2D illustrate are for utilize different pictures that eyes are seen to decide the method for the far and near position of object simultaneously.
Fig. 3 A, 3B, 3C illustrate are explained the relation between object and eyes for controlling the 3D degree of depth.
The presentation mode that Fig. 4 A, 4B illustrate are captions in the 3D TV.
Fig. 5 illustrate is applied to an embodiment of the captions control method of display unit for the present invention.
Fig. 6 A, 6B, 6C illustrate are various captions schematic diagrames in picture.
Fig. 7 illustrate is applied to another embodiment of the captions control method of display unit for the present invention.
Fig. 8 illustrate is applied to the embodiment of the captions control element of display unit for the present invention.
The captions that Fig. 9 A illustrates as 2D is presented change the captions schematic diagram that 3D presents into.
Fig. 9 B illustrate changes for the captions that 3D is presented the captions schematic diagram that 2D presents into.
Fig. 9 C illustrate changes for the captions that 3D is presented the captions schematic diagram that 3D presents into.
The main element symbol description
30: object
35: screen plane
38: captions
302,302L, 302R: rhombus object
304,304L, 304R: circular object
306,306L, 306R: triangle object
710: the captions acquisition unit
720: screen processing
The 724:3D advanced treatment unit
730: captions superposition unit
Embodiment
Due to the 3D TV, when presenting an object, because the difference of left eye picture and right eye picture, can allow image that audience's brain is seen according to eyes set up the object of 3D.Below introduce in detail its principle.
In general, human brain is that the image that utilizes left eye and right eye to see is set up three-dimensional visual effect.That is to say, when left eye and right eye are seen same object, it is a little different that left eye and the image presented of right eye have, and the image that brain of human body is seen according to eyes is set up 3-dimensional image.
Please refer to Figure 1A and 1B, when its illustrate is watched same object for eyes, the imaging schematic diagram of indivedual eyes.When an object, when approaching very much position, the dead ahead I of eyes, the object that left eye is seen can be on the right side of left eye picture, and the object that right eye is seen can be in the left side of right eye picture.When object continues away from eyes, the object that left eye and right eye are seen can approach toward central authorities gradually.Suppose that object is when the II of position, the image that right and left eyes is seen is identical, that is object is in the centre of image, and the distance of this position II and eyes mid point can be considered a reference distance.When object continues away from eyes, the object that left eye is seen can be in the left side of left eye picture, and the object that right eye is seen can be on the right side of right eye picture.
According to above-mentioned characteristic, develop the concept of a kind of 3D degree of depth (3D depth).Please refer to Fig. 2 A, 2B, 2C, 2D, its illustrate is for utilize different pictures that eyes are seen to decide the method for the far and near position of object simultaneously.And following description is only carried out with horizontal direction.
Suppose left eye picture that left eye sees as shown in Figure 2 A, in image rhombus object 302L left side, circular object 304L on right side, triangle object 306L is in central authorities; And the right eye picture that right eye is seen is as shown in Fig. 2 B, in image rhombus object 302R on right side, circular object 304R in left side, triangle object 306R is in central authorities.Therefore, can obtain as shown in Figure 2 C the distance relation between three objects and eyes.That is, circular object 304 approach most eyes, triangle object 306 on reference position, rhombus object 304 is away from eyes.In other words, can learn the distance of this object and eyes according to the relative position of same item in left-eye images and right-eye image.
As shown in Figure 2 D, the left eye picture of supposing Fig. 2 A is defined as a reference picture (reference picture), in Fig. 2 B and the displacement of the horizontal range caused because of parallax/visual field between same item in two images in Fig. 2 A be the 3D degree of depth of this object.Clearly, so triangle object 306L and the 306R 3D degree of depth of triangle object 306 on reference position is 0, that is, in the visual field image of right and left eyes, the horizontal level of triangle object 306 is identical.In like manner, in the left eye picture, circular object 204L is positioned at right side, and in the right eye picture, circular object 204R is positioned at left side, so the 3D degree of depth of circular object 204 d1 that is negative value.In like manner, in the left eye picture, rhombus object 204L is positioned at left side, and in the right eye picture, rhombus object 204R is positioned at right side, thus the 3D degree of depth of rhombus object 204 be on the occasion of d2.
Certainly, also can be via the concept of coordinate translation, by the 3D degree of depth be defined as be all on the occasion of.In other words, it is less that object more approaches its 3D degree of depth of eyes, more larger away from its 3D degree of depth of eyes.Following example explanation explanation is all that the 3D degree of depth with reference position equals 0, and more approach the eyes 3D degree of depth, is less negative value, and away from the eyes 3D degree of depth be larger on the occasion of.
As shown in Figure 3A, when the 3D TV shows that the 3D degree of depth (3Dth) of an object 30 and this object 30 is 0, two eyes of audience can be seen identical picture, and this object 30 is presented on screen plane 35.In other words, the screen plane 35 of 3D TV can be considered reference position, and now audience's eyes focus on object 30, namely on screen plane 35.
As shown in Figure 3 B, when the 3D TV shows this object 30, and the 3D degree of depth of this object is when (3Dth=+a), and the audience can see that this object 30 is presented on screen plane 35 rears.And audience's eyes focus on the rear of screen plane 35.When a value becomes large gradually, the audience can think that this object 30 is more and more far away apart from screen plane 35 rears.
As shown in Figure 3 C, when the 3D TV shows this object 30, and the 3D degree of depth of this object is while being negative value (3Dth=-b), and the audience can see that this object 30 is presented on screen plane 35 the place aheads.Now audience's eyes focus on the place ahead of screen plane 35.When the b value becomes large gradually, the audience can feel the more and more nearer audience of this object 30.
From above explanation, while utilizing the concept of the 3D degree of depth to control left eye picture and right eye picture, can allow object 30 be presented on screen plane 35 or any distance of screen plane 35 front and back.That is to say, control the horizontal displacement (the 3D degree of depth) of object 30 in left eye picture and right eye picture, can control the distance between object 30 and audience.
In general, the signal of video signal of 3D film is for example, by image source (player) while exporting the 3D TV to, and captions are Already in left eye picture and right eye picture, so 3D TV position that can't the control word curtain.And, in the signal of video signal that image source produces, the presentation mode of subtitle position has following two kinds of modes.
As shown in Figure 4 A, in the identical situation in position when captions 38 in left eye picture and right eye picture, the audience will see that captions 38 are presented on the screen plane 35 of 3D TV.That is to say, the 3D degree of depth of captions 38 is zero (3Dth=0), and captions 38 present in the mode of 2D.Moreover, in the 3D TV during at projection 3D film, because the 3D degree of depth of object 30 is changing at any time, so object 30 is to change at any time with the distance of eyes.
In the situation that above-mentioned, the audience is in the process of appreciating the 3D film, and its eyes need to constantly focus on object 30 and captions 38, therefore views and admires after 3D film a period of time the discomfort that can cause eyeball and tired.
Perhaps, as shown in Figure 4 B, during the image source output image signal, the 3D degree of depth of captions 38 changes along with the 3D degree of depth of object.Now, audience's eyes can focus on object 30 and captions 38 simultaneously.Yet such captions 38 presentation modes also can allow the audience of part only can't adapt to.
According to embodiments of the invention, for example, for example, when the shown device (3D TV) of the signal of video signal of image source (player) output receives, display unit can be analyzed the position of captions in left eye picture and right eye picture, and judges the 3D degree of depth of these captions.Moreover, captions acquisition unit fechtable left eye picture in display unit and the captions in the right eye picture, present in the 3D mode or present (the 2D mode for example captions are presented on screen plane presents) with static mode and the audience optionally controls captions.
When captions that the audience need to present in the 2D mode, display unit by the captions superposition for example, in left eye picture and right eye picture and there is fixing displacement (3D depth dimension be held in zero), make captions fixedly be presented on the screen plane 35 of 3D TV, and present in the 2D mode.That is to say, the 2D mode can be considered a kind of AD HOC of static mode.Certainly, the 3D degree of depth that display unit also can change captions is fixed on other numerical value, makes captions fixedly be presented in a specific focal position, but also on-fixed is presented on the screen plane 35 of 3D TV.The demonstration of this kind of captions is also the performance of static mode.
Otherwise, when the captions that need to present in dynamic 3D mode, display unit is captions on the diverse location superposition of left eye picture and right eye picture, the 3D degree of depth that makes captions is along with the 3D degree of depth of a particular artifact changes and changes, and namely a kind of 3D degree of depth can change and make the audience can see the captions that the 3D mode presents at any time.
Certainly, when the 3D depth dimension of judging these captions when display unit is held in definite value (captions present with static mode), now display unit also can be configured to dynamically change the 3D degree of depth of captions, and the mode that makes captions become with dynamic 3D presents.
Please refer to Fig. 5, its illustrate is applied to an embodiment of the captions control method of display unit for the present invention.At first, after display unit starts to receive the original image signal (step S510) by image source output, display unit first captures left eye picture and the interior captions (step S520) of right eye picture in original image signal.After captions are captured out, will produce the left eye picture of acquisition after captions and right eye picture (for example,, without left eye picture and the right eye picture of captions; Perhaps, can be also left eye picture and the right eye picture that captions are arranged).Then, display unit judges according to the captions that capture the mode (step S530) that captions present.
, if but the audience accepts mode set and display device that captions present for not changing the pattern (step S540) of captions presentation mode, left eye picture and right eye picture (step S580) that display unit is directly shown in original image signal are appreciated for the audience.
Otherwise, if audience's wish change captions presentation mode, display unit is set to the pattern (step S540) of change captions presentation mode, display unit need to be set a 3D degree of depth (step S550), and according to the 3D degree of depth by the captions superposition in the left eye picture after previous acquisition captions and right eye picture (step S560).Finally, left eye picture and the right eye picture (step S570) after projection superposition captions appreciated for the audience.
In another embodiment, the judgement of step S540 also can be moved between step S510 and step S520, if the audience accepts the mode that captions present and does not need to change the captions presentation mode, need not carry out step S520 and follow-up captions handling procedure, more easy.
The detailed step flow process that is illustrated as one embodiment of the invention of above-mentioned Fig. 5, it is applied to a display unit, in order to captions of dynamic adjustment one raw video.In other words, the envoy can select to adjust rear captions presentation mode; Then, the right eye caption information in judgement right eye picture and the displacement each other of the left eye caption information in the left eye picture; And, optionally according to captions presentation mode after adjusting and a three dimensional depth, adjust this difference, after the adjustment that right eye picture and left eye picture are presented, captions have the rear captions three dimensional depth of adjustment.Wherein, adjust rear captions presentation mode and comprise static presentation mode and dynamic 3D presentation mode.
As shown in the above description, when image source output original image signal, to display unit, display unit need to capture captions in left eye picture and right eye picture.
In general, in order to allow the audience easily recognize captions, captions can be fixed on the ad-hoc location in picture usually, for example picture central authorities Lower Half.Moreover the color of captions and brightness usually can be more outstanding, make the audience be easy to identification.Perhaps, font has housing, or the captions position is in the background housing.Display unit of the present invention is used for capturing the captions in picture according to above characteristic.
Please refer to Fig. 6 A, 6B, 6C, its illustrate is various captions schematic diagrames in picture.This picture can be left eye picture and right eye picture one of them.As shown in Figure 6A, the captions in picture comprise a background housing, and captions are positioned at the captions housing.Display unit can be easily captures whole background housing and captions according to the color of the background housing of high contrast.
As shown in Figure 6B, the captions in picture are solid font, and the image of the color of these captions and brightness and picture has the contrast of height.Display unit can be set a brightness threshold value, captures the captions that are positioned at picture central authorities Lower Half.
In like manner, as shown in Figure 6 C, the captions in picture are open letters, and the image of the color of these captions and brightness and picture has the contrast of height.Display unit also can profit capture the captions that are positioned at picture central authorities Lower Half in a like fashion.
After the captions of left eye picture and right eye picture are captured out, display unit can judge the displacement of subtitle position in left eye picture and right eye picture, see through the variation that displacement continuous in time changes and learn the 3D degree of depth, further to confirm the presentation mode of captions.For instance, suppose that the subtitle position displacement of left eye picture and right eye picture does not change, the 3D degree of depth that represents these captions is fixed value.Now, captions present (for example the 2D mode presents) in static mode.Perhaps, suppose the lasting variation of displacement between the subtitle position of left eye picture and right eye picture, represent that the 3D degree of depth of these captions is for dynamically changing, that is captions are that the mode with 3D presents.
From above explanation, how display unit captures the captions in picture and judges the presentation mode of captions.
When captions are now in static (or 2D) mode, display unit can confirm that the 3D depth value of captions is fixed value (for example the 3D degree of depth remain d1 make captions be presented on screen plane).If now the audience wants to change to the mode that dynamic 3D captions present, display unit need provide the 3D degree of depth of change to the captions that separate.And according to the 3D degree of depth of change, display unit again by the captions superposition after left eye picture and right eye picture, show left eye picture and the right eye picture of superposition captions.And the mode that captions now become with dynamic 3D presents.Otherwise, if the audience wants to maintain the mode presented of static (or 2D) captions, left eye picture and the right eye picture directly shown in primary signal get final product.
When captions are now in dynamic 3D mode, display unit can be confirmed the 3D degree of depth that the 3D depth value of captions is change.If now the audience wants to change to the mode (the 2D mode presents) that static captions present, display unit provides the fixing 3D degree of depth (for example the 3D degree of depth equals d1) to the captions that separate.And according to the fixing 3D degree of depth, display unit again by the captions superposition after left eye picture and right eye picture, left eye picture and the right eye picture of projection superposition captions.And captions now become in static mode and present.In like manner, want to maintain the mode presented of 3D captions if view and admire, left eye picture and the right eye picture directly shown in primary signal get final product.
Certainly, excessively tired in order to allow user's eyes continue change the focal length of eyes.Judge captions when display unit and be now in static mode, the mode that can automatically captions be changed into dynamic 3D presents.
Please refer to Fig. 7, its illustrate is applied to another embodiment of the captions control method of display unit for the present invention.At first, after display unit starts to receive the original image signal (step S582) by image source output, display unit first captures left eye picture and the interior captions (step S584) of right eye picture in original image signal.After captions are captured out, will produce left eye picture and right eye picture without captions.Then, display unit judges according to the captions that capture the mode (step S586) that captions present.
Suppose that captions are not while in the 2D mode, being now (step S588), left eye picture and right eye picture (step S590) that display unit is directly shown in original image signal are appreciated for the audience.
Otherwise, suppose that captions are while in the 2D mode, being now (step S588), display unit need to provide the 3D degree of depth (step S592) of dynamic change, and according to the 3D degree of depth by the captions superposition in the left eye picture after previous acquisition captions and right eye picture (step S594).Finally, left eye picture and the right eye picture (step S596) after projection superposition captions appreciated for the audience.
In brief, in this embodiment, display unit automatically detects captions and converts it to the 3D captions.Basically, in the second embodiment, the mode of the acquisition of captions and superposition is introduced in the first embodiment, repeats no more.
The detailed step flow process that is illustrated as one embodiment of the invention of above-mentioned Fig. 7, it is applied to a display unit, in order to captions of dynamic adjustment one raw video.In other words, can be directly according to the displacement of right eye caption information and left eye caption information, to judge original captions presentation mode; Then, select whether to change original captions presentation mode; And, optionally produce three dimensional depth and adjust according to this this difference, after the adjustment that right eye picture and left eye picture are presented, captions have the rear captions three dimensional depth of adjustment; Wherein, original captions presentation mode comprises that a static presentation mode and a dynamic 3D present.
Please refer to Fig. 8, its illustrate is applied to an embodiment of the captions control element of display unit for the present invention.This captions control element just can move when change captions presentation mode.Below will illustrate respectively and how to change captions into the 2D presentation mode by the 3D presentation mode, and change captions into the 3D presentation mode by the 2D presentation mode.Wherein, the captions control element comprises captions acquisition unit 710, screen processing 720, captions superposition unit 730.
When display unit, via the user, change or change automatically, when the mode that captions are presented changes dynamic 3D into by 2D, captions acquisition unit 710 receives the original image signal Sin of outside input and captures left eye picture and the interior captions Sub of right eye picture in original image signal.Therefore, the captions Sub of captions acquisition unit 710 output acquisition is to the picture signal Fa after captions superposition unit 730 and output acquisition captions to screen processing 720.Wherein, the picture signal Fa of acquisition after captions comprises left eye picture and the right eye picture after the acquisition captions.Wherein, left eye picture and the right eye picture after the acquisition captions can be left eye picture and the right eye picture without captions.
Moreover, after screen processing 720 receives the picture signal Fa after the acquisition captions, utilize 3D advanced treatment unit 724 to analyze the main object in the picture of acquisition after captions and obtain the 3D degree of depth of this main object, and exporting this 3D degree of depth 3Dth to captions superposition unit 730.Clearly, when the 3D of main object change in depth, the 3D degree of depth that exports captions superposition unit 730 to also can change.Screen processing 720 is also optionally carried out image processing to the picture signal Fa after the acquisition captions, with the face signal Fb after generation acquisition captions.In detail, the picture signal Fb after the picture signal Fa after the acquisition captions that screen processing 720 receives and the acquisition captions of exporting can be identical picture; Perhaps, be the picture of processing through further.For instance, suppose the required frame rate of display unit (frame rate, frame per second) frame rate provided higher than original image signal Sin, screen processing need to utilize the calculating of mobile picture frame penalty method (Motion frame compensation) and the poor reinforcing method of picture frame (Frame Interpolation) to increase picture and improve frame rate, the picture signal Fb after the captions of output acquisition afterwards.
Then, after captions superposition unit 730 receives the 3D degree of depth 3Dth and the picture signal Fb after the acquisition captions of screen processing output, can be in acquisition the picture signal Fb after captions (for example, left eye picture and right eye picture without captions) go up captions on superposition, and the displacement between subtitle position is 3D degree of depth 3Dth.Afterwards, left eye picture Lo and the right eye picture Ro after the superposition captions exported in captions superposition unit 730, and when the left eye picture Lo after display unit projection superposition captions and right eye picture Ro, the audience can appreciate the captions that dynamic 3D presents.And captions have the identical 3D degree of depth with main object.
When the audience changes voluntarily, the mode that wish presents captions is presented and is changed into static state and be now by 3D, and the original image signal Sin that captions acquisition unit 710 receives outside input also captures the captions Sub in left eye picture in original image signal and right eye picture.Therefore, the captions Sub of captions acquisition unit 710 output acquisition to after captions superposition unit 730 and acquisition captions picture signal Fa to screen processing 720.
Moreover screen processing 720 is utilized 3D advanced treatment unit 724 directly to produce the 3D degree of depth of fixed value, and is exported this 3D degree of depth to captions superposition unit 730 after receiving the picture signal Fa after the acquisition captions.
Then, after captions superposition unit 730 receives the 3D degree of depth (3Dth) and the picture signal Fb after the acquisition captions of screen processing output, can be in acquisition captions on superposition on the picture signal Fb after captions, and the displacement between subtitle position is constant, also being the 3D degree of depth (3Dth) is fixed value.Afterwards, left eye picture Lo and the right eye picture Ro after the superposition captions exported in captions superposition unit 730, and when the left eye picture Lo after display unit projection superposition captions and right eye picture Ro, the audience can appreciate the captions that 2D presents.
In brief, in the captions control element of Fig. 8, the captions acquisition unit is from left eye picture acquisition left eye caption information and from right eye picture acquisition right eye caption information, and according to the displacement of right eye caption information and left eye caption information, to judge original captions presentation mode; One screen processing is in order to produce three dimensional depth; And, captions superposition unit, in order to selectivity, according to right eye picture after the rear left eye picture of three dimensional depth generation adjustment and adjustment, wherein, after the adjustment that after the rear right eye picture of adjustment and adjustment, the left eye picture presents, captions have the rear captions three dimensional depth of adjustment.
Please refer to Fig. 9 A, its illustrate changes for the captions that 2D is presented the captions schematic diagram that dynamic 3D presents into.Suppose that left eye picture Li and right eye picture Ri in original image signal present in the 2D mode, be that its 3D degree of depth is definite value (equaling d1 or 0), in left eye picture Li and right eye picture Ri, the position of captions (subtitle) is identical can not change.After being converted to the 3D mode and presenting, in left eye picture Lo and right eye picture Ro, displacement has appearred in the position of captions.And, along with the change of the 3D degree of depth, the displacement in left eye picture Lo and right eye picture Ro between captions also can change, and then presents the captions of dynamic 3D.
Please refer to Fig. 9 B, its illustrate changes for the captions that dynamic 3D is presented the captions schematic diagram that static state presents into.Suppose that left eye picture Li and right eye picture Ri in original image signal present in dynamic 3D mode, so its 3D degree of depth can constantly change, that is in left eye picture Li and right eye picture Ri, the displacement between captions can change.After being converted to static mode and presenting, the displacement in left eye picture Lo and right eye picture Ro between captions can become definite value.Therefore, the displacement in left eye picture Lo and right eye picture Ro between captions can not change, and its 3D degree of depth is definite value, and then presents static captions.
Certainly, utilize above-mentioned captions control method also can change the 3D degree of depth of the original dynamically captions that 3D presents, make the third dimension of captions stronger.Please refer to Fig. 9 C, its illustrate changes for the captions that dynamic 3D is presented the captions schematic diagram that dynamic 3D presents into.If the left eye picture Li in original image signal and right eye picture Ri present in dynamic 3D mode, therefore and its 3D degree of depth can constantly change, that is in left eye picture Li and right eye picture Ri, the displacement between captions can change.Suppose the mode that the dissatisfied 3D captions of audience present, while wishing that the third dimension of captions is more strong, the 3D degree of depth of original captions can be added to an inclined to one side benefit value (offset) or be multiplied by a yield value (Gain) to increase the 3D degree of depth of captions.Therefore, after the 3D depth value increases, in left eye picture Lo and right eye picture Ro, larger displacement appears in the position of captions.And, along with the change of the 3D degree of depth, the displacement in left eye picture Lo and right eye picture Ro between captions also can change, and then presents the captions that have more relief dynamic 3D.
Certainly, the audience also can utilize above-mentioned mode that the 3D degree of depth is deducted to an inclined to one side benefit value (or be multiplied by be less than one yield value), with the 3D degree of depth that reduces captions and reduce the third dimension that dynamic 3D presents captions, repeats no more herein.
Therefore, advantage of the present invention is to propose a kind of captions control method and element that is applied to display unit.After display unit receives the original image signal of image source, fechtable goes out the captions in left eye picture and right eye picture, and changes the 3D degree of depth of captions, makes captions can allow the audience select to present or present with static mode in dynamic 3D mode.
Moreover, for more 3D film is provided, existing display unit can be the 3D film by the 2D film conversion now.That is, picture single in the 2D film, via specific algorithm, and then is obtained to the 3D film possess left eye picture and right eye picture.And caption presentation method of the present invention also can apply to this.
For instance, in the process that is the 3D film by the 2D film conversion, can first the captions in the 2D film be captured out.And after changing out left eye picture and right eye picture, more optionally carry out the mode that captions present.For instance, fixedly the 3D degree of depth of captions makes captions present with static mode, or the 3D degree of depth that changes dynamically captions makes captions present in dynamic 3D mode.
That is to say, a 2D video conversion that will possess a single picture is the process that possesses a 3D image of right eye picture and left eye picture, first captures the captions in single picture; Afterwards, optionally by this captions superposition in right eye picture and left eye picture, right eye picture and left eye picture are presented one adjust after captions there is captions three dimensional depth after an adjustment; Wherein, after this adjustment, the captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
In sum, although the present invention discloses as above with preferred embodiment, so it is not in order to limit the present invention.The persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when being used for a variety of modifications and variations.Therefore, protection scope of the present invention is when by claims, being defined and be as the criterion.

Claims (18)

1. a captions control method, be applied to a display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, and this captions control method comprises the following steps:
Captions presentation mode after selecting one to adjust;
Judge a displacement of this right eye caption information and this left eye caption information; And
Optionally according to captions presentation mode after this adjustment and a three dimensional depth, adjust this displacement, what this right eye picture and this left eye picture were presented one adjusts afterwards captions and has captions three dimensional depth after an adjustment;
Wherein, after this adjustment, the captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
2. captions control method as claimed in claim 1, it is characterized in that, also comprise judgement one original captions presentation mode, comprise relatively this displacement of this right eye caption information and this left eye caption information, when this displacement roughly remains unchanged, judge that this original captions presentation mode is a static presentation mode, when the dynamic change in time of this displacement, the presentation mode that judges these captions is a dynamic 3D presentation mode.
3. captions control method as claimed in claim 2, is characterized in that, after this adjustment, the captions presentation mode is different from this original captions presentation mode, produces this three dimensional depth according to captions presentation mode after this adjustment, and adjust according to this this displacement.
4. captions control method as claimed in claim 3, is characterized in that, after this is adjusted, the captions presentation mode is this dynamic 3D presentation mode, and this three dimensional depth is relevant to the 3D degree of depth of an object in this raw video.
5. captions control method as claimed in claim 2, is characterized in that, after this adjustment, the captions presentation mode is different from this original captions presentation mode, makes the user that this three dimensional depth is provided, and adjusts according to this this displacement.
6. a captions control method, be applied to a display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, and this captions control method comprises the following steps:
According to a displacement of this right eye caption information and this left eye caption information, to judge an original captions presentation mode;
Select whether to change this original captions presentation mode; And
Optionally produce a three dimensional depth adjust according to this this displacement, what this right eye picture and this left eye picture were presented one adjusts afterwards captions and has captions three dimensional depth after an adjustment;
Wherein, this original captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
7. captions control method as claimed in claim 6, it is characterized in that, when this displacement of this right eye caption information and this left eye caption information roughly remains unchanged, judge that this original captions presentation mode is a static presentation mode, when the dynamic change in time of this displacement, judge that this original captions presentation mode is a dynamic 3D presentation mode.
8. captions control method as claimed in claim 6, is characterized in that, when selecting this original captions presentation mode of change, produces this three dimensional depth, and adjust according to this this displacement.
9. captions control method as claimed in claim 8, is characterized in that, when captions presentation mode after changing is this dynamic 3D presentation mode, this three dimensional depth is relevant to the three dimensional depth of an object in this raw video.
10. captions control method as claimed in claim 6, is characterized in that, when selecting this original captions presentation mode of change, makes the user that this three dimensional depth is provided, and adjust according to this this displacement.
A 11. captions control element that is applied to display unit, captions in order to dynamic adjustment one raw video, this raw video comprises a right eye picture and a left eye picture, this right eye picture comprises the right eye caption information, this left eye picture comprises the left eye caption information, and this captions control element comprises:
One captions acquisition unit, certainly this left eye picture capture this left eye caption information and certainly this right eye picture capture this right eye caption information, and according to a displacement of this right eye caption information and this left eye caption information, to judge an original captions presentation mode;
One screen processing, in order to produce a three dimensional depth; And
One captions superposition unit, produce one in order to selectivity according to this three dimensional depth and adjust rear left eye picture and the rear right eye picture of an adjustment, wherein, after the adjustment that after right eye picture and this adjustments, the left eye picture presents after this adjustment, captions have captions three dimensional depth after an adjustment.
12. captions control element as claimed in claim 11, it is characterized in that, when this displacement of this right eye caption information and this left eye caption information roughly remains unchanged, this captions acquisition unit judges that this original captions presentation mode is a static presentation mode, when the dynamic change in time of this displacement, judge that this original captions presentation mode is a dynamic 3D presentation mode.
13. captions control element as claimed in claim 11, is characterized in that, when selecting this original captions presentation mode of change, this displacement is adjusted according to this three dimensional depth in this captions superposition unit.
14. captions control element as claimed in claim 13, is characterized in that, when captions presentation mode after changing is this dynamic 3D presentation mode, screen processing produces this three dimensional depth according to the three dimensional depth of an object in this raw video.
15. captions control element as claimed in claim 9, is characterized in that, when selecting this original captions presentation mode of change, makes the user that this three dimensional depth is provided, for adjusting according to this this displacement in this captions superposition unit.
16. a captions control method, be applied to a display unit, is a 3D image that possesses a right eye picture and a left eye picture in order to a 2D video conversion that will possess a single picture, this captions control method comprises the following steps:
Capture the captions in this single picture; And
Optionally by this captions superposition in this right eye picture and this left eye picture, this right eye picture and this left eye picture are presented one adjust after captions there is captions three dimensional depth after an adjustment;
Wherein, after this adjustment, the captions presentation mode comprises a static presentation mode and a dynamic 3D presentation mode.
17. captions control method as claimed in claim 16, is characterized in that, when after this adjustment, the captions three dimensional depth roughly remains unchanged, this adjusts rear captions presentation mode is this static state presentation mode; And, when this adjusts the lasting variation of rear captions three dimensional depth, after this adjustment, the captions presentation mode is this dynamic 3D presentation mode.
18. captions control method as claimed in claim 16, is characterized in that, after this is adjusted, the captions presentation mode is this dynamic 3D presentation mode, and after this adjustment, the captions three dimensional depth is relevant to the three dimensional depth of an object in this right eye picture and this left eye picture.
CN2012101842099A 2012-06-06 2012-06-06 Caption control method applied to display device and component Pending CN103475831A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012101842099A CN103475831A (en) 2012-06-06 2012-06-06 Caption control method applied to display device and component

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012101842099A CN103475831A (en) 2012-06-06 2012-06-06 Caption control method applied to display device and component

Publications (1)

Publication Number Publication Date
CN103475831A true CN103475831A (en) 2013-12-25

Family

ID=49800512

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012101842099A Pending CN103475831A (en) 2012-06-06 2012-06-06 Caption control method applied to display device and component

Country Status (1)

Country Link
CN (1) CN103475831A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106164819A (en) * 2014-03-25 2016-11-23 微软技术许可有限责任公司 Eye tracking enables intelligence closed caption
CN106331690A (en) * 2016-10-17 2017-01-11 南京通孚轻纺有限公司 3D bullet screen realization method and device

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1461146A (en) * 2002-05-16 2003-12-10 精工爱普生株式会社 Caption pickup device
CN101365072A (en) * 2007-08-09 2009-02-11 富士通株式会社 Subtitle region extracting device and method
CN101448100A (en) * 2008-12-26 2009-06-03 西安交通大学 Method for extracting video captions quickly and accurately
CN101453575A (en) * 2007-12-05 2009-06-10 中国科学院计算技术研究所 Video subtitle information extracting method
CN101653011A (en) * 2007-03-16 2010-02-17 汤姆森许可贸易公司 System and method for combining text with three-dimensional content
CN101853381A (en) * 2009-03-31 2010-10-06 华为技术有限公司 Method and device for acquiring video subtitle information
CN102196288A (en) * 2010-03-17 2011-09-21 索尼公司 Image processing apparatus, image conversion method, and program
WO2011123178A1 (en) * 2010-04-01 2011-10-06 Thomson Licensing Subtitles in three-dimensional (3d) presentation
CN102232294A (en) * 2008-12-01 2011-11-02 图象公司 Methods and systems for presenting three-dimensional motion pictures with content adaptive information
CN102332096A (en) * 2011-10-17 2012-01-25 中国科学院自动化研究所 Video caption text extraction and identification method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1461146A (en) * 2002-05-16 2003-12-10 精工爱普生株式会社 Caption pickup device
CN101653011A (en) * 2007-03-16 2010-02-17 汤姆森许可贸易公司 System and method for combining text with three-dimensional content
CN101365072A (en) * 2007-08-09 2009-02-11 富士通株式会社 Subtitle region extracting device and method
CN101453575A (en) * 2007-12-05 2009-06-10 中国科学院计算技术研究所 Video subtitle information extracting method
CN102232294A (en) * 2008-12-01 2011-11-02 图象公司 Methods and systems for presenting three-dimensional motion pictures with content adaptive information
CN101448100A (en) * 2008-12-26 2009-06-03 西安交通大学 Method for extracting video captions quickly and accurately
CN101853381A (en) * 2009-03-31 2010-10-06 华为技术有限公司 Method and device for acquiring video subtitle information
CN102196288A (en) * 2010-03-17 2011-09-21 索尼公司 Image processing apparatus, image conversion method, and program
WO2011123178A1 (en) * 2010-04-01 2011-10-06 Thomson Licensing Subtitles in three-dimensional (3d) presentation
CN102332096A (en) * 2011-10-17 2012-01-25 中国科学院自动化研究所 Video caption text extraction and identification method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106164819A (en) * 2014-03-25 2016-11-23 微软技术许可有限责任公司 Eye tracking enables intelligence closed caption
CN106164819B (en) * 2014-03-25 2019-03-26 微软技术许可有限责任公司 The enabled intelligent closed caption of eyes tracking
US10447960B2 (en) 2014-03-25 2019-10-15 Microsoft Technology Licensing, Llc Eye tracking enabled smart closed captioning
CN106331690A (en) * 2016-10-17 2017-01-11 南京通孚轻纺有限公司 3D bullet screen realization method and device

Similar Documents

Publication Publication Date Title
EP2346263B1 (en) GUI providing method, and display apparatus and 3D image providing system using the same
US9007442B2 (en) Stereo image display system, stereo imaging apparatus and stereo display apparatus
US8930838B2 (en) Display apparatus and display method thereof
CN102450022B (en) Image-processing method for a display device which outputs three-dimensional content, and display device adopting the method
US9414041B2 (en) Method for changing play mode, method for changing display mode, and display apparatus and 3D image providing system using the same
EP3097689B1 (en) Multi-view display control for channel selection
US20100134603A1 (en) Three-dimensional information output apparatus and three-dimensional information output method
KR101911250B1 (en) Apparatus for processing a three-dimensional image and method for adjusting location of sweet spot for viewing multi-view image
US20130050416A1 (en) Video processing apparatus and video processing method
US20120050471A1 (en) Display apparatus and image generating method thereof
JP5132804B1 (en) Video processing apparatus and video processing method
JP5156116B1 (en) Video processing apparatus and video processing method
CN103475831A (en) Caption control method applied to display device and component
JP5095851B1 (en) Video processing apparatus and video processing method
JP5156117B1 (en) Video processing apparatus and video processing method
JP2011193057A (en) Three-dimensional image display apparatus, and image processing apparatus
JP5050094B2 (en) Video processing apparatus and video processing method
WO2014199127A1 (en) Stereoscopic image generation with asymmetric level of sharpness
TWI555400B (en) Method and device of controlling subtitle in received video content applied to displaying apparatus
JP5603911B2 (en) VIDEO PROCESSING DEVICE, VIDEO PROCESSING METHOD, AND REMOTE CONTROL DEVICE
JP5355758B2 (en) Video processing apparatus and video processing method
US8503874B2 (en) Apparatus for imaging three-dimensional image
JP2014225736A (en) Image processor
KR20140124263A (en) Display apparatus and 3d effect setting method thereof
JP5417356B2 (en) Video processing device, video processing method, and stereoscopic video display device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20131225

RJ01 Rejection of invention patent application after publication