WO2010140430A1 - Video image processing apparatus and method for controlling video image processing apparatus - Google Patents

Video image processing apparatus and method for controlling video image processing apparatus Download PDF

Info

Publication number
WO2010140430A1
WO2010140430A1 PCT/JP2010/056894 JP2010056894W WO2010140430A1 WO 2010140430 A1 WO2010140430 A1 WO 2010140430A1 JP 2010056894 W JP2010056894 W JP 2010056894W WO 2010140430 A1 WO2010140430 A1 WO 2010140430A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
video image
image processing
cutout position
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2010/056894
Other languages
French (fr)
Inventor
Teruki Kikkawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to KR1020117031254A priority Critical patent/KR101318711B1/en
Priority to US13/322,893 priority patent/US9253429B2/en
Priority to CN201080024839.9A priority patent/CN102804756B/en
Publication of WO2010140430A1 publication Critical patent/WO2010140430A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/007—Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/04—Maintaining the quality of display appearance
    • G09G2320/043—Preventing or counteracting the effects of ageing
    • G09G2320/046—Dealing with screen burn-in prevention or compensation of the effects thereof
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/10—Special adaptations of display systems for operation with variable images
    • G09G2320/106—Determination of movement vectors or equivalent parameters within the image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0464—Positioning

Definitions

  • the present invention relates to a video image processing apparatus and a method for controlling a video image processing apparatus.
  • the channel BS 11 which is a Japanese digital satellite broadcasting channel, performs 3D broadcasting by the "side-by-side method” in which a video image for a single screen is transmitted by dividing the image into a left eye video image and a right eye video image.
  • the "polarization method” and the “active shutter method” are known as typical display methods for 3D video images.
  • the active shutter method is also referred to as the time- division display method, the frame sequential method or the like.
  • a receiver for 3D broadcasts includes a film having polarization properties on a display panel, and carries out an interlaced display of left eye video images and right eye video images.
  • a viewer wears polarization glasses and views the display lines for the left eye video images with his/her left eye, and views the display lines for the right eye video images with his/her right eye, thereby enabling stereoscopic perception of video images.
  • the 3D broadcasting receiver alternately displays left eye video images and right eye video images.
  • a viewer wears glasses including a liquid-crystal shutter.
  • the glasses control the liquid-crystal shutter such that the left eye video image enters his/her left eye only and the right eye video image enters his/her right eye only. In this manner, a viewer can perceive video images stereoscopically.
  • Burn-in is a phenomenon in which degradation of light-emitting devices advances due to lighting the light-emitting devices for a long time, leading to a condition in which its light- emitting function is not performed properly. Especially, in the case where a still image or a moving image including a still region is displayed for a long time, such an image may sometimes remain on the display panel like an afterimage due to burn-in. [0006] In this manner, burn-in is caused by degradation of the light-emitting devices, and may occur both with two-dimensional (2D) video images and 3D video images. Some techniques for suppressing burn- in from occurring are currently known.
  • Japanese Patent Laid-Open No. 2000-338947 discloses a technique for mitigating burn-in by the method so-called "pixel shifting", which, when an input image does not change for a certain amount of time, changes the display size of the image to shift the display position thereof.
  • Japanese Patent Laid-Open No. 2004-264366 discloses a technique in which the input format of an image is detected and interpolation is carried out in accordance with the display size. Then, burn-in is mitigated by shifting, by one pixel per prescribed amount of time, the display position of the image in horizontal and vertical directions within a prescribed pixel range, while suppressing visual distractions caused by the shifting of the image.
  • Japanese Patent Laid-Open Nos. 2000-338947 and 2004-264366 aim at applying a pixel shifting to 2D video images, but do not give consideration to the case that video images include left eye video images and right eye video images. Nevertheless, when processing such as conventional pixel shifting is applied to 3D video images, there is a possibility that the 3D video image is perceived with a different stereoscopic effect from that originally intended by the creator thereof, due to the following reasons.
  • the parallax between the right and left eyes is inverted.
  • the parallax between both video images fluctuates when the shift amount of the pixels for the left eye video image and that for the right eye video image are different from each other, or when the shift timings for the pixels for these video images are different from each other.
  • the present invention has been achieved in consideration of these circumstances, and provides a technique for mitigating burn-in for 3D video images.
  • a video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: video image processing means for cutting out a part of frame images from a three- dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means, when changing the cutout position of the partial image, cuts out the partial image from the frame images such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region.
  • a video image processing apparatus that outputs a video image to a display device, comprising: video image processing means for cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of left and right frame image sets for each scene, a single left and right frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means executes processing for changing a cutout position of the partial image, and the video image processing means executes the processing for changing the cutout position at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set.
  • a method for controlling a video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: a video image processing step of cutting out a part of frame images from a three-dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, when changing the cutout position of the partial image, the partial image is cut out from the frame image such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region.
  • a method for controlling a video image processing apparatus that outputs a video image to a display device, comprising: a video image processing step of cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of right and left frame image sets for each scene, a single right and left frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, processing for changing a cutout position of the partial image is executed, and in the video image processing step, the processing for changing the cutout position is executed at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set.
  • FIG. 1 is a conceptual diagram showing a display panel 101 as viewed from the side that displays a 3D video image by a polarization method.
  • FIG. 2 is a conceptual diagram showing the display panel 101 as viewed from the front.
  • FIG. 3 is a block diagram showing the schematic configuration of a broadcast receiver 300 according to a first embodiment.
  • FIG. 4 is a conceptual diagram of a 2D pixel shifting table and a 3D pixel shifting table.
  • FIG. 5 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 300.
  • FIG. 6 is a conceptual diagram of 3D video image display by an active shutter method.
  • FIG. 7 is a block diagram showing a schematic configuration of a broadcast receiver 700 according to a second embodiment.
  • FIG. 8 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 700.
  • FIG. 9 is a conceptual diagram showing how a display start position is shifted according to the flowchart in FIG. 8.
  • FIG. 1 is a conceptual diagram showing a display panel 101 as viewed from the side that displays the 3D video image by the polarization method.
  • FIG. 2 is a conceptual diagram showing the display panel 101 as viewed from the front .
  • the display panel 101 receives and displays video images output by a broadcast receiver.
  • the display panel 101 may be of any type, such as a liquid crystal display, a plasma display, or an SED (Surface- conduction Electron-emitter Display) .
  • a polarization filter 102 is attached on the display panel 101 (display device) . As shown in FIG. 2, the polarization filter 102 is configured such that odd numbered lines (Ll, L2, ...) serve as left eye display lines (first display portion) , and even numbered lines (Rl, R2, ...) serve as right eye display lines (second display portion) . Therefore, left eye images and right eye images are respectively displayed with light having different oscillation directions.
  • the viewer perceives a video image as a 3D video image by viewing the video image while wearing special polarization glasses 104 in which polarization filters with different orientations are used respectively for the left eye and the right eye (FIG. 1 shows only one of the eyes, 103) .
  • FIG. 3 is a block diagram showing a schematic configuration of a broadcast receiver 300 according to a first embodiment.
  • a CPU 301 performs overall control of the broadcast receiver 300 in accordance with programs stored in a ROM 302.
  • a RAM 303 is a volatile memory, and is used as a work memory of the CPU 301.
  • the RAM 303 is used also as a temporary storage area for various data.
  • a 2D pixel shifting table is stored in a first memory area 304 and a 3D pixel shifting table is stored in a second memory, area 305.
  • FIG. 4 is a conceptual diagram of the 2D pixel shifting table and the 3D pixel shifting table.
  • the 2D pixel shifting table is configured such that each time the trigger signal is generated, the display start position is shifted by one pixel in the x direction or the y direction (shift processing) .
  • the 3D pixel shifting table is configured such that each time the trigger signal is generated, the display start position is shifted by one pixel in the x direction (horizontal direction) and by 2n pixels (where n is a natural number) in the y direction (vertical direction) . That is, in order to perform pixel shifting on a 3D video image each frame of which contains a pair of the left eye image and the right eye image that alternate horizontal line by horizontal line, the images corresponding to the same scene, the display start position is shifted by 2n lines (where n is a natural number) in the vertical direction.
  • the pixel shifting table can also hold display start positions corresponding to the fifth trigger signal and subsequent trigger signals. However, when four trigger signals are treated as forming one cycle, it is sufficient if the pixel shifting table holds the display start positions corresponding to the four trigger signals.
  • a tuner unit 306 demodulates broadcast waves received via an antenna (not shown) and outputs video and audio baseband data.
  • a demultiplexer unit 307 performs frame disassembly on the data received from the tuner unit 306 so as to separate video data, audio data and program information data.
  • the video data and the audio data separated by the demultiplexer unit 307 is input to a decoder unit 308.
  • the decoder unit 308 decodes MPEG-2 coded video data and inputs the decoded data to a 3D video image generation unit 310.
  • the decoder unit 308 also decodes MPEG-2 AAC-coded audio data to convert the audio data into a linear PCM format, and inputs the converted data to an audio processing unit 315.
  • the program information data separated by demultiplexer unit 307 is input to a video image determination unit 309.
  • the program information data is transmitted in a data structure defined by the standard, "Service Information for Digital Broadcasting System", by the Association of Radio Industries and Businesses (ARIB), for example.
  • Main constituent data of such a structure includes an SDT, which carries information regarding program channels, and an EIT, which carries information regarding a program such as the name or broadcast time of the program, the type of components to be transmitted, or the like.
  • SDT Service Description Table
  • EIT is an abbreviation of Event Information Table.
  • the 3D video image format is additionally defined in the video image component type, which is currently standardized (component_type) .
  • the video image determination unit 309 determines whether the format of the video data being decoded by the decoder unit 308 corresponds to two-dimensional video image (2D video image) or 3D video image, based on the component type included in the EIT, and notifies the 3D video image generation unit 310 of the determination result.
  • the 3D video image generation unit 310 performs processing to convert the video image input by the decoder unit 308 into a 3D video image if the video image format notified by the video image determination unit 309 indicates a 3D video image.
  • the 3D video image generation unit 310 processes a frame image constituting the video image input from the decoder unit 308, such that the left eye image is displayed in the odd numbered lines and the right eye image is displayed in the even numbered lines, as shown in FIG. 2, and inputs the frame image into a resolution conversion unit 313.
  • the 3D video image generation unit 310 inputs the video image input from the decoder unit 308 to the resolution conversion unit 313 without processing.
  • a video image is defined as sequential display of a plurality of images in time series. Accordingly, resolution conversion and cutout processing based on the display position are not performed on the video image, but on the images forming the video image.
  • the display position control unit 311 determines, based on the determination result by the video image determination unit 309, a display region (prescribed region) in the image whose resolution has been converted by the resolution conversion unit 313 (described later) . Then, the display position control unit 311 inputs to a video image processing unit 314 an image (partial image) cut out from the determined display region. Specifically, the display start position of the video image is determined by using the 2D pixel shifting table stored in the first memory area 304 in the case of the 2D video image, while using the 3D pixel shifting table stored in the second memory area 305 in the case of the 3D video image.
  • pixel shifting can be understood as processing for shifting the region of the image cut out and output to the display panel 101 in accordance with the display start position.
  • processing of merely shifting the display position without cutting out the image also corresponds to pixel shifting processing.
  • a frame number measurement unit 312 counts the number of frames output to the display panel, and sends the burn-in mitigation trigger signal to the display position control unit 311 when the count number has reached a prescribed number.
  • condition for generating the burn-in mitigation trigger signal is not limited to the number of frames.
  • a trigger signal may be generated in the case where a change of channel is detected based on the above-described program information data, or in the case where the channel is changed in response to a user operation via a remote controller 317 or the like.
  • the resolution conversion unit 313 performs resolution conversion on the video image input from the 3D video image generation unit 310 so as to comply with the display panel 101. In this manner, a 2D video image or a 3D video image as a target for the pixel shifting processing is obtained. Therefore, the resolution conversion unit 313 can obtain a 2D video image or a 3D video image.
  • the resolution conversion unit 313 sends a video image that has undergone resolution conversion to the display position control unit 311.
  • the video image processing unit 314 performs Y processing or the like on the image (partial image) input from the display position control unit 311, thereafter performs conversion into video image data complying with the display panel 101, such as an LVDS signal for example, and outputs the video image data.
  • the audio processing unit 315 performs digital-to-analog (D/A) conversion processing or the like on audio data, and outputs the converted audio data to a speaker 316.
  • the remote controller 317 sends a control signal as an infrared signal in response to a user operation.
  • the CPU 301 generates various commands, control signals or the like for controlling the broadcast receiver 300 from the infrared signal received by an infrared light receiving unit 318, and outputs the commands, control signals or the like.
  • the left eye image is displayed in odd numbered lines of the display panel 101
  • right eye image is displayed in the even numbered lines of the display panel 101 (see FIG. 2).
  • the arrangement of the left eye image and the right eye image is not limited thereto, and for example, pixels for the left eye image and pixels for the right eye image may be arranged in a checkered pattern.
  • the display position control unit 311 selects the portion to be displayed in the three-dimensional image for display that constitutes a 3D video image, namely, the region cut out as a partial image, such that the arrangement pattern of the left eye image and the right eye image of the 3D video image matches the arrangement pattern of the polarization filter 102. As a result, the image can be displayed as a 3D video image.
  • the cutout position of the partial image is shifted such that the arrangement pattern of the left eye image and the right eye image does not change.
  • the cutout position is shifted such that the arrangement pattern of the left eye image and the right eye image matches the arrangement pattern of the polarization filter 102 even after shifting (changing) the cutout position.
  • shifting the cutout position is not essential to the present invention. In other words, processing of changing the display position of the display image itself is possible. Although a region where no image is displayed, namely, a blank region, appears in the display screen with such processing, displaying the display image constantly in the same position can be avoided, thereby mitigating burn-in.
  • FIG. 5 is a flowchart illustrating a burn- in mitigation processing performed by the broadcast receiver 300.
  • the processing of this flowchart starts.
  • the video image determination unit 309 extracts the component type from the component descriptor in the EIT.
  • the video image determination unit 309 determines whether the format of the video data being decoded by the decoder unit 308 corresponds to the 2D video image or the 3D video image. The procedure proceeds to step S503 in the case of 2D video image, and to step S505 in the case of 3D video image.
  • step S503 the display position control unit 311 reads out the 2D pixel shifting table from the RAM 303.
  • step S504 the display position control unit 311 acquires a corresponding display start position from the 2D pixel shifting table, based on the number of occurrences of the trigger signal (specifically, how many trigger signals have occurred up to the current processing of the flowchart) .
  • step S505 the display position control unit 311 reads out the 3D pixel shifting table from the RAM 303.
  • step S506 the display position control unit 311 acquires a corresponding display start position from the 3D pixel shifting table based on the number of occurrences of the trigger signal.
  • step S507 the display position control unit 311 cuts out an image based on the display start position acquired in step S504 or S506, and inputs the image cutout into the video image processing unit 314.
  • the format of the burn-in mitigation trigger signal may be defined such that the display position control unit 311 can acknowledge the cause of occurrence of the burn-in mitigation trigger signal.
  • the burn-in mitigation trigger signal is generated due to a cause that may accompany a change in the video image format (for example, a change of channel) , this process can be omitted thereafter.
  • the broadcast receiver 300 shifts the region of the video image output on the display panel 101 in order to mitigate burn-in on the display panel 101.
  • the broadcast receiver 300 shifts the region such that the pixels for the left eye image are displayed in the positions of the pixels for the left eye image on the display panel 101, and the pixels for the right eye image are displayed in the positions of the pixels for the right eye image on the display panel 101. In this manner, a technique for mitigating burn- in for the 3D video image is provided.
  • FIG. 6 is a conceptual diagram of 3D video image display by the active shutter method. As illustrated in FIG. 6, left eye images (L_tl, L_t3, ...) and right eye images (R_t2, R_t4, ...) are alternately displayed in time-series, and the parallax between both images causes a three- dimensional effect.
  • FIG. 7 is a block diagram showing a schematic configuration of a broadcast receiver 700 according to a second embodiment. In FIG. 7, constituent elements similar to those in the broadcast receiver 300 (FIG. 3) are assigned identical reference numerals, and their further description is omitted.
  • a decoder unit 701 includes a first decoder
  • the decoder unit 701 decodes MPEG-2 AAC-coded audio data to convert the audio data into a linear PCM format, and inputs the converted data to the audio processing unit 315.
  • the decoder switching unit 704 alternately inputs the left eye images and the right eye images input from the decoder unit 701 to the resolution conversion unit 313. Using two decoders in this manner enables display of video images at a higher frame rate.
  • a display position control unit 705 determines the region to be displayed of the image whose resolution has been converted by the resolution conversion unit 313, based on whether the image is the left eye image or the right eye image, and the determination result by the video image determination unit 309, and the partial image cut out from the determined display region is input into the video image processing unit 314. When determining the display region, the display position control unit 705 causes the display start positions for a pair of a left eye image and a right eye image to be matched.
  • a glasses control unit 706 controls the liquid crystal shutter of glasses 707 such that the left eye image only enters the left eye and the right eye image only- enters the right eye in synchronization with the timing in which the left eye images and the right eye images are displayed in alternation.
  • a display panel 708 differs from the display panel 101 in the first embodiment, and does not include a polarization film.
  • a first memory area 709 holds the 2D pixel shifting table and a second memory area 710 holds the 3D pixel shifting table.
  • design of the 3D pixel shifting table is not restricted by the arrangement of the polarization film.
  • FIG. 8 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 700. In FIG. 8, steps where processes similar to those in the first embodiment (FIG. 5) are performed are assigned identical reference numerals, and description thereof is omitted. Upon generation of the burn-in mitigation trigger signal, the processing of this flowchart starts.
  • the display position control unit 705 gradually shifts the display start position over several frames, from the display start position before the trigger signal is generated (e.g., [1, I]) to the display start position after the trigger signal is generated (e.g., [7, I]).
  • step S801 the display position control unit 705 obtains a display start position corresponding to the number of occurrences of the trigger signal from the 2D pixel shifting table, and sets the position as a target shift position.
  • step S802 the display position control unit 705 shifts the display start position by a prescribed unit amount (e.g., one pixel). For example, if the display start position before shifting is [1, 1] and the target shift position is [7, 1], the display start position after shifting is [2, 1] .
  • step S803 the display position control unit 705 cuts out an image based on the display start position obtained after shifting in step S802, and inputs the image cutout to the video image processing unit 314.
  • step S804 the display position control unit 705 determines whether or not the display start position has reached the target shift position. If the target shift position is not reached, the procedure returns to step S802, and if the target shift position is reached, the processing ends.
  • step S805 the display position control unit 705 obtains the display start position corresponding to the number of occurrences of the trigger signal from the 3D pixel shifting table, and sets the position as the target shift position.
  • step S806 the display position control unit 705 determines whether or not a video image as the processing target is the left eye image. If the video image is the left eye image, the procedure proceeds to step S807, and if it is not the left eye image, the procedure proceeds to step S808.
  • step S807 the display position control unit 705 shifts the display start position by a prescribed unit amount (e.g., one pixel). For example, if the display start position before shifting is [1, 1] and the target shift position is [5, 1] , the display start position after shifting is [2, 1] .
  • step S808 the display position control unit 705 cuts out an image based on the display start position obtained after shifting in step S807, and inputs the image to the video image processing unit 314
  • step S809 the display position control unit 705 determines whether or not the display start position has reached the target shift position. If the target shift position is not reached, the procedure returns to step S806, and if the target shift position is reached, processing ends.
  • steps S806 to S809 when the processing target video image is the right eye image, the display start position is not shifted, so the display start positions of a pair of the left eye image and the right eye image that correspond to the same scene match. As a result, the parallax does not change between the left eye image and right eye image that correspond to the same scene.
  • FIG. 9 is a conceptual diagram showing how the display start position is shifted according to the flowchart in FIG. 8.
  • the display start positions of a pair of the left eye image and the right eye image e.g., L_tl and R_t2
  • the display start position is not shifted at a timing other than the timing with which a pair of left and right eye images that correspond to the same scene is switched to another pair of left and right eye images.
  • setting the shift amount to 0 with respect to the coordinate values for the 3D pixel shifting table means stopping pixel shifting processing. If a motion vector between frames is determined to be large with the decoder unit 701, the motion of an object in the video image can be considered to be large. If pixel shifting is performed in this case, a significant disruption in the video image appears and the 3D effect is reduced. Accordingly, the decoder unit 701 divides a frame into a plurality of regions, references the motion vector for each region, and notifies the display position control unit 705 of the average motion amount of the object in the frame.
  • the display position control unit 705 operates with replacing the shift amount to "0" with respect to the coordinate values in the 3D pixel shifting table, even in the case where the burn-in mitigation trigger signal is generated. As a result, a reduction of the 3D effect can be avoided. Note that in this case, since the motion of the object in the movie image itself is large, burn-in that may bring about an afterimage does not readily occur. [0072] As described above, according to the present embodiment, the broadcast receiver 700 shifts the region of the video image to be output in the display panel 708 so as to mitigate burn-in on the display panel 708.
  • the broadcast receiver 700 shifts the region such that the display start positions of the left eye image and the right eye image corresponding to the same scene match. Accordingly, fluctuation in the parallax between the left eye image and the right eye image corresponding to the same scene is prevented. In this manner, a burn-in mitigation technique for 3D video images is provided.
  • aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU or MPU) that reads out and executes a program recorded on a memory device to perform the functions of the above-described embodiment (s) , and by a method, the steps of which are performed by a computer of a system or apparatus by, for example, reading out and executing a program recorded on a memory device to perform the functions of the above-described embodiment (s) .
  • the program is provided to the computer for example via a network or from a recording medium of various types serving as the memory device (e.g., computer-readable medium) .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

There is provided a video image processing apparatus. A display device includes a first display portion for a left eye image and a second display portion for a right eye image. The apparatus comprises: video image processing means for cutting out a part of frame images from a three-dimensional video image configured as an aggregate of the frame images, a single frame image being formed by arranging a pair of a left and right eye images corresponding to the same scene in a prescribed pattern; and output means for outputting the partial image to the display device. The video image processing means, when changing the cutout position, cuts out the partial image such that an arrangement pattern of the left and right eye images in the partial image after the change matches an arrangement pattern of the first and the second display portions in the display region.

Description

DESCRIPTION
TITLE OF INVENTION
VIDEO IMAGE PROCESSING APPARATUS AND METHOD FOR CONTROLLING VIDEO IMAGE PROCESSING APPARATUS
TECHNICAL FIELD
[0001] The present invention relates to a video image processing apparatus and a method for controlling a video image processing apparatus.
BACKGROUND ART
[0002] Currently, three-dimensional (3D) video images are broadcasted (3D broadcasting). For example, the channel BS 11, which is a Japanese digital satellite broadcasting channel, performs 3D broadcasting by the "side-by-side method" in which a video image for a single screen is transmitted by dividing the image into a left eye video image and a right eye video image. In addition, the "polarization method" and the "active shutter method" are known as typical display methods for 3D video images. The active shutter method is also referred to as the time- division display method, the frame sequential method or the like.
[0003] In the case of the polarization method, a receiver for 3D broadcasts includes a film having polarization properties on a display panel, and carries out an interlaced display of left eye video images and right eye video images. A viewer wears polarization glasses and views the display lines for the left eye video images with his/her left eye, and views the display lines for the right eye video images with his/her right eye, thereby enabling stereoscopic perception of video images.
[0004] In the case of the active shutter method, the 3D broadcasting receiver alternately displays left eye video images and right eye video images. A viewer wears glasses including a liquid-crystal shutter. The glasses control the liquid-crystal shutter such that the left eye video image enters his/her left eye only and the right eye video image enters his/her right eye only. In this manner, a viewer can perceive video images stereoscopically.
[0005] Incidentally, a phenomenon called burn-in may occur on a display panel. Burn-in is a phenomenon in which degradation of light-emitting devices advances due to lighting the light-emitting devices for a long time, leading to a condition in which its light- emitting function is not performed properly. Especially, in the case where a still image or a moving image including a still region is displayed for a long time, such an image may sometimes remain on the display panel like an afterimage due to burn-in. [0006] In this manner, burn-in is caused by degradation of the light-emitting devices, and may occur both with two-dimensional (2D) video images and 3D video images. Some techniques for suppressing burn- in from occurring are currently known. [0007] Japanese Patent Laid-Open No. 2000-338947 discloses a technique for mitigating burn-in by the method so-called "pixel shifting", which, when an input image does not change for a certain amount of time, changes the display size of the image to shift the display position thereof.
[0008] Japanese Patent Laid-Open No. 2004-264366 discloses a technique in which the input format of an image is detected and interpolation is carried out in accordance with the display size. Then, burn-in is mitigated by shifting, by one pixel per prescribed amount of time, the display position of the image in horizontal and vertical directions within a prescribed pixel range, while suppressing visual distractions caused by the shifting of the image.
[0009] Japanese Patent Laid-Open Nos. 2000-338947 and 2004-264366 aim at applying a pixel shifting to 2D video images, but do not give consideration to the case that video images include left eye video images and right eye video images. Nevertheless, when processing such as conventional pixel shifting is applied to 3D video images, there is a possibility that the 3D video image is perceived with a different stereoscopic effect from that originally intended by the creator thereof, due to the following reasons. [0010] For example, in the case of the polarization method, if the pixels for the left eye video image are shifted to the positions of the pixels for the right eye video image and, the pixels for the right eye video image are shifted to the positions of the pixels for the left eye video image, the parallax between the right and left eyes is inverted. Also in the case of the active shutter method, the parallax between both video images fluctuates when the shift amount of the pixels for the left eye video image and that for the right eye video image are different from each other, or when the shift timings for the pixels for these video images are different from each other. In the 3D video image, people can perceive video images stereoscopically by providing parallax (binocular parallax) between the left eye video image and the right eye video image. However, as a result of the parallax based on which a video image is designed being changed due to a burn-in control, it is anticipated that the 3D video image becomes blurred, or in a worse case, fails to be perceived as a 3D video image. That is, conventional burn-in mitigation techniques have not given consideration to the issue of burn-in in the 3D video images. SUMMARY OF INVENTION
[0011] The present invention has been achieved in consideration of these circumstances, and provides a technique for mitigating burn-in for 3D video images.
[0012] According to the first aspect of the present invention, there is provided a video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: video image processing means for cutting out a part of frame images from a three- dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means, when changing the cutout position of the partial image, cuts out the partial image from the frame images such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region.
[0013] According to the second aspect of the present invention, there is provided a video image processing apparatus that outputs a video image to a display device, comprising: video image processing means for cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of left and right frame image sets for each scene, a single left and right frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means executes processing for changing a cutout position of the partial image, and the video image processing means executes the processing for changing the cutout position at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set.
[0014] According to the third aspect of the present invention, there is provided a method for controlling a video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: a video image processing step of cutting out a part of frame images from a three-dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, when changing the cutout position of the partial image, the partial image is cut out from the frame image such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region. [0015] According to the forth aspect of the present invention, there is provided a method for controlling a video image processing apparatus that outputs a video image to a display device, comprising: a video image processing step of cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of right and left frame image sets for each scene, a single right and left frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, processing for changing a cutout position of the partial image is executed, and in the video image processing step, the processing for changing the cutout position is executed at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set. [0016] With the above configuration, the present invention can provide a technique for mitigating burn- in for 3D video images.
[0017] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings .
BRIEF DESCRIPTION OF DRAWINGS
[0018] FIG. 1 is a conceptual diagram showing a display panel 101 as viewed from the side that displays a 3D video image by a polarization method. [0019] FIG. 2 is a conceptual diagram showing the display panel 101 as viewed from the front. [0020] FIG. 3 is a block diagram showing the schematic configuration of a broadcast receiver 300 according to a first embodiment.
[0021] FIG. 4 is a conceptual diagram of a 2D pixel shifting table and a 3D pixel shifting table. [0022] FIG. 5 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 300. [0023] FIG. 6 is a conceptual diagram of 3D video image display by an active shutter method. [0024] FIG. 7 is a block diagram showing a schematic configuration of a broadcast receiver 700 according to a second embodiment.
[0025] FIG. 8 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 700. [0026] FIG. 9 is a conceptual diagram showing how a display start position is shifted according to the flowchart in FIG. 8.
DESCRIPTION OF EMBODIMENTS
[0027] Embodiments of the present invention will now be described with reference to attached drawings. It should be noted that the technical scope of the present invention is defined by claims, and is not limited by each embodiment described below. In addition, not all combinations of the features described in the embodiments are necessarily required for realizing the present invention. [0028] In the following embodiments, a case is described in which a video image processing apparatus of the present invention is applied to a broadcast receiver, however, application examples are not limited thereto. It is also possible to apply a video image processing apparatus of the present invention to a video image reproduction apparatus, such as DVD player for example. [0029] First Embodiment
In the first embodiment, a case is described in which the polarization method is used as the display method for three-dimensional video images (3D video images). Accordingly, the 3D video image is constituted as an aggregate of pairs of a left eye image and a right eye image corresponding to the same scene. FIG. 1 is a conceptual diagram showing a display panel 101 as viewed from the side that displays the 3D video image by the polarization method. FIG. 2 is a conceptual diagram showing the display panel 101 as viewed from the front .
[0030] The display panel 101 receives and displays video images output by a broadcast receiver. The display panel 101 may be of any type, such as a liquid crystal display, a plasma display, or an SED (Surface- conduction Electron-emitter Display) . [0031] A polarization filter 102 is attached on the display panel 101 (display device) . As shown in FIG. 2, the polarization filter 102 is configured such that odd numbered lines (Ll, L2, ...) serve as left eye display lines (first display portion) , and even numbered lines (Rl, R2, ...) serve as right eye display lines (second display portion) . Therefore, left eye images and right eye images are respectively displayed with light having different oscillation directions. The viewer (user) perceives a video image as a 3D video image by viewing the video image while wearing special polarization glasses 104 in which polarization filters with different orientations are used respectively for the left eye and the right eye (FIG. 1 shows only one of the eyes, 103) .
[0032] FIG. 3 is a block diagram showing a schematic configuration of a broadcast receiver 300 according to a first embodiment. In FIG. 3, a CPU 301 performs overall control of the broadcast receiver 300 in accordance with programs stored in a ROM 302. [0033] A RAM 303 is a volatile memory, and is used as a work memory of the CPU 301. The RAM 303 is used also as a temporary storage area for various data. In particular, a 2D pixel shifting table is stored in a first memory area 304 and a 3D pixel shifting table is stored in a second memory, area 305.
[0034] FIG. 4 is a conceptual diagram of the 2D pixel shifting table and the 3D pixel shifting table. Each table shows the display start position ([1,1], for example) of a video image corresponding to the number of occurrences (N = 1, 2, 3, ...) of a burn-in mitigation trigger signal (to be described later with description of a display position control unit 311). In the example of FIG. 4, the 2D pixel shifting table is configured such that each time the trigger signal is generated, the display start position is shifted by one pixel in the x direction or the y direction (shift processing) . Also, the 3D pixel shifting table is configured such that each time the trigger signal is generated, the display start position is shifted by one pixel in the x direction (horizontal direction) and by 2n pixels (where n is a natural number) in the y direction (vertical direction) . That is, in order to perform pixel shifting on a 3D video image each frame of which contains a pair of the left eye image and the right eye image that alternate horizontal line by horizontal line, the images corresponding to the same scene, the display start position is shifted by 2n lines (where n is a natural number) in the vertical direction. Also, by shifting the image in accordance with a rule suitable for the video image format (whether the image is a 2D video image or a 3D video image) , disruption in the video image can be suppressed. [0035] Note that a computation expression for determining the display start position, for example, may be used instead of the table. Although the number of occurrences of the trigger signal in FIG. 4 is shown only up to the fourth time (N = A)1 actually, the pixel shifting table can also hold display start positions corresponding to the fifth trigger signal and subsequent trigger signals. However, when four trigger signals are treated as forming one cycle, it is sufficient if the pixel shifting table holds the display start positions corresponding to the four trigger signals.
[0036] A tuner unit 306 demodulates broadcast waves received via an antenna (not shown) and outputs video and audio baseband data. A demultiplexer unit 307 performs frame disassembly on the data received from the tuner unit 306 so as to separate video data, audio data and program information data. [0037] The video data and the audio data separated by the demultiplexer unit 307 is input to a decoder unit 308. The decoder unit 308 decodes MPEG-2 coded video data and inputs the decoded data to a 3D video image generation unit 310. The decoder unit 308 also decodes MPEG-2 AAC-coded audio data to convert the audio data into a linear PCM format, and inputs the converted data to an audio processing unit 315. [0038] The program information data separated by demultiplexer unit 307 is input to a video image determination unit 309. The program information data is transmitted in a data structure defined by the standard, "Service Information for Digital Broadcasting System", by the Association of Radio Industries and Businesses (ARIB), for example. Main constituent data of such a structure includes an SDT, which carries information regarding program channels, and an EIT, which carries information regarding a program such as the name or broadcast time of the program, the type of components to be transmitted, or the like. Note that SDT is an abbreviation of Service Description Table, and EIT is an abbreviation of Event Information Table. [0039] With the present embodiment, the 3D video image format is additionally defined in the video image component type, which is currently standardized (component_type) . Then, the video image determination unit 309 determines whether the format of the video data being decoded by the decoder unit 308 corresponds to two-dimensional video image (2D video image) or 3D video image, based on the component type included in the EIT, and notifies the 3D video image generation unit 310 of the determination result. [0040] The 3D video image generation unit 310 performs processing to convert the video image input by the decoder unit 308 into a 3D video image if the video image format notified by the video image determination unit 309 indicates a 3D video image. Specifically, the 3D video image generation unit 310 processes a frame image constituting the video image input from the decoder unit 308, such that the left eye image is displayed in the odd numbered lines and the right eye image is displayed in the even numbered lines, as shown in FIG. 2, and inputs the frame image into a resolution conversion unit 313. In the case where the indicated video image format corresponds to a 2D video image, the 3D video image generation unit 310 inputs the video image input from the decoder unit 308 to the resolution conversion unit 313 without processing. In the embodiments of the present invention, a video image is defined as sequential display of a plurality of images in time series. Accordingly, resolution conversion and cutout processing based on the display position are not performed on the video image, but on the images forming the video image.
[0041] The display position control unit 311 determines, based on the determination result by the video image determination unit 309, a display region (prescribed region) in the image whose resolution has been converted by the resolution conversion unit 313 (described later) . Then, the display position control unit 311 inputs to a video image processing unit 314 an image (partial image) cut out from the determined display region. Specifically, the display start position of the video image is determined by using the 2D pixel shifting table stored in the first memory area 304 in the case of the 2D video image, while using the 3D pixel shifting table stored in the second memory area 305 in the case of the 3D video image. If the image size of the video image is 1920 x 1080 for example, an image whose size is 1900 * 1070 is cut out starting from the display start position and the cutout image is input to the video image processing unit 314. Accordingly, pixel shifting can be understood as processing for shifting the region of the image cut out and output to the display panel 101 in accordance with the display start position. Of course, processing of merely shifting the display position without cutting out the image also corresponds to pixel shifting processing.
[0042] A frame number measurement unit 312 counts the number of frames output to the display panel, and sends the burn-in mitigation trigger signal to the display position control unit 311 when the count number has reached a prescribed number. The display position control unit 311, upon receipt of the burn-in mitigation trigger signal, updates the display start position based on the pixel shifting table according to the video image format.
[0043] Note that the condition for generating the burn-in mitigation trigger signal is not limited to the number of frames. For example, a trigger signal may be generated in the case where a change of channel is detected based on the above-described program information data, or in the case where the channel is changed in response to a user operation via a remote controller 317 or the like.
[0044] The resolution conversion unit 313 performs resolution conversion on the video image input from the 3D video image generation unit 310 so as to comply with the display panel 101. In this manner, a 2D video image or a 3D video image as a target for the pixel shifting processing is obtained. Therefore, the resolution conversion unit 313 can obtain a 2D video image or a 3D video image. The resolution conversion unit 313 sends a video image that has undergone resolution conversion to the display position control unit 311.
[0045] The video image processing unit 314 performs Y processing or the like on the image (partial image) input from the display position control unit 311, thereafter performs conversion into video image data complying with the display panel 101, such as an LVDS signal for example, and outputs the video image data. [0046] The audio processing unit 315 performs digital-to-analog (D/A) conversion processing or the like on audio data, and outputs the converted audio data to a speaker 316. The remote controller 317 sends a control signal as an infrared signal in response to a user operation. The CPU 301 generates various commands, control signals or the like for controlling the broadcast receiver 300 from the infrared signal received by an infrared light receiving unit 318, and outputs the commands, control signals or the like. [0047] Note that in the present embodiment, for the purpose of description, the left eye image is displayed in odd numbered lines of the display panel 101, while right eye image is displayed in the even numbered lines of the display panel 101 (see FIG. 2). However, the arrangement of the left eye image and the right eye image is not limited thereto, and for example, pixels for the left eye image and pixels for the right eye image may be arranged in a checkered pattern. In whatever form the left eye image and the right eye image are arranged, desired effects can be achieved by creating the pixel shifting table with which the pixels for a left eye image are shifted to the positions for other pixels for the left eye image, while the pixels for a right eye image are shifted to the positions of other pixels for the right eye image. In other words, the display position control unit 311 selects the portion to be displayed in the three-dimensional image for display that constitutes a 3D video image, namely, the region cut out as a partial image, such that the arrangement pattern of the left eye image and the right eye image of the 3D video image matches the arrangement pattern of the polarization filter 102. As a result, the image can be displayed as a 3D video image. Then, in the burn-in mitigation processing, the cutout position of the partial image is shifted such that the arrangement pattern of the left eye image and the right eye image does not change. Specifically, the cutout position is shifted such that the arrangement pattern of the left eye image and the right eye image matches the arrangement pattern of the polarization filter 102 even after shifting (changing) the cutout position. Note that shifting the cutout position is not essential to the present invention. In other words, processing of changing the display position of the display image itself is possible. Although a region where no image is displayed, namely, a blank region, appears in the display screen with such processing, displaying the display image constantly in the same position can be avoided, thereby mitigating burn-in.
[0048] FIG. 5 is a flowchart illustrating a burn- in mitigation processing performed by the broadcast receiver 300. Upon generation of the above-described burn-in mitigation trigger signal, the processing of this flowchart starts. In step S501, the video image determination unit 309 extracts the component type from the component descriptor in the EIT. In step S502, the video image determination unit 309 determines whether the format of the video data being decoded by the decoder unit 308 corresponds to the 2D video image or the 3D video image. The procedure proceeds to step S503 in the case of 2D video image, and to step S505 in the case of 3D video image.
[0049] In step S503, the display position control unit 311 reads out the 2D pixel shifting table from the RAM 303. In step S504, the display position control unit 311 acquires a corresponding display start position from the 2D pixel shifting table, based on the number of occurrences of the trigger signal (specifically, how many trigger signals have occurred up to the current processing of the flowchart) . [0050] Meanwhile, in step S505, the display position control unit 311 reads out the 3D pixel shifting table from the RAM 303. Then in step S506, the display position control unit 311 acquires a corresponding display start position from the 3D pixel shifting table based on the number of occurrences of the trigger signal.
[0051] In step S507, the display position control unit 311 cuts out an image based on the display start position acquired in step S504 or S506, and inputs the image cutout into the video image processing unit 314. [0052] Note that the format of the burn-in mitigation trigger signal may be defined such that the display position control unit 311 can acknowledge the cause of occurrence of the burn-in mitigation trigger signal. In this case, once the process for determining the format type of the video image (steps S501 and S502) is performed, unless the burn-in mitigation trigger signal is generated due to a cause that may accompany a change in the video image format (for example, a change of channel) , this process can be omitted thereafter.
[0053] As described above, with the present embodiment, the broadcast receiver 300 shifts the region of the video image output on the display panel 101 in order to mitigate burn-in on the display panel 101. In the case where the video image is a 3D video image, the broadcast receiver 300 shifts the region such that the pixels for the left eye image are displayed in the positions of the pixels for the left eye image on the display panel 101, and the pixels for the right eye image are displayed in the positions of the pixels for the right eye image on the display panel 101. In this manner, a technique for mitigating burn- in for the 3D video image is provided. [0054] Second Embodiment
In a second embodiment, a case is described in which the active shutter method is employed as the method for displaying 3D video images. FIG. 6 is a conceptual diagram of 3D video image display by the active shutter method. As illustrated in FIG. 6, left eye images (L_tl, L_t3, ...) and right eye images (R_t2, R_t4, ...) are alternately displayed in time-series, and the parallax between both images causes a three- dimensional effect. [0055] FIG. 7 is a block diagram showing a schematic configuration of a broadcast receiver 700 according to a second embodiment. In FIG. 7, constituent elements similar to those in the broadcast receiver 300 (FIG. 3) are assigned identical reference numerals, and their further description is omitted. [0056] A decoder unit 701 includes a first decoder
702 that decodes left eye images and a second decoder
703 that decodes right eye images, and decodes MPEG-2 coded video data input from the demultiplexer unit 307 and inputs the decoded video data into a decoder switching unit 704. Also, the decoder unit 701 decodes MPEG-2 AAC-coded audio data to convert the audio data into a linear PCM format, and inputs the converted data to the audio processing unit 315.
[0057] The decoder switching unit 704 alternately inputs the left eye images and the right eye images input from the decoder unit 701 to the resolution conversion unit 313. Using two decoders in this manner enables display of video images at a higher frame rate. [0058] A display position control unit 705 determines the region to be displayed of the image whose resolution has been converted by the resolution conversion unit 313, based on whether the image is the left eye image or the right eye image, and the determination result by the video image determination unit 309, and the partial image cut out from the determined display region is input into the video image processing unit 314. When determining the display region, the display position control unit 705 causes the display start positions for a pair of a left eye image and a right eye image to be matched. [0059] If the video data is a 3D video image, a glasses control unit 706 controls the liquid crystal shutter of glasses 707 such that the left eye image only enters the left eye and the right eye image only- enters the right eye in synchronization with the timing in which the left eye images and the right eye images are displayed in alternation.
[0060] A display panel 708 differs from the display panel 101 in the first embodiment, and does not include a polarization film. A first memory area 709 holds the 2D pixel shifting table and a second memory area 710 holds the 3D pixel shifting table. However, unlike the first embodiment, since the left eye image and the right eye image do not coexist in a single frame, design of the 3D pixel shifting table is not restricted by the arrangement of the polarization film. [0061] FIG. 8 is a flowchart illustrating burn-in mitigation processing by the broadcast receiver 700. In FIG. 8, steps where processes similar to those in the first embodiment (FIG. 5) are performed are assigned identical reference numerals, and description thereof is omitted. Upon generation of the burn-in mitigation trigger signal, the processing of this flowchart starts.
[0062] In the second embodiment, it is assumed that the pixel shifting table is configured such that the display start position is shifted by two pixels or more for a single trigger signal, for example, N = {1, 2, ...} = {[1,1], [7,1], ...}. In this case, if the display start position is shifted by the entire shift amount at once, when one frame is changed to the next frame, such shifting is noticeable to viewers, which may be perceived as a disruption in the video image. For this reason, with the present embodiment, the display position control unit 705 gradually shifts the display start position over several frames, from the display start position before the trigger signal is generated (e.g., [1, I]) to the display start position after the trigger signal is generated (e.g., [7, I]). [0063] In step S801, the display position control unit 705 obtains a display start position corresponding to the number of occurrences of the trigger signal from the 2D pixel shifting table, and sets the position as a target shift position. In step S802, the display position control unit 705 shifts the display start position by a prescribed unit amount (e.g., one pixel). For example, if the display start position before shifting is [1, 1] and the target shift position is [7, 1], the display start position after shifting is [2, 1] . [0064] In step S803, the display position control unit 705 cuts out an image based on the display start position obtained after shifting in step S802, and inputs the image cutout to the video image processing unit 314. In step S804, the display position control unit 705 determines whether or not the display start position has reached the target shift position. If the target shift position is not reached, the procedure returns to step S802, and if the target shift position is reached, the processing ends.
[0065] Meanwhile, in step S805, the display position control unit 705 obtains the display start position corresponding to the number of occurrences of the trigger signal from the 3D pixel shifting table, and sets the position as the target shift position. In step S806, the display position control unit 705 determines whether or not a video image as the processing target is the left eye image. If the video image is the left eye image, the procedure proceeds to step S807, and if it is not the left eye image, the procedure proceeds to step S808.
[0066] In step S807, the display position control unit 705 shifts the display start position by a prescribed unit amount (e.g., one pixel). For example, if the display start position before shifting is [1, 1] and the target shift position is [5, 1] , the display start position after shifting is [2, 1] . [0067] In step S808, the display position control unit 705 cuts out an image based on the display start position obtained after shifting in step S807, and inputs the image to the video image processing unit 314 In step S809, the display position control unit 705 determines whether or not the display start position has reached the target shift position. If the target shift position is not reached, the procedure returns to step S806, and if the target shift position is reached, processing ends.
[0068] As understood from steps S806 to S809, when the processing target video image is the right eye image, the display start position is not shifted, so the display start positions of a pair of the left eye image and the right eye image that correspond to the same scene match. As a result, the parallax does not change between the left eye image and right eye image that correspond to the same scene.
[0069] FIG. 9 is a conceptual diagram showing how the display start position is shifted according to the flowchart in FIG. 8. As illustrated in FIG. 9, in the case of the 3D video image, the display start positions of a pair of the left eye image and the right eye image (e.g., L_tl and R_t2) that correspond to the same scene match. In other words, the display start position is not shifted at a timing other than the timing with which a pair of left and right eye images that correspond to the same scene is switched to another pair of left and right eye images.
[0070] Note that setting the shift amount to 0 with respect to the coordinate values for the 3D pixel shifting table means stopping pixel shifting processing. If a motion vector between frames is determined to be large with the decoder unit 701, the motion of an object in the video image can be considered to be large. If pixel shifting is performed in this case, a significant disruption in the video image appears and the 3D effect is reduced. Accordingly, the decoder unit 701 divides a frame into a plurality of regions, references the motion vector for each region, and notifies the display position control unit 705 of the average motion amount of the object in the frame. [0071] If the received average motion amount exceeds a prescribed threshold, the display position control unit 705 operates with replacing the shift amount to "0" with respect to the coordinate values in the 3D pixel shifting table, even in the case where the burn-in mitigation trigger signal is generated. As a result, a reduction of the 3D effect can be avoided. Note that in this case, since the motion of the object in the movie image itself is large, burn-in that may bring about an afterimage does not readily occur. [0072] As described above, according to the present embodiment, the broadcast receiver 700 shifts the region of the video image to be output in the display panel 708 so as to mitigate burn-in on the display panel 708. In the case where the video image is a 3D video image, the broadcast receiver 700 shifts the region such that the display start positions of the left eye image and the right eye image corresponding to the same scene match. Accordingly, fluctuation in the parallax between the left eye image and the right eye image corresponding to the same scene is prevented. In this manner, a burn-in mitigation technique for 3D video images is provided. [0073] Other Embodiments
Aspects of the present invention can also be realized by a computer of a system or apparatus (or devices such as a CPU or MPU) that reads out and executes a program recorded on a memory device to perform the functions of the above-described embodiment (s) , and by a method, the steps of which are performed by a computer of a system or apparatus by, for example, reading out and executing a program recorded on a memory device to perform the functions of the above-described embodiment (s) . For this purpose, the program is provided to the computer for example via a network or from a recording medium of various types serving as the memory device (e.g., computer-readable medium) . [0074] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions. [0075] This application claims the benefit of Japanese Patent Application No. 2009-134298, filed on June 3, 2009, which is hereby incorporated by reference herein in its entirety.

Claims

1. A video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: video image processing means for cutting out a part of frame images from a three-dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means, when changing the cutout position of the partial image, cuts out the partial image from the frame images such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region.
2. The video image processing apparatus according to claim 1, wherein in the display region, the first display portion and the second display portion are provided on alternating horizontal lines, and the video image processing means shifts the cutout position by 2n lines (where n is a natural number) in a vertical direction.
3. A video image processing apparatus that outputs a video image to a display device, comprising: video image processing means for cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of left and right frame image sets for each scene, a single left and right frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and output means for outputting the partial image cut out by the video image processing means to the display device, wherein the video image processing means executes processing for changing a cutout position of the partial image, and the video image processing means executes the processing for changing the cutout position at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set.
4. The video image processing apparatus according to claim 3, wherein the video image processing means, when changing the cutout position from a current cutout position to a target cutout position, the cutout position is shifted to the target cutout position in a stepwise manner by gradually shifting the cutout position over a plurality of left and right frame image sets .
5. A method for controlling a video image processing apparatus that outputs a video image to a display device having a display region including a first display portion for displaying a left eye image and a second display portion for displaying a right eye image, comprising: a video image processing step of cutting out a part of frame images from a three-dimensional video image configured as an aggregate of the frame images for each scene, a single frame image being formed by arranging a pair of a left eye image and a right eye image corresponding to the same scene in a prescribed pattern; and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, when changing the cutout position of the partial image, the partial image is cut out from the frame image such that an arrangement pattern of the left eye image and the right eye image in the partial image after the cutout position is changed matches an arrangement pattern of the first display portion and the second display portion in the display region.
6. The method according to claim 5, wherein, in the display region, the first display portion and the second display portion are provided on alternating horizontal lines, and in the video image processing step, the cutout position is shifted by 2n lines (where n is a natural number) in a vertical direction.
7. A method for controlling a video image processing apparatus that outputs a video image to a display device, comprising: a video image processing step of cutting out a part of a left eye frame image and a right eye frame image from a three-dimensional video image configured as an aggregate of right and left frame image sets for each scene, a single right and left frame image set being formed of a pair of a left eye frame image and a right eye frame image corresponding to the same scene, and an outputting step of outputting the partial image cut out in the video image processing step to the display device, wherein in the video image processing step, processing for changing a cutout position of the partial image is executed, and in the video image processing step, the processing for changing the cutout position is executed at a timing in which, in the three-dimensional video image, a left and right frame image set corresponding to the same scene is switched to the next left and right frame image set.
8. The method according to claim 7, wherein in the video image processing step, when changing the cutout position from a current cutout position to a target cutout position, the cutout position is shifted to the target cutout position in a stepwise manner by gradually shifting the cutout position over a plurality of left and right frame image sets.
PCT/JP2010/056894 2009-06-03 2010-04-13 Video image processing apparatus and method for controlling video image processing apparatus Ceased WO2010140430A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020117031254A KR101318711B1 (en) 2009-06-03 2010-04-13 Video image processing apparatus and method for controlling video image processing apparatus
US13/322,893 US9253429B2 (en) 2009-06-03 2010-04-13 Video image processing apparatus and method for controlling video image processing apparatus
CN201080024839.9A CN102804756B (en) 2009-06-03 2010-04-13 Video image processing device and control method for video image processing device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009134298A JP5185202B2 (en) 2009-06-03 2009-06-03 Image processing apparatus and image processing apparatus control method
JP2009-134298 2009-06-03

Publications (1)

Publication Number Publication Date
WO2010140430A1 true WO2010140430A1 (en) 2010-12-09

Family

ID=42269842

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/056894 Ceased WO2010140430A1 (en) 2009-06-03 2010-04-13 Video image processing apparatus and method for controlling video image processing apparatus

Country Status (5)

Country Link
US (1) US9253429B2 (en)
JP (1) JP5185202B2 (en)
KR (1) KR101318711B1 (en)
CN (1) CN102804756B (en)
WO (1) WO2010140430A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271569A1 (en) * 2010-12-10 2013-10-17 Fujitsu Limited Stereoscopic moving picture generating apparatus and stereoscopic moving picture generating method
EP2748669A1 (en) * 2011-08-24 2014-07-02 Sony Corporation Display device and display control method
CN104811678A (en) * 2014-01-23 2015-07-29 电信科学技术研究院 Method and device for carrying out video playing
WO2016066775A1 (en) * 2014-10-29 2016-05-06 Gvbb Holdings S.A.R.L. Degradation control of display pixels for a high definition display
EP3640933A4 (en) * 2017-06-16 2020-04-22 Jvckenwood Corporation DISPLAY SYSTEM, VIDEO PROCESSING DEVICE, PIXEL OFFSET DISPLAY DEVICE, VIDEO PROCESSING METHOD, DISPLAY METHOD AND PROGRAM
EP3836130A4 (en) * 2018-11-01 2022-04-27 Samsung Electronics Co., Ltd. ELECTRONIC DEVICE FOR CONTROLLING POSITION OR IMAGE DISPLAY AREA BASED ON CHANGE IN IMAGE CONTENT

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9049426B2 (en) * 2010-07-07 2015-06-02 At&T Intellectual Property I, Lp Apparatus and method for distributing three dimensional media content
KR102320207B1 (en) * 2015-05-06 2021-11-03 삼성디스플레이 주식회사 Image corrector, display device including the same and method for displaying image using display device
JP6793297B2 (en) * 2015-10-05 2020-12-02 パナソニックＩｐマネジメント株式会社 Projection type image display device
KR102330164B1 (en) * 2017-06-08 2021-11-24 엘지전자 주식회사 Digital signage and operating method thereof
JP7379961B2 (en) 2019-09-04 2023-11-15 株式会社Ｊｖｃケンウッド Display system and display method
KR20220161903A (en) 2021-05-31 2022-12-07 엘지디스플레이 주식회사 Display panel, display device including the display panel and personal immersion system using the display device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020009137A1 (en) * 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
EP1555814A2 (en) * 2004-01-15 2005-07-20 Matsushita Electric Industrial Co., Ltd. Reducing burn-in associated with mismatched video image/display aspect ratios
US20060001601A1 (en) * 2004-06-25 2006-01-05 Funai Electric Co, Ltd. Plasma display apparatus
EP1679683A1 (en) * 2005-01-06 2006-07-12 Thomson Licensing Method and device for protecting display from burn-in effect
US20060209054A1 (en) * 2003-02-20 2006-09-21 Ikuo Someya Image signal processing apparatus and processing method, and image display apparatus using the same
US20070096767A1 (en) * 2005-10-28 2007-05-03 Chang-Hung Tsai Method of preventing display panel from burn-in defect

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9027881D0 (en) * 1990-12-21 1991-02-13 Delta System Design Ltd Improvements in 3d imaging systems
JP3239541B2 (en) * 1993-07-13 2001-12-17 ソニー株式会社 Stereoscopic television signal generator and stereoscopic video display
CN1113320C (en) * 1994-02-01 2003-07-02 三洋电机株式会社 Method of converting two-dimensional images into three-dimensional images
US5767898A (en) * 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
US6549295B1 (en) * 1997-12-15 2003-04-15 Insight, Inc. Method for making products having merged images
JP3756014B2 (en) * 1999-05-26 2006-03-15 パイオニア株式会社 Image display control apparatus, image display control method, and recording medium recording the control program
JP4002522B2 (en) * 2003-03-07 2007-11-07 株式会社ソフィア Game machine and image display device
KR100962696B1 (en) * 2007-06-07 2010-06-11 주식회사 이시티 Construction method of encoded stereoscopic video data file
KR101520620B1 (en) * 2008-08-18 2015-05-18 삼성전자주식회사 Method and apparatus for determining a two- or three-dimensional display mode of an image sequence
US9055278B2 (en) * 2009-01-07 2015-06-09 Dolby Laboratories Licensing Corporation Conversion, correction, and other operations related to multiplexed data sets
US20100328428A1 (en) * 2009-06-26 2010-12-30 Booth Jr Lawrence A Optimized stereoscopic visualization

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020009137A1 (en) * 2000-02-01 2002-01-24 Nelson John E. Three-dimensional video broadcasting system
US20060209054A1 (en) * 2003-02-20 2006-09-21 Ikuo Someya Image signal processing apparatus and processing method, and image display apparatus using the same
EP1555814A2 (en) * 2004-01-15 2005-07-20 Matsushita Electric Industrial Co., Ltd. Reducing burn-in associated with mismatched video image/display aspect ratios
US20060001601A1 (en) * 2004-06-25 2006-01-05 Funai Electric Co, Ltd. Plasma display apparatus
EP1679683A1 (en) * 2005-01-06 2006-07-12 Thomson Licensing Method and device for protecting display from burn-in effect
US20070096767A1 (en) * 2005-10-28 2007-05-03 Chang-Hung Tsai Method of preventing display panel from burn-in defect

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271569A1 (en) * 2010-12-10 2013-10-17 Fujitsu Limited Stereoscopic moving picture generating apparatus and stereoscopic moving picture generating method
EP2748669A1 (en) * 2011-08-24 2014-07-02 Sony Corporation Display device and display control method
CN104811678A (en) * 2014-01-23 2015-07-29 电信科学技术研究院 Method and device for carrying out video playing
WO2016066775A1 (en) * 2014-10-29 2016-05-06 Gvbb Holdings S.A.R.L. Degradation control of display pixels for a high definition display
US9654693B2 (en) 2014-10-29 2017-05-16 Gvbb Holdings S.A.R.L. Degradation control of display pixels for a high definition display
CN107111983A (en) * 2014-10-29 2017-08-29 Gvbb控股有限责任公司 Display Pixel Degradation Control for High Definition Displays
EP3640933A4 (en) * 2017-06-16 2020-04-22 Jvckenwood Corporation DISPLAY SYSTEM, VIDEO PROCESSING DEVICE, PIXEL OFFSET DISPLAY DEVICE, VIDEO PROCESSING METHOD, DISPLAY METHOD AND PROGRAM
US11381790B2 (en) 2017-06-16 2022-07-05 Jvckenwood Corporation Display system, video processing device, pixel shift display device, video processing method, display method, and program
EP3836130A4 (en) * 2018-11-01 2022-04-27 Samsung Electronics Co., Ltd. ELECTRONIC DEVICE FOR CONTROLLING POSITION OR IMAGE DISPLAY AREA BASED ON CHANGE IN IMAGE CONTENT
US11631382B2 (en) 2018-11-01 2023-04-18 Samsung Electronics Co., Ltd. Electronic device for controlling display position or area of image on basis of change of content of image

Also Published As

Publication number Publication date
JP2010283528A (en) 2010-12-16
US20120075438A1 (en) 2012-03-29
KR20120026574A (en) 2012-03-19
JP5185202B2 (en) 2013-04-17
CN102804756B (en) 2015-07-08
CN102804756A (en) 2012-11-28
US9253429B2 (en) 2016-02-02
KR101318711B1 (en) 2013-10-16

Similar Documents

Publication Publication Date Title
US9253429B2 (en) Video image processing apparatus and method for controlling video image processing apparatus
US9066077B2 (en) 3D image reproduction device and method capable of selecting 3D mode for 3D image
US20120026287A1 (en) Receiver, transmitter, communication system, display control method, program, and data structure
JP2011029849A (en) Receiving device, communication system, method of combining caption with stereoscopic image, program, and data structure
EP2320669A1 (en) Stereoscopic image reproduction method in case of pause mode and stereoscopic image reproduction apparatus using same
US20110141230A1 (en) 3d display device and method for correcting image thereof
KR20120051978A (en) Apparatus and method for processing 3 dimensional video signal
US8780186B2 (en) Stereoscopic image reproduction method in quick search mode and stereoscopic image reproduction apparatus using same
JP5955851B2 (en) Transfer of 3D image data
JP4762343B2 (en) Image quality adjusting apparatus and image quality adjusting method
JP2012129708A (en) Stereoscopic image signal processing device and method
US20130147912A1 (en) Three dimensional video and graphics processing
US20150130897A1 (en) Method for generating, transporting and reconstructing a stereoscopic video stream
US9872008B2 (en) Display device and video transmission device, method, program, and integrated circuit for displaying text or graphics positioned over 3D video at varying depths/degrees
JP2013021683A (en) Image signal processing device, image signal processing method, image display device, image display method, and image processing system
KR101895943B1 (en) shutter glasses, method for controlling shutter glasses, device for processing 3 dimensional image
US8953018B2 (en) Generation and display of stereoscopic images
WO2014136140A1 (en) Video processing device and video processing method
JP5717496B2 (en) Video display device
KR20120015666A (en) Stereoscopic image playback device and stereoscopic image playback method
US20110316986A1 (en) Video display apparatus and video display method
US20120257817A1 (en) Image output apparatus
KR101112085B1 (en) Demultiplexer and method for 3D TV
JP2011223598A (en) Image quality adjustment device and image quality adjustment method
KR20120017127A (en) Stereoscopic image playback device and stereoscopic image playback method

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080024839.9

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10716641

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 13322893

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20117031254

Country of ref document: KR

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 10716641

Country of ref document: EP

Kind code of ref document: A1