US8432495B2 - Video processor and video processing method - Google Patents

Video processor and video processing method Download PDF

Info

Publication number
US8432495B2
US8432495B2 US12/440,471 US44047107A US8432495B2 US 8432495 B2 US8432495 B2 US 8432495B2 US 44047107 A US44047107 A US 44047107A US 8432495 B2 US8432495 B2 US 8432495B2
Authority
US
United States
Prior art keywords
data
frame
interpolation
video
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/440,471
Other languages
English (en)
Other versions
US20090303392A1 (en
Inventor
Katsumi Terai
Yoshihito Ohta
Kazushi Nozawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Original Assignee
Panasonic Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp filed Critical Panasonic Corp
Assigned to PANASONIC CORPORATION reassignment PANASONIC CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: TERAI, KATSUMI, NOZAWA, KAZUSHI, OHTA, YOSHIHITO
Publication of US20090303392A1 publication Critical patent/US20090303392A1/en
Application granted granted Critical
Publication of US8432495B2 publication Critical patent/US8432495B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • H04N5/145—Movement estimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
    • H04N7/0132—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter the field or frame frequency of the incoming video signal being multiplied by a positive integer, e.g. for flicker reduction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/02—Improving the quality of display appearance
    • G09G2320/0261—Improving the quality of display appearance in the context of movement of objects on the screen or movement of the observer relative to the screen
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/10—Special adaptations of display systems for operation with variable images
    • G09G2320/106—Determination of movement vectors or equivalent parameters within the image
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0435—Change or adaptation of the frame rate of the video stream
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0135—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
    • H04N7/014—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving interpolation processes involving the use of motion vectors

Definitions

  • the present invention relates to a video processor and a video processing method in which frame rate conversion is carried out.
  • video data is subjected to frame rate conversion (see for example Patent Document 1).
  • frame rate conversion a motion vector is detected from two consecutive frames (screen images forming a moving image) on the time base and an interpolation frame is generated using the detected motion vector, for example.
  • the compression efficiency of the video data can be improved while the picture quality of the video images can be improved.
  • characters such as a channel number can be displayed on a display panel.
  • the television receiver When characters are displayed on the display panel, the television receiver generates character data by a microcomputer included therein.
  • the generated character data is superimposed on the video data after the frame rate conversion and the superimposed data is output as a video image.
  • an interpolation frame is generated from two consecutive frames on the time base, and therefore the frame frequency of the video data increases.
  • the video data at a frame frequency of 50 Hz is changed into video data at a frame frequency of 100 Hz by the frame rate conversion. Therefore, when the character data is superimposed after the frame rate conversion, the video data having its frame frequency increased must have character data superimposed thereon, and therefore a high performance microcomputer that operates at high processing speed must be used. This increases the product cost for the television receiver.
  • the inventors considered about the way of superimposing the character data on the video data and then carrying out frame rate conversion for reduction of the product cost for the television receiver.
  • the video data before the frame frequency increases, in other words, video data at a low frame frequency can have character data superimposed thereon. Therefore, a high performance microcomputer that operates at high processing speed is not necessary. Therefore, the product cost for the television receiver can be reduced.
  • the inventors have found that when the frame rate conversion is carried out after the character data is superimposed on the video data, the picture quality is lowered in some cases.
  • the inventors have found a number of causes for the degradation in the picture quality.
  • problems generated during the frame rate conversion will be described by illustrating some examples of the causes.
  • FIGS. 15 and 16 are views showing an example of how a channel number is displayed on a display panel in the television receiver.
  • characters 1005 representing the channel number “31” are displayed on the display panel 1001 of the television receiver 1000 .
  • three birds 1006 , 1007 , and 1008 move to the right in the main screen image 1002 .
  • the bird 1006 is partly occluded by the characters 1005 .
  • an interpolation frame is generated from two consecutive frames on the time base. Therefore, in the above-described example, a motion vector cannot be detected correctly for the part of the bird 1006 occluded by the characters 1005 . Therefore, a correct interpolation frame cannot be generated.
  • the motion vector is detected on a block-basis (such as a block of 8 ⁇ 8 pixels). Therefore, if the boundary between the characters 1005 and the bird 1006 is present within one block, the motion vector of the block is detected based on the bird 1006 in some cases. Therefore, in the interpolation frame, part of the characters 1005 could move as the bird 1006 moves.
  • the picture quality is lowered in the region surrounding the characters 1005 and the bird 1006 .
  • a main screen image 1002 based on one piece of video data and a sub screen image 1003 based on another piece of the video data are displayed on the display panel 1001 .
  • the main screen image 1002 and the sub screen image 1003 are independent from each other and the sub screen image 1003 is displayed on the main screen image 1002 .
  • an automobile 1004 travels to the left in the main screen image 1002 . Therefore, the automobile 1004 partly occluded by the sub screen image 1003 in FIG. 15 gradually comes to appear on the main screen image 1002 .
  • the motion vector of the block is sometimes detected based on the movement of the automobile 1004 . In this way, in the interpolation frame, part of the sub screen image 1003 can move as the automobile 1004 moves.
  • the picture quality is lowered in the sub screen image 1003 and the region surrounding the sub screen image 1003 .
  • the picture quality can be lowered by frame rate conversion. Therefore, it is difficult to stably provide video images with high picture quality.
  • a video processor processes superimposed data produced based on first data for displaying a first video image and second data for displaying a second video image on the first video image and includes a motion vector detector that detects a motion vector from superimposed data for a plurality of frames, and an interpolation data generator that generates interpolation data in an interpolation frame that interpolates between two frames based on the superimposed data for the plurality of frames and the motion vector detected by the motion vector detector.
  • the interpolation data generator When the second video image is displayed at least in one of the two frames, the interpolation data generator generates interpolation data for a region corresponding to at least an outer peripheral part of the display region for the second video image in the interpolation frame without using the motion vector detected by the motion vector detector.
  • a motion vector is detected from superimposed data for a plurality of frames in the motion vector detector.
  • interpolation data generator interpolation data in an interpolation frame that interpolates between two frames is generated based on the superimposed data for the plurality of frames and the motion vector.
  • the interpolation data generator when at least one of the two frames has a display region for the second video image, the interpolation data generator generates the interpolation data without using the motion vector for a region corresponding to at least the outer peripheral part of the display region for the second video image in the interpolation frame.
  • the outer peripheral part refers to a region having a prescribed width including the contour line of the display region for the second video image.
  • the outer peripheral part that should not be moved can be prevented from moving in the interpolation frame based on the motion vector.
  • the second video image can be prevented from being displayed in the region for displaying the first video image and the first video image can be prevented from being displayed in the region for displaying the second video image. Therefore, the second video image can be displayed in an appropriate position in the interpolation frame.
  • the interpolation data generator can generate an interpolation frame from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the number of frames of the first data (frame frequency) increases, the second data can be superimposed on the first data.
  • the first data when for example the second data is data for an on screen display (hereinafter abbreviated as “OSD data”), the first data may have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the OSD data is superimposed on the first data after the number of frames of the first data increases.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • the interpolation data generator may generate interpolation data for all the regions of the interpolation frame without using the motion vector detected by the motion vector detector.
  • the second video image that should not be moved can surely be prevented from moving in the interpolation frame based on the motion vector. Therefore, in the interpolation frame, the second video image can surely be prevented from being displayed in the region for displaying the first video image and the first video image can surely be prevented from being displayed in the region for displaying the second video image. Therefore, the second video image can be displayed in an appropriate position in the interpolation frame.
  • the interpolation data generator may generate the second data as interpolation data for a region corresponding to at least the outer peripheral part of the display region for the second video image in the interpolation frame.
  • a video image is also displayed based on the second data in a region at least corresponding to the above-described outer peripheral part in the interpolation frame. Therefore, when the two frames both have a display region for the second video image, a video image based on the first data can be prevented from being displayed in the region at least corresponding to the outer peripheral part in the interpolation. Consequently, more precise motion compensation can be carried out.
  • the interpolation data generator may determine the region corresponding to at least the outer peripheral part based on the region data indicating the display region for the second video image in each frame.
  • the region for displaying at least the above-described outer peripheral part in the interpolation frame can readily be determined based on the region data.
  • the interpolation data generator may generate data for first and second prediction frames based on the superimposed data for the previous and present frames on the time base among the two frames and the motion vector detected by the motion vector detector, and when the region of at least the outer peripheral part in the first prediction frame and the region of at least the outer peripheral part in the second prediction frame are different, the interpolation data generator may select data in a corresponding region of one of the first and second prediction frames as interpolation data for a region corresponding to at least the outer peripheral part in the other prediction frame in an interpolation frame.
  • the first prediction frame based on the previous frame and the motion vector and the second prediction frame based on the present frame and the motion vector are generated as candidates for the interpolation frame.
  • the interpolation frame for the region of the first prediction frame at least corresponding to the outer peripheral part, data in a corresponding region of the second prediction frame is used as the interpolation data and for the region of the second prediction frame at least corresponding to the outer peripheral part, data in a corresponding region of the first prediction frame is used as the interpolation data.
  • the above described region of at least the outer peripheral part that should not be moved can be prevented from moving in the interpolation frame, and the interpolation data in the interpolation frame can be generated from the superimposed data for the previous or present frame based on the motion vector. Therefore, in the interpolation frame, the second video image can be displayed in an appropriate position and even more precise motion compensation can be carried out. Consequently, high picture quality video images can stably be provided.
  • the interpolation data generator may further generate data in a third prediction frame by calculation using the superimposed data for the previous and present frames, and when the region of at least the outer peripheral part in the first prediction frame and the region of at least the outer peripheral part in the second prediction frame are equal, the interpolation data generator may select data in a corresponding region in the third prediction frame as interpolation data for regions corresponding to at least the outer peripheral part in the first and second prediction frames in an interpolation frame.
  • the third prediction frame is generated as a candidate for the interpolation frame by calculation using superimposed data in the previous frame and superimposed data in the present frame.
  • data in the corresponding region of the third prediction frame is used as the interpolation data for both regions at least corresponding to the outer peripheral part of the first prediction frame and the outer peripheral part of the second prediction frame.
  • the above-described region of at least the outer peripheral part that should not be moved can surely be prevented from moving in the interpolation frame while the interpolation data in the interpolation frame can be generated from the superimposed data for the previous and present frames.
  • the second video image can be displayed in an appropriate position and even more precise motion compensation can be carried out. Consequently, high picture quality video images can stably be provided.
  • the video processor may further include a prediction region data generator that generates first prediction region data indicating the display region for the second video image in the first prediction frame based on region data indicating the display region for the second video image in the previous frame and the motion vector detected by the motion vector detector, and second prediction region data indicating the display region for the second video image in the second prediction frame based on region data indicating the display region for the second video image in the present frame and the motion vector detected by the motion vector detector, and the interpolation data generator may generate interpolation data based on the first and second prediction region data generated by the prediction region data generator.
  • the interpolation data generator can readily identify at least the region of the outer peripheral part in the first and second prediction frames based on the first and second prediction region data.
  • the second data may be data for an on screen display, and the region of at least the outer peripheral part may include all the regions for the on screen display.
  • the first data can have the data for an on screen display (hereinafter abbreviated as “OSD data”) superimposed thereon.
  • OSD data on screen display
  • the first data may have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data increases.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • the interpolation data is generated without using the motion vector for the region for an on screen display.
  • the region for the on screen display that should not be moved can be prevented from moving in the interpolation frame based on the motion vector. Therefore, in the interpolation frame, an on screen display can be prevented from being provided in the region in which the on screen display should not be provided and the first video image can be prevented from being displayed in the region for an on screen display. Therefore, an on screen display can be provided in an appropriate position in the interpolation frame.
  • a video processor processes first data for displaying a first video image and second data for displaying a second video image and includes a superimposed data generator that generates superimposed data for a plurality of frames in which the second video image is displayed on the first video image by superimposing the second data on the first data, a motion vector detector that detects a motion vector from the first data for the plurality of frames, and an interpolation data generator that generates interpolation data in an interpolation frame that interpolates between two frames based on the superimposed data for the plurality of frames generated by the superimposed data generator and the motion vector detected by the motion vector detector.
  • the second data for displaying the second video image is superimposed on the first data for displaying the first video image to form the superimposed data in the superimposed data generator.
  • a motion vector is detected from the first data for the plurality of frames.
  • the interpolation data generator the interpolation data in the interpolation frame that interpolates between two frames is generated based on the superimposed data for the plurality of frames and the motion vector.
  • the motion vector is detected from the first data. If the second video image is displayed on the first video image, the motion vector can be detected with no consideration given to the second data.
  • the interpolation data generator can generate the interpolation frame from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the frame number of the first data (frame frequency) increases, the second data can be superimposed on the first data.
  • the first data can have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data is increased.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • the interpolation data generator may generate interpolation data for a region corresponding to the display region for the second video image in the interpolation frame without using the motion vector detected by the motion vector detector.
  • the display region for the second video image that should not be moved can be prevented from moving in the interpolation frame based on the motion vector. Therefore, in the interpolation frame, the second video image can be prevented from being displayed in the region for displaying the first video image and the first video image can be prevented from being displayed in the region for displaying the second video image. Therefore, the second video image can be displayed in an appropriate position in the interpolation frame.
  • the interpolation data generator may generate interpolation data for all the regions of the interpolation frame without using the motion vector detected by the motion vector detector.
  • the second video image that should not be moved can surely be prevented from moving in the interpolation frame based on the motion vector. Therefore, in the interpolation frame, the second video image can surely be prevented from being displayed in the region for displaying the first video image and the first video image can surely be prevented from being displayed in the region for displaying the second video image. Therefore, the second video image can be displayed in an appropriate position in the interpolation frame.
  • the interpolation data generator may generate the second data as interpolation data in a region corresponding to the display region for the second video image in the interpolation frame.
  • the video image based on the second data is also displayed in the region of the interpolation frame corresponding to at least the outer peripheral part. Therefore, when the two frames both have the display region for the second video image, the video image based on the first data can be prevented from being displayed in the region of the interpolation frame at least corresponding to the outer peripheral part. Consequently, more precise motion compensation can be carried out.
  • the interpolation data generator may determine a region corresponding to the display region for the second video image based on region data indicating the display region for the second video image in each frame. In this way, the display region for the second video image in the interpolation frame can readily be determined based on the region data.
  • the interpolation data generator may generate data in first and second prediction frames based on the superimposed data for the previous and present frames on the time base among the two frames and the motion vector detected by the motion vector detector, and when the display region for the second video image in the first prediction frame and the display region for the second video image in the second prediction frame are different, the interpolation data generator may select, as interpolation data in the region corresponding to the display region for the second video image in one of the first and second prediction frames in the interpolation frame, data in the corresponding region of the other prediction frame.
  • the first prediction frame based on the previous frame and the motion vector and the second prediction frame based on the present frame and the motion vector are generated as candidates for the interpolation frame.
  • the interpolation frame for the region of the first prediction frame corresponding to the display region for the second video image, data in a corresponding region of the second prediction frame is used as the interpolation data, and for the region of the second prediction frame corresponding to the display region for the second video, data in a corresponding region of the first prediction frame is used as the interpolation data.
  • the display region for the second video image that should not be moved can be prevented from moving in the interpolation frame, while the interpolation data in the interpolation frame can be generated from the superimposed data of the previous or present frame based on the motion vector.
  • the second video image can be displayed in an appropriate position and more precise motion compensation can be carried out. Consequently, high picture quality video images can stably be provided.
  • the interpolation data generator may further generate data in a third prediction frame by calculation using the superimposed data for the previous and present frames, and when the display region for the second video image in the first prediction frame and the display region for the second video image in the second prediction frame are equal, in the interpolation frame, the interpolation data generator may select data in a corresponding region of said third prediction frame as interpolation data for regions corresponding to the display regions for said second video image in said first and second prediction frames.
  • the third prediction frame is generated as a candidate for the interpolation frame by calculation using superimposed data for the previous frame and superimposed data for the present frame.
  • data in the corresponding region of the third prediction frame is used as the interpolation data for both regions corresponding to the display region for the second video image in the first prediction frame and the display region for the second video image in the second prediction frame.
  • the display region for the second video image that should not be moved can surely be prevented from moving in the interpolation frame, while the interpolation data in the interpolation frame can be generated from the superimposed data for the previous and present frames.
  • the second video image can be displayed in an appropriate position and more precise motion compensation can be carried out. Consequently, high picture quality video images can stably be provided.
  • the video processor may further include a prediction region data generator that generates first prediction region data indicating the display region for the second video image in the first prediction frame based on region data indicating the display region for the second video image in the previous frame and the motion vector detected by the motion vector detector, and second prediction region data indicating the display region for the second video image in the second prediction frame based on region data indicating the display region for the second video image in the present frame and the motion vector detected by the motion vector detector, and the interpolation data generator may generate interpolation data based on the first and second prediction region data generated by the prediction region data generator.
  • the interpolation data generator can readily identify the display region for the second video image in the first and second prediction frames based on the first and second prediction region data.
  • the display region for the second video image that should not be moved can surely be prevented from moving in the interpolation frame, and the interpolation data in the interpolation frame can readily be generated from the superimposed data for the previous and present frames. Therefore, the second video image can be displayed in a more appropriate position in the interpolation frame and even more precise motion compensation can be carried out.
  • the second data may be data for an on screen display.
  • the first data before the interpolation frame is generated, in other words, before the frame number of the first data (frame frequency) increases, the first data can have the data for the on screen display (hereinafter abbreviated as “OSD data”) superimposed thereon.
  • OSD data data for the on screen display
  • the OSD data can be superimposed on the first data using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data is increased.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • a video processor processes superimposed data produced based on first data for displaying a first video image and second data for displaying a second video image on the first video image and includes an interpolation data generator that generates interpolation data for an interpolation frame that interpolates between two frames based on superimposed data for a plurality of frames, and a video corrector that corrects video images in the plurality of frames and the interpolation frame, and the video corrector is prevented from correcting the second video image or sets a lower video correction ratio for the second video image than that for the first video image in a frame in which the second video image is displayed among the plurality of frames and the interpolation frame.
  • the interpolation data in the interpolation frame that interpolates between the two frames can be generated from the superimposed data for the plurality of frames.
  • the plurality of frames and the interpolation frame are subjected to video correction.
  • the video corrector is prevented from carrying out video correction in the display region for the second video image or sets a lower video correction ratio for the second video image than that for the first video image.
  • the display region for the second video image can be prevented from being subjected unnecessary picture quality correction. Therefore, the picture quality of the second video image can be prevented from being degraded.
  • the elements of the second video image (second data) can be prevented from being reflected on the first video image after the correction. Therefore, the picture quality of the first video image after the video correction can be prevented from being degraded.
  • the interpolation data generator can generate the interpolation frame from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the number of frames of the first data (frame frequency) increases, the second data can be superimposed on the first data.
  • the first data when for example the second data is data for an on screen display (hereinafter abbreviated as “OSD data”), the first data may have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data increases.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • the video corrector may carry out video correction without using the second data in the frame in which the second video image is displayed.
  • the elements of the second video image (second data) can surely be prevented from being reflected on the first video image after the correction. Therefore, the picture quality of the first video image after the video correction can surely be prevented from being degraded.
  • the video corrector may extract a feature quantity in the plurality of frames and the interpolation frame based on the superimposed data and the interpolation data, subject the plurality of frames and the interpolation frame to video correction based on the extracted feature quantity, and extract the feature quantity without using the second data in a frame in which the second video image is displayed.
  • the plurality of frames and the interpolation frame are subjected to video correction based on the feature quantity, so that the picture quality in the plurality of frames and the interpolation frame can sufficiently be improved.
  • the second data is not used for extracting the feature quantity in the frame in which the second video image is displayed.
  • the elements of the second video image can be prevented from being reflected on the first video image after the correction. Therefore, the picture quality of the first video image after the video correction can surely be prevented from being degraded.
  • a video processing method processes superimposed data produced based on first data for displaying a first video image and second data for displaying a second video image on the first video image and includes the steps of detecting a motion vector from superimposed data for a plurality of frames, and generating interpolation data in an interpolation frame that interpolates between two frames based on the superimposed data for the plurality of frames and the motion vector.
  • step of generating the interpolation data when the second video image is displayed at least in one of the two frames, interpolation data for a region corresponding to at least an outer peripheral part of the display region for the second video image in the interpolation frame is generated without using the motion vector detected by the motion vector detector.
  • the motion vector is detected from the superimposed data for the plurality of frames.
  • the interpolation data in the interpolation frame that interpolates between two frames is generated based on the superimposed data for the plurality of frames and the motion vector.
  • the interpolation data is generated without using the motion vector for the region of the display region for the second video image corresponding to at least the outer peripheral part in the interpolation frame.
  • the outer peripheral part that should not be moved can be prevented from moving in the interpolation frame based on the motion vector. Therefore, in the interpolation frame, the second video image can surely be prevented from being displayed in the region for displaying the first video image and the first video image can surely be prevented from being displayed in the region for displaying the second video image. Therefore, the second video image can be displayed in an appropriate position in the interpolation frame.
  • the interpolation frame can be generated from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the number of frames of the first data (frame frequency) increases, the first data can have the second data superimposed thereon.
  • the first data when for example the second data is data for an on screen display (hereinafter abbreviated as “OSD data”), the first data may have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data increases. In this way, a high performance microcomputer is not necessary.
  • OSD data data for an on screen display
  • a video processing method is a method for processing first data for displaying a first video image and second data for displaying a second video image and includes the steps of generating superimposed data for a plurality of frames in which the second video image is displayed on the first video image by superimposing the second data on the first data, detecting a motion vector from the first data for the plurality of frames, and generating interpolation data in an interpolation frame that interpolates between two frames based on the superimposed data for the plurality of frames and the motion vector.
  • the second data for displaying the second video image is superimposed on the first data for displaying the first video image and thus the superimposed data is generated.
  • the motion vector is detected from the first data for the plurality of frames.
  • the interpolation data in the interpolation frame that interpolates between the two frames is generated based on the superimposed data for the plurality of frames and the motion vector.
  • the motion vector is detected from the first data. Therefore, the motion vector can be detected with no consideration given to the second data even if the second video image is displayed on the first video image.
  • the interpolation frame can be generated from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the frame number of the first data (frame frequency) increases, the second data can be superimposed on the first data.
  • the first data can have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data is increased. In this case, a high performance microcomputer is not necessary.
  • the interpolation data is generated without using the motion vector for the region at least corresponding to the outer peripheral part of the display region for the second video image in the interpolation frame.
  • the second video image can surely be prevented from being displayed in the region for displaying the first video image and the first video image can surely be prevented from being displayed in the region for displaying the second video image.
  • the interpolation frame can be generated from the superimposed data of the first and second data. Therefore, before the interpolation frame is generated, in other words, before the number of frames of the first data (frame frequency) increases, the second data can be superimposed on the first data.
  • the first data when for example the second data is data for an on screen display (hereinafter abbreviated as “OSD data”), the first data may have the OSD data superimposed thereon using a microcomputer whose data processing speed is lower than the case in which the first data has the OSD data superimposed thereon after the number of frames of the first data increases.
  • a high performance microcomputer is not necessary in the video processor, so that the product cost for the video processor can be reduced.
  • the motion vector can be detected from the first data. Therefore, if the second video image is displayed on the first display image, the motion vector can be detected with no consideration given to the second data. In this case, in the plurality of frames of the superimposed data, precise matching can be carried out between the two frames for the first video image in the region that is not displayed because of the second video image. Therefore, the motion vector can be detected highly precisely for the first video image.
  • the second video image is not subjected to video correction or a lower video correction ratio is set for the second video image than that for the first video image.
  • the display region for the second video image can be prevented from being subjected to unnecessary picture quality correction. Therefore, the picture quality of the second video image can be prevented from being degraded.
  • the elements of the second video image (second data) can be prevented from being reflected on the first video image after the correction. Therefore, the picture quality of the first video image after the video correction can be prevented from being degraded.
  • FIG. 1 is a block diagram of the structure of a television receiver according to a first embodiment.
  • FIG. 2 is a block diagram of the structure of a main part of a motion compensator.
  • FIG. 3 is a view for use in illustrating a method of generating an interpolation frame.
  • FIG. 4 is a view for use in illustrating region data.
  • FIG. 5 is a flowchart for use in illustrating the process of selecting video data by a video data selector.
  • FIG. 6 is a block diagram of another example of the motion compensator.
  • FIG. 7 is a block diagram of the structure of a television receiver according to a second embodiment.
  • FIG. 8 is a view for use in illustrating a method of detecting a motion vector by a motion vector detector in FIG. 7 .
  • FIG. 9 is a block diagram of the structure of an example of the television receiver according to the second embodiment and the structure of a television receiver according to a third embodiment.
  • FIG. 10 is a block diagram of the structure of a main part of a motion compensator in a television receiver according to a fourth embodiment.
  • FIG. 11 is a block diagram of the structure of a television receiver according to a fifth embodiment.
  • FIG. 12 is a block diagram of the structure of a television receiver according to a sixth embodiment.
  • FIG. 13 is a block diagram of the structure of a television receiver according to a seventh embodiment.
  • FIG. 14 is a block diagram of an example of a video corrector.
  • FIG. 15 is a view of one example of how two screen images are displayed at the same time on the display panel of a television receiver
  • FIG. 16 is a view of one example of how two screen images are displayed at the same time on the display panel of a television receiver.
  • FIG. 1 is a block diagram of the structure of a television receiver according to a first embodiment of the invention. Note that in the description of the first embodiment, frame rate conversion is carried out while characters (such as a channel number) are presented as an OSD (On Screen Display) on a screen.
  • OSD On Screen Display
  • the television receiver 100 includes a selector 101 , a demodulator 102 , a TS (Transport Stream) decoder 103 , an AV (audio-visual) decoder 104 , an audio output unit 105 , a superimposer 106 , a microcomputer 107 , a motion vector detector 108 , a motion compensator 109 , and a video output unit 110 .
  • a selector 101 the television receiver 100 according to the embodiment includes a selector 101 , a demodulator 102 , a TS (Transport Stream) decoder 103 , an AV (audio-visual) decoder 104 , an audio output unit 105 , a superimposer 106 , a microcomputer 107 , a motion vector detector 108 , a motion compensator 109 , and a video output unit 110 .
  • a plurality of digital broadcasting signals (hereinafter simply as “broadcasting signals”) are input to the selector 101 from an antenna 901 .
  • the selector 101 selects one of the plurality of broadcasting signals and outputs the selected broadcasting signal to the demodulator 102 .
  • the demodulator 102 demodulates the broadcasting signal output from the selector 101 and generates a transport stream according to the MPEG (Motion Picture Experts Group)-2 standard.
  • the demodulator 102 outputs the generated transport stream to the TS decoder 103 .
  • the TS decoder 103 separates an audio stream and a video stream from the transport stream output from the demodulator 102 .
  • the TS decoder 103 outputs the separated audio stream and video stream to the AV decoder 104 .
  • the AV decoder 104 decodes the audio stream and video stream output from the TS decoder 103 and generates audio data and video data.
  • the AV decoder 104 outputs the generated audio data to the audio output unit 105 and the generated video data to the superimposer 106 .
  • the audio output unit 105 includes an audio output device such as a speaker and outputs the audio data output from the AV decoder 104 as an audio sound.
  • a microcomputer 107 generates character data and outputs the generated character data to the superimposer 106 .
  • the microcomputer 107 generates region data and outputs the generated region data to the motion compensator 109 .
  • the region data in the embodiment refers to information that indicates the region in which characters are displayed and indicates whether each pixel represents part of the characters.
  • the superimposer 106 superimposes the character data on the video data output from the AV decoder 104 .
  • the video data having the character data superimposed thereon is output to the motion vector detector 108 and the motion compensator 109 .
  • the superimposer 106 directly outputs the video data output from the AV decoder 104 to the motion vector detector 108 and the motion compensator 109 .
  • the motion vector detector 108 detects a motion vector each for a predetermined block (such as a pixel region of 8 ⁇ 8 pixels) for the video data output from the superimposer 106 and outputs the motion vector data of each pixel to the motion compensator 109 .
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector detector 108 and the region data output from the microcomputer 107 .
  • the motion compensator 109 outputs the video data after the frame rate conversion to the video output unit 110 . Note that in the frame rate conversion, the motion compensator 109 generates data in a frame (interpolation frame) that interpolates between two consecutive frames on the time base.
  • the motion compensator 109 will be detailed later.
  • the video output unit 110 includes a video display device such as a liquid crystal display panel and a plasma display panel and displays the video data output from the motion compensator 109 as a video image. Note that when video data having character data superimposed thereon is displayed as a video image, the characters are presented as an OSD at the video display device.
  • FIG. 2 is a block diagram of the structure of a main part of the motion compensator 109 .
  • the motion compensator 109 includes a video data selector 91 , a video data editor 92 , a vector reference data editor 93 , a delay unit 94 , a region data editor 95 , and a delay unit 96 .
  • the video data editor 92 , the vector reference data editor 93 , and the region data editor 95 are each provided with two frame memories.
  • Video data output from the superimposer 106 is input to one frame memory of the video data editor 92 , one frame memory of the vector reference data editor 93 and the delay unit 94 .
  • Motion vector data output from the motion vector detector 108 is input to the vector reference data editor 93 and the region data editor 95 .
  • the region data output from the microcomputer 107 is input to one frame memory in the region data editor 95 , and the delay unit 96 .
  • the delay unit 94 delays the input video data by one frame and outputs the data to the other frame memory of the video data editor 92 and the other frame memory of the vector reference data editor 93 . More specifically, these frame memories of the video data editor 92 and the vector reference data editor 93 are provided with video data one frame before the video data input to the previously mentioned frame memories of the video data editor 92 and the vector reference data editor 93 .
  • the frame produced by the video data input to one frame memory of each of the video data editor 92 and the vector reference data editor 93 is referred to as “present frame” and the frame produced by the video data input to the other frame memory is referred to as “previous frame.”
  • the delay unit 96 delays input region data by one frame and outputs the data to the other frame memory of the region editor 95 . More specifically, this frame memory of the region data editor 95 is provided with region data one frame before the region data input to the previously mentioned frame memory of the region data editor 95 .
  • region data stored in one frame memory of the region data editor 95 indicates the pixel region in which characters are displayed in the present frame and the region data stored in the other frame memory indicates the pixel region in which the characters are displayed in the previous frame.
  • region data input to one frame memory of the region data editor 95 is referred to as region data in the present frame and the region data input to the other frame memory is referred to as region data in the previous frame.
  • the video data editor 92 directly outputs the video data in the present frame stored in one frame memory to the video data selector 91 as present frame video data PVD.
  • the video data editor 92 generates average video data AVD from the video data in the present frame stored in one frame memory and the video data in the previous frame stored in the other frame memory and outputs the data to the video data selector 91 .
  • the luminance of each pixel is the average luminance of the pixels in the same position in the present frame and the previous frame.
  • the vector reference data editor 93 generates present compensation video data RVD based on the video data in the present frame stored in one frame memory and the motion vector data output from the motion vector detector 108 and outputs the data to the video data selector 91 .
  • the present compensation video data RVD will be detailed later.
  • the vector reference data editor 93 generates previous compensation video data FVD based on the video data in the previous frame stored in the other frame memory and the motion vector data output from motion vector detector 108 and outputs the generated data to the video data selector 91 .
  • the previous compensation video data FVD will be detailed later.
  • the region data editor 95 directly outputs the region data in the present frame stored in one frame memory as the present frame region data PAD to the video data selector 91 .
  • the region data editor 95 generates present compensation region data RAD based on the region data in the present frame stored in one frame memory and the motion vector data output from the motion vector detector 108 and outputs the generated data to the video data selector 91 .
  • the present compensation region data RAD will be detailed later.
  • the region data editor 95 generates previous compensation region data FAD based on region data in the previous frame stored in the other frame memory and the motion vector data output from the motion vector detector 108 and outputs the generated data to the video data selector 91 .
  • the previous compensation region data FAD will be detailed later.
  • the video data selector 91 selects one of the four pieces of video data PVD, AVD, RVD, and FVD based on the three kinds of region data PAD, RAD, and FAD output from the region data editor 95 and outputs the selected data to the video output unit 110 . Note that video data is selected for each pixel in the video data selector 91 . A method of selecting video data by the video data selector 91 will be detailed later.
  • FIG. 3 is a view for use in illustrating the method of generating an interpolation frame.
  • (a) shows one region of the previous frame (a pixel region of 8 ⁇ 8 pixels) generated based on video data output from the superimposer 106
  • (b) shows one region of the present frame
  • (c) shows an interpolation frame generated by the motion compensator 109 .
  • FIG. 3( a 1 ) shows a frame generated by moving the video data of each pixel in the previous frame ( FIG. 3( a )) based on motion vector data (hereinafter referred to as “previous compensation frame”).
  • FIG. 3( b 1 ) shows a frame generated by moving the video data of each pixel in the present frame ( FIG. 3( b )) based on motion vector data (hereinafter referred to as “present compensation frame”).
  • the previous compensation frame ( FIG. 3( a 1 )) is a frame generated by the previous compensation video data FVD described in connection with FIG. 2 and the present compensation frame ( FIG. 3( b 1 )) is a frame generated by the present compensation video data RVD also described in connection with FIG. 2 .
  • FIG. 3( b ) is the present frame and therefore corresponds to a frame generated by the present frame video data PVD.
  • the luminance of each pixel is the average luminance of corresponding pixels in the previous frame ( FIG. 3( a )) and the present frame ( FIG. 3( b )).
  • the motion vector detector 108 detects a motion vector on the basis of 4 ⁇ 4 pixels as one block for the ease of description.
  • the position of each pixel is represented by the X and Y coordinates.
  • a moving object A is indicated by eight pixels in the upper left block and a character C 1 is represented by two pixels and a character C 2 is represented by five pixels in the lower right block.
  • the character C 1 is represented by two pixels in the upper left block
  • the moving object A is represented by seven pixels in the lower right block and the character C 2 is represented by five pixels.
  • the moving object A consisting of eight pixels moves from the upper left block to the lower right block between the previous frame and the present frame.
  • the character C 2 Assume that video data of pixels other than the region in which the moving object A is displayed is unchanged.
  • the motion vector detector 108 detects a motion vector (+4 in the X-direction and +4 in the Y-direction) representing the movement of video data of each pixel in the upper left block to the lower right block between the previous frame ( FIG. 3( a )) and the present frame ( FIG. 3( b )).
  • a frame that interpolates between the previous frame ( FIG. 3( a )) and the present frame ( FIG. 3( b )) is generated by moving the video data of each pixel in the upper left block in the previous frame by +2 in the X-direction and +2 in the Y-direction or the video data of each pixel in the lower right block in the present frame by ⁇ 2 in the X-direction and ⁇ 2 in the Y-direction.
  • the character C 1 is present in the upper left block and the character C 2 is present in the lower right block. Therefore, when the video data of each pixel in the upper left block in the previous frame is moved by +2 in the X-direction and +2 in the Y-direction, the character C 1 that should not be moved moves together with the moving member A in the previous compensation frame ( FIG. 3( a 1 )).
  • the video data selector 91 selects one of the four pieces of video data PVD, AVD, RVD, and FVD for each pixel depending on the display position of the characters and outputs the selected data to the video output unit 110 ( FIG. 2 ). In this way, the picture quality in the interpolation frame can be prevented from being degraded.
  • FIG. 4 is a view for use in illustrating the region data PAD, RAD, and FAD.
  • FIG. 4 (a) conceptually illustrates the state of each pixel represented by region data in the previous frame and (b) conceptually illustrates the state of each pixel represented by region data in the present frame. More specifically, FIG. 4( a ) conceptually illustrates the state of each pixel represented by region data input to the region data editor 95 ( FIG. 2) from the delay unit 96 ( FIG. 2 ), and FIG. 4( b ) conceptually illustrates the state of each pixel represented by region data input to the region data editor 95 from the microcomputer 107 ( FIG. 2) and the present frame region data PAD ( FIG. 2 ).
  • FIG. 4( a 1 ) conceptually illustrates the state of each pixel represented by region data when the region data of each pixel in the upper left block is moved by +2 in the X-direction and +2 in the Y-direction from the position shown in FIG. 4( a ) similarly to FIG. 3( a 1 ).
  • FIG. 4( b 1 ) conceptually illustrates the state of each pixel represented by region data when the region data of each pixel in the lower right block is moved by ⁇ 2 in the X-direction and ⁇ 2 in the Y-direction from the position shown in FIG. 4( b ) similarly to FIG. 3( b 1 ).
  • FIG. 4( a 1 ) conceptually illustrates the state of each pixel represented by the previous compensation region data FAD ( FIG. 2) generated based on the region data in the previous frame and the motion vector data
  • FIG. 4( b 1 ) conceptually illustrates the state of each pixel represented by the present compensation region data RAD ( FIG. 2) generated based on the region data in the present frame and the motion vector data.
  • the present frame region data PAD ( FIG. 2 ) specifies the character display pixels in the present frame
  • the previous compensation region data FAD ( FIG. 2 ) specifies the character display pixels in the previous compensation frame
  • the present compensation region data RAD ( FIG. 2 ) specifies the character display pixels in the present compensation frame.
  • FIG. 5 is a flowchart for use in illustrating the process of selecting video data by the video data selector 91 . Note that the selecting processing in the flowchart in FIG. 5 is carried out for each pixel.
  • the video data selector 91 determines whether the present frame region data PAD is data that indicates character display (hereinafter referred to as “character display data”) (step S 1 ).
  • the video data selector 91 selects the present frame video data PVD ( FIG. 2 ) and outputs the selected data to the video output unit 110 ( FIG. 2 ).
  • the present frame region data PAD (see FIG. 4( b )) is character display data.
  • step S 1 If it is determined in step S 1 that the present frame region data PAD is not character display data, the video data selector 91 determines whether the present compensation region data RAD is character display data (step S 2 ).
  • the video data selector 91 determines whether the previous compensation region data FAD is character display data (step S 3 ).
  • the video data selector 91 selects average video data AVD ( FIG. 2 ) and outputs the data to the video output unit 110 ( FIG. 2 ).
  • the present frame region data PAD (see FIG. 4( b )) is not character display data.
  • step S 3 If it is determined in step S 3 that the previous compensation region data FAD is not character display data, the video data selector 91 selects the previous compensation video data FVD ( FIG. 2 ) and outputs the selected data to the video output unit 110 ( FIG. 2 ).
  • the present frame region data PAD (see FIG. 4( b )) is not character display data.
  • step S 2 If it is determined in step S 2 that the present compensation region data RAD is not character display data, the video data selector 91 determines whether the previous compensation region data FAD is character display data (step S 4 ).
  • the video data selector 91 selects the present compensation region data RAD ( FIG. 2 ) and outputs the selected data to the video output unit 110 ( FIG. 2 ).
  • the present frame region data PAD (see FIG. 4( b )) is not character display data.
  • step S 4 If it is determined in step S 4 that the previous compensation region data FAD is not character display data, the video data selector 91 selects the previous compensation video data FVD ( FIG. 2 ) and outputs the selected data to the video output unit 110 ( FIG. 2 ).
  • the present frame region data PAD (see FIG. 4( b )) is not character display data.
  • step S 4 if it is determined in step S 4 that the previous compensation region data FAD is not character display data, the video data selector 91 selects the previous compensation video data FVD ( FIG. 2 ) but the present compensation video data RVD may be selected instead.
  • an interpolation frame may be generated by the video data in the previous frame and the motion vector similarly to normal motion compensation, or the interpolation frame may be generated based on the video data in the present frame and the motion vector.
  • character data is superimposed on video data in the superimposer 106 before the frame rate conversion by the motion compensator 109 . More specifically, before the number of frames (frame frequency) increases, the character data is superimposed on the video data. In this way, the character data can be superimposed on the video data using a microcomputer 107 that operates at lower data processing speed than the case in which the video data after the frame rate conversion has character data superimposed thereon. Therefore, a high performance microcomputer 107 is not necessary, and therefore the product cost for the television receiver 100 can be reduced.
  • the character in the region in which a character is displayed in the present frame, the character is displayed in the interpolation frame, and a character is not displayed in the interpolation frame in the region in which a character is not displayed in the present frame.
  • the luminance of the region is set to the average luminance of the present frame and the previous frame. Furthermore, in a region in which a character is displayed only in the present compensation frame, video data in the previous compensation frame is used, and in a region in which a character is displayed only in the previous compensation frame, video data in the present compensation frame is used.
  • a character that should not be moved in the interpolation frame can be prevented from moving and the other video images can be prevented from being displayed in a region for displaying a character. More specifically, in the interpolation frame, a character can be displayed in an appropriate position.
  • the video data editor 92 and the vector reference data editor 93 are each provided with two frame memories, while two frame memories common to the video data editor 92 and the vector reference data editor 93 may be provided in the motion compensator 109 .
  • FIG. 6 is a block diagram of another example of the motion compensator 109 .
  • the motion compensator 109 shown in FIG. 6 is provided with two frame memories 97 and 98 , instead of the two frame memories provided in each of the video data editor 92 and the vector reference data editor 93 .
  • video data output from the superimposer 106 is input to the frame memory 97 and the delay unit 94 .
  • the delay unit 94 delays the input video data by one frame and outputs the data to the frame memory 98 . More specifically, the video data in the present frame is stored in the frame memory 97 and video data in the previous frame is stored in the frame memory 98 .
  • the video data editor 92 directly outputs the video data in the present frame stored in the frame memory 97 as present frame video data PVD to the video data selector 91 , generates average video data AVD from the video data in the present frame stored in the frame memory 97 and the video data in the previous frame stored in the frame memory 98 and outputs the generated data to the video data selector 91 .
  • the vector reference data editor 93 generates present compensation video data RVD and previous compensation video data FVD based on the video data in the present frame stored in the frame memory 97 and motion vector data output from the motion vector detector 108 and outputs the generated data to the video data selector 91 .
  • the two memories 97 and 98 are provided in common to the video data editor 92 and the vector reference data editor 93 , so that the video data editor 92 and the vector reference data editor 93 each do not have to include frame memories. Therefore, the product cost for the television receiver 100 can be reduced.
  • a line memory may be used instead of the frame memories provided for each of the video data editor 92 , the vector reference data editor 93 , and the region data editor 95 shown in FIG. 2 and the frame memories 97 and 98 in FIG. 6 . In this way, the product cost for the television receiver 100 can further be reduced.
  • a character is not displayed in the interpolation frame in the region in which no character is displayed in the present frame, but a character may be displayed in a region in which no character is displayed in the present frame but a character is displayed in the previous frame.
  • present frame video data PVD ( FIG. 2 ) is used as the video data of a pixel in the interpolation frame corresponding to the pixel, while the present frame video data PVD may be used as the video data of any other pixel in the interpolation frame. More specifically, if a character is displayed in the present frame, the present frame video data PVD may be used as the video data for all the pixels in the interpolation frame.
  • the motion compensator 109 directly outputs the video data in the present frame output from the superimposer 106 as video data in the interpolation frame to the video output unit 110 if the character data is output from the microcomputer 107 .
  • average video data AVD ( FIG. 2 ) or the video data in the previous frame may be used as the video data for all the pixels in the interpolation frame.
  • the motion compensator 109 directly outputs the average video data AVD or the video data in the previous frame as the video data in the interpolation frame to the video output unit 110 when character data is output from the microcomputer 107 .
  • Part of the character may be displayed in a transmitted state.
  • region data indicating a region in which a character in a non-transmitted state is displayed and region data indicating a region in which a character in a transmitted state is displayed are generated in the microcomputer 107 .
  • region data indicates character display in a transmitted state
  • data produced by adding the value of the character data and the value of the video data in a predetermined ratio is generated at the superimposer 106 or the motion compensator 109 .
  • a television receiver according to a second embodiment is different from the television receiver 100 according to the first embodiment in the following point.
  • FIG. 7 is a block diagram of the structure of the television receiver 100 according to the second embodiment.
  • the AV decoder 104 outputs audio data to the audio output unit 105 and video data to the superimposer 106 and the motion vector detector 108 .
  • the microcomputer 107 generates character data and outputs the generated character data to the superimposer 106 .
  • the superimposer 106 superimposes the character data on the video data output from the AV decoder 104 and outputs the video data having the character data superimposed thereon to the motion compensator 109 .
  • the superimposer 106 directly outputs the video data output from the AV decoder 104 to the motion compensator 109 .
  • the motion vector detector 108 detects a motion vector each for a prescribed block (such as a pixel region of 8 ⁇ 8 pixels) based on the video data output from the AV decoder 104 and outputs the motion vector data of each pixel to the motion compensator 109 .
  • a prescribed block such as a pixel region of 8 ⁇ 8 pixels
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector data detector 108 .
  • the video data output from the AV decoder 104 is input to the superimposer 106 and the motion vector detector 108 . Therefore, the motion vector detector 108 can detect a motion vector based on video data on which no character data is superimposed.
  • FIG. 8 is a view for use in illustrating a method of detecting a motion vector by the motion vector detector 108 in FIG. 7 .
  • FIG. 8 shows a region (a pixel region of 8 ⁇ 8 pixels) of the previous frame generated based on superimposed video data, (b) shows a region of the present frame generated based on the superimposed video data, (c) shows a region of a frame generated based on simple video data in the frame shown in (a), i.e., on simple video data in the previous frame, and (d) shows a region of a frame generated based on simple video data in the frame shown in (b), i.e., on simple video data in the present frame.
  • the motion vector detector 108 detects a motion vector each for 4 ⁇ 4 pixels as one block for the ease of description.
  • FIG. 8( a ) is equal to FIG. 3( a ) and FIG. 8( b ) is equal to FIG. 3( b ).
  • the simple video data is input to the motion vector detector 108 ( FIG. 7 ). Therefore, when frames as shown in FIG. 8( a ) and 8 ( b ) are displayed on the screen of the television receiver 100 , the motion vector detector 108 detects a motion vector based on the simple video data (data in the frames in FIG. 8( c ) and ( d )).
  • the motion vector detector 108 ( FIG. 7 ) can detect a motion vector (+4 in the X-direction and +4 in the Y-direction) that indicates the movement of the video data of each pixel in the upper left block to the lower right block based on the movement of the moving object A shown in FIGS. 8( c ) and ( d ).
  • character data is superimposed on video data in the superimposer 106 before the frame rate conversion by the motion compensator 109 . More specifically, before the number of frames increases, the character data is superimposed on the video data. In this way, the character data can be superimposed on the video data using a microcomputer 107 whose data processing speed is lower than the case in which the character data is superimposed on the video data after the frame rate conversion. Therefore, a high performance microcomputer 107 is not necessary, so that the product cost for the television receiver 100 can be reduced.
  • FIG. 9 is a block diagram of the structure of a television receiver according to another example of the second embodiment.
  • the microcomputer 107 In the television receiver 100 in FIG. 9 , the microcomputer 107 generates region data and outputs the generated region data to the motion compensator 109 similarly to the television receiver 100 in FIG. 1 .
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector detector 108 and the region data output from the microcomputer 107 .
  • the motion compensator 109 can generate data in the interpolation frame for the region in which a character is displayed in the present frame or the previous frame based on the region data without using motion vector data. In this way, the video image around the character display region can be prevented from being blurry. Consequently, more precise motion compensation can be achieved.
  • a television receiver according to a third embodiment is different from the television receiver 100 ( FIGS. 1 and 7 ) according to the first embodiment in the following point.
  • the structure of the television receiver according to the third embodiment is the same as that of the television receiver 100 shown in FIG. 9 .
  • the AV decoder 104 outputs audio data to the audio output unit 105 and outputs video data to the superimposer 106 and the motion vector detector 108 .
  • the superimposer 106 superimposes the character data on the video data output from the AV decoder 104 .
  • the video data having the character data superimposed thereon is then output to the motion compensator 109 .
  • the superimposer 106 When the microcomputer 107 does not output character data, the superimposer 106 directly outputs the video data output from the AV decoder 104 to the motion compensator 109 .
  • the motion vector detector 108 detects a motion vector for each of a prescribed block (such as a pixel region of 8 ⁇ 8 pixels) based on the video data output from the AV decoder 104 and outputs the motion vector data of each pixel to the motion compensator 109 .
  • a method of detecting a motion vector by the motion vector detector 108 is the same as the method described in connection with the second embodiment (see FIG. 8 ).
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector detector 108 and the region data output from the microcomputer 107 . Note that in the frame rate conversion, the motion compensator 109 carries out the same processing as that described in conjunction with FIGS. 2 to 5 .
  • the television receiver 100 has a combined structure of the television receivers 100 according to the first and second embodiments.
  • character data is superimposed on video data in the superimposer 106 .
  • the character data is superimposed on the video data.
  • the character data can be superimposed on the video data using a microcomputer 107 whose data processing speed is lower than that in the case in which the character data is superimposed on the video data after the frame rate conversion. Therefore, a high performance microcomputer 107 is not necessary, so that the product cost for the television receiver 100 can be reduced.
  • the character In a region in which a character is displayed in the present frame, the character is displayed in the interpolation frame, and in a region in which no character is displayed in the present frame, no character is displayed in the interpolation frame.
  • the luminance of the region In a region in which a character is displayed both in the present compensation frame and in the previous compensation frame, the luminance of the region is set to the average luminance of the present frame and the previous frame. Furthermore, in a region in which a character is displayed only in the present compensation frame, video data in the previous compensation frame is used, and in a region in which a character is displayed only in the previous compensation frame, video data in the present compensation frame is used.
  • a character that should not be moved in the interpolation frame can be prevented from moving and any other video image can be prevented from being displayed in a region in which a character should be displayed. More specifically, a character can be displayed in an appropriate position in the interpolation frame.
  • the motion vector detector 108 detects a motion vector based on video data on which character data is not superimposed. More specifically, a motion vector can be detected with no consideration given to a character. In this way, for a video part present in a region originally occluded by a character, precise matching can be carried out between the previous frame and the present frame. Consequently, a motion vector can be detected highly precisely between the previous frame and the present frame.
  • a television receiver according to a fourth embodiment is different from the television receiver 100 according to the first embodiment in the following point.
  • FIG. 10 is a block diagram of a main part of the motion compensator 109 in the television receiver according to the fourth embodiment.
  • the motion compensator 109 includes a video data selector 91 , a video data editor 92 , a vector reference data editor 93 , a delay unit 94 , and a region data superimposer 99 .
  • video data output from the superimposer 106 and region data output from the microcomputer 107 are input to the region data superimposer 99 .
  • Motion vector data output from the motion vector detector 108 is input to the vector reference data editor 93 .
  • the region data superimposer 99 superimposes the region data output from the microcomputer 107 on the video data output from the superimposer 106 .
  • the region data superimposer 99 outputs the video data having the region data superimposed thereon to one frame memory of the video data editor 92 , one frame memory of the vector reference data editor 93 , and the delay unit 94 .
  • the delay unit 94 delays the input video data by one frame and outputs the delayed data to the other frame memory of the video data editor 92 and the other frame memory of the vector reference data editor 93 .
  • the video data has the region data superimposed thereon in the region data superimposer 99 as described above. Therefore, the present frame video data PVD (see FIG. 2 ) as well as the present frame region data PAD (see FIG. 2 ) is output from the video data editor 92 .
  • the vector reference data editor 93 In the vector reference data editor 93 , motion compensation is carried out to the video data having the region data superimposed thereon. Therefore, the vector reference data editor 93 outputs the present compensation video data RVD (see FIG. 2 ) as well as the present compensation region data RAD (see FIG. 2 ) and the previous compensation video data FVD (see FIG. 2 ) as well as the previous compensation region data FAD (see FIG. 2 ).
  • the video data selector 91 selects one of the four video data pieces PVD, AVD, RVD, and FVD according to the same method as the method described in connection with FIG. 5 based on the three region data pieces PAD, RAD, and FAD and outputs the selected video data to the video output unit 110 (see FIG. 2 ).
  • region data is superimposed on video data in the region data superimposer 99 .
  • the present compensation region data RAD and the previous compensation region data FAD can be generated in the vector reference data editor 93 . Therefore, the region data editor 95 and the delay unit 96 are not necessary. In this way, the structure of the television receiver can be simplified and the product cost can be reduced.
  • a television receiver according to a fifth embodiment is different from the television receiver 100 ( FIG. 9 ) according to the third embodiment in the following point.
  • frame rate conversion is carried out while two screen images are displayed on the display panel (for example as shown in FIGS. 15 and 16 , a main screen image 1002 and a sub screen image 1003 are displayed).
  • the television receiver 100 according to the embodiment will be described with reference to FIGS. 15 and 16 .
  • FIG. 11 is a block diagram of the structure of the television receiver 100 according to the fifth embodiment.
  • the television receiver 100 includes a selector 101 a , a demodulator 102 a , a TS decoder 103 a , and an AV decoder 104 a that have the same structures as those of the selector 101 , the demodulator 102 , the TS decoder 103 , and the AV decoder 104 shown in FIG. 9 .
  • a broadcasting signal input from an antenna 901 to the selector 101 a is input to the AV decoder 104 a as an audio stream and a video stream through the demodulator 102 a and the TS decoder 103 a.
  • the AV decoder 104 a decodes the input audio stream and video stream and generates audio data and video data.
  • the AV decoder 104 a outputs the generated audio data to the audio output unit 105 and the video data to the superimposer 106 .
  • the audio output unit 105 selects one of the audio data output from the AV decoder 104 and the audio data output from AV decoder 104 a and outputs the selected data as audio sound.
  • the superimposer 106 superimposes the video data output from AV decoder 104 a on the video data output from the AV decoder 104 and outputs the superimposed video data to the motion compensator 109 .
  • a video image based on the video data output from the AV decoder 104 is displayed on the entire surface of the display panel 1001 as a main screen image 1002 , and a video image based on the video data output from the AV decoder 104 a is displayed in one region of the main screen image 1002 as the sub screen image 1003 as shown in FIGS. 15 and 16 .
  • the microcomputer 107 generates region data and outputs the generated region data to the motion compensator 109 .
  • the region data generated in the microcomputer 107 is information representing a region in which the sub screen image 1003 is displayed and indicates for each pixel whether the pixel is part of the region in which the sub screen image 1003 is displayed.
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector detector 108 and the region data output from the microcomputer 107 . Note that in the frame rate conversion, the motion compensator 109 carries out the same processing as that described in conjunction with FIGS. 2 to 5 .
  • the motion vector detector 108 detects a motion vector based on video data output from the AV decoder 104 . Then, in the main screen image 1002 , precise matching can be carried out between the previous frame and the present frame for a video part present in a region occluded by the sub screen image 1003 . Consequently, the motion vector can be detected highly precisely between the previous frame and the present frame in the main screen image 1002 .
  • the sub screen image 1003 is displayed also in the interpolation frame.
  • the luminance of pixels when the subscreen image 1003 is displayed both in the present compensation frame and the previous compensation frame of the main screen image 1002 is set to the average luminance of the present frame and the previous frame of the main screen image 1002 .
  • video data in the previous compensation frame is used and for the pixels for the sub screen image 1003 displayed only in the previous compensation frame, video data in the present compensation frame is used.
  • the sub screen image 1003 that should not move on the main screen image 1002 can be prevented from moving, and the video image of the main screen image 1002 can be prevented from being displayed in the region in which the sub screen image 1003 should be displayed. Therefore, the sub screen image 1003 can be displayed in an appropriate position in the interpolation frame.
  • the motion vector detector 108 detects the motion vector for the video data output from the AV decoder 104 , while an additional motion vector detector may be provided, and a motion vector may be detected for video data output from the AV decoder 104 a .
  • motion compensation can be carried out for a video image displayed as the sub screen image 1003 , and therefore video images with even higher picture quality can be provided.
  • a television receiver according to a sixth embodiment is different from the television receiver 100 ( FIG. 11 ) according to the fifth embodiment in the following point.
  • FIG. 12 is a block diagram of the structure of the television receiver 100 according to the sixth embodiment.
  • the motion vector detector 108 detects a motion vector based on video data output from the superimposer 106 .
  • the motion compensator 109 carries out frame rate conversion to the video data output from the superimposer 106 based on the motion vector data output from the motion vector detector 108 and the region data output from the microcomputer 107 . Note that in the frame rate conversion, the motion compensator 109 carries out the same processing as that described in conjunction with FIGS. 2 to 5 .
  • the sub screen image 1003 in a region in which the sub screen image 1003 (see FIG. 15 ) is displayed in the present frame, the sub screen image 1003 is displayed in the interpolation frame, and in a region in which the sub screen image 1003 is not displayed in the present frame, the sub screen image 1003 is not displayed in the interpolation frame.
  • the luminance of the region is set to the average luminance of the present frame and the previous frame.
  • the sub screen image 1003 that should not move in the interpolation frame can be prevented from moving, and any other video image can be prevented from being displayed in a region in which the sub screen image 1003 should be displayed. More specifically, in the interpolation frame, the sub screen image 1003 can be displayed in an appropriate position.
  • the region data may represent a region including the contour line of the sub screen image 1003 (such as the outer frame part of the sub screen image 1003 ).
  • the region data may represent a region including the contour line of the sub screen image 1003 (such as the outer frame part of the sub screen image 1003 ).
  • normal motion compensation is carried out similarly to the case of the video image in the main screen image 1002 . Therefore, the boundary part between the main screen image 1002 and the sub screen image 1003 that should not move can be prevented from moving, while highly precise motion compensation can be achieved.
  • a television receiver according to a seventh embodiment is different from the television receiver 100 ( FIG. 9 ) according to the third embodiment in the following point.
  • FIG. 13 is a block diagram of the structure of the television receiver 100 according to the seventh embodiment.
  • the television receiver 100 further includes a video corrector 111 .
  • the microcomputer 107 outputs region data to the motion compensator 109 and the video corrector 111 .
  • the motion compensator 109 outputs video data after frame rate conversion to the video corrector 111 .
  • the video corrector 111 carries out video correction to the video data output from the motion compensator 109 and outputs the video data after the video correction to the video output unit 110 .
  • the video corrector 111 carries out video correction to video images in the region other than the character display region specified by the region data in video images in each of the frames. Therefore, when for example a character is displayed in the present frame, video correction is carried out only to the video images other than the character in the present frame and the interpolation frame.
  • the video corrector 111 includes a region data editor 95 and a delay unit 96 shown in FIG. 2 and can generate present frame region data PAD ( FIG. 2 ), present compensation region data RAD ( FIG. 2 ) and previous compensation region data FAD ( FIG. 2 ).
  • the video corrector 111 can specify a character display region in each frame based on these pieces of region data.
  • correction processing is carried out only to the video data excluding the character data in the video data output from the motion compensator 109 in this embodiment.
  • the video elements such as luminance and color
  • the video images can be prevented from being degraded in the picture quality.
  • the video elements of the video images other than the character can be prevented from being reflected upon the character in the frame after the video correction. In this way, the picture quality of the character can be prevented from being degraded.
  • FIG. 14 is a block diagram of an example of the video corrector 111 .
  • the video corrector 111 includes a first corrector unit 11 , a second corrector unit 12 , and a feature quantity extractor 13 .
  • Video data output from the motion compensator 109 is input to the first corrector unit 11 and the feature quantity extractor 13 .
  • Region data output from the microcomputer 107 is input to the first corrector unit 11 , the second corrector unit 12 , and the feature quantity extractor 13 .
  • the video corrector 111 shown in FIG. 14 includes a region data editor 95 ( FIG. 2 ) and a delay unit 96 ( FIG. 2 ) though not shown.
  • One of present frame region data PAD ( FIG. 2 ), present compensation region data RAD ( FIG. 2 ) and previous compensation region data FAD ( FIG. 2 ) is input to the first corrector unit 11 , the second corrector unit 12 , and the feature quantity extractor 13 as the region data.
  • the feature quantity extractor 13 extracts the feature quantity of the video image in each frame (such as luminance and color distribution) generated by the video data output from the motion compensator 109 . More specifically, in the video images in each frame, the feature quantity extractor 13 extract the feature quantity of video images in the region other than the character display region specified by the region data. Therefore, if a character is displayed in the present frame, the feature quantity extraction is carried out only to video images other than the character in the present frame and the interpolation frame. The feature quantity extractor 13 applies the extracted feature quantity of the video images in each frame to the first corrector unit 11 .
  • the first corrector unit 11 carries out contrast correction and brightness correction to the video images in each frame generated by the video data output from the motion compensator 109 based on the feature quantity applied from the feature quantity extractor 13 . More specifically, the first correction unit 11 carries out contrast correction and brightness correction to video images in the region other than the character display region specified by the region data in the video image in each frame. Therefore, if for example a character is displayed in the present frame, only the video images other than the character are subjected to contrast correction and brightness correction in the present frame and the interpolation frame. The first corrector unit 11 outputs the corrected video data to the second corrector unit 12 .
  • the second corrector unit 12 carries out sharpness correction to video images in each frame generated by the video data output from the first corrector unit 11 . More specifically, the second corrector unit 12 carries out sharpness correction to video images in the region other than the character display region specified by the region data in the video image in each frame. Therefore, when for example a character is displayed in the present frame, the sharpness correction is carried out only to video images other than the character in the present frame and the interpolation frame. The second corrector unit 12 outputs the corrected video data to the video output unit 110 .
  • the feature quantity is extracted only for the video images other than characters, so that the feature quantity of the video images that should be corrected (other than the characters) can appropriately be extracted.
  • the contrast and brightness of the video images that should be corrected can appropriately be corrected.
  • first and second corrector units 11 and 12 correction is carried out only to video images other than characters. Therefore, when a frame having a character display region is subjected to video correction, the video elements of the character can be prevented from being reflected on corrected video images other than the character. Consequently, the picture quality of the video images that should be corrected can surely be prevented from being degraded.
  • the first corrector unit 11 carries out the contrast correction and the brightness correction and the second corrector unit 12 carries out the sharpness correction, but the first and second corrector units 11 and 12 may carry out other kinds of video correction such as color correction.
  • the video corrector 111 does not carry out video correction to a character, while the video correction may be carried out to a character by setting the video correction ratio of the character to be lower than the video correction ratio of the video images other than the character. In this case, the ratio of the video elements of the character to be extracted during video correction can be lowered. In this way, the picture quality of the video images that should be corrected can be prevented from being degraded.
  • the above-described video corrector 111 may be applied to the television receivers 100 shown in FIGS. 1 , 7 , 11 and 12 .
  • the character, the sub screen image 1003 ( FIG. 15 ), or the video images in the region excluding the outer frame part of the sub screen image 1003 are subjected to correction, so that the video elements of the character, the sub screen image 1003 or the outer frame part of the sub screen image 1003 can be prevented from being reflected upon a corrected video image in each frame. Consequently, the picture quality of the video images that should be corrected (the video images excluding the character) can be prevented from being lowered.
  • frame rate conversion is carried out based on region data generated by the microcomputer 107 , but the region data does not have to be generated by the microcomputer 107 .
  • the broadcasting signal transmitted from the broadcasting station may include region data.
  • the motion compensator 109 can carry out frame rate conversion based on the region data included in the broadcasting signal. In this way, the microcomputer 107 used to generate the region data is not necessary, so that the product cost for the television receiver 100 can be reduced.
  • the region data may indicate one region (such as the outer frame part of the sub screen image 1003 ) including the contour line of the sub screen image 1003 (see FIG. 15 ).
  • the region excluding the region described above in the sub screen image 1003 is subjected to normal motion compensation similarly to the video images in the main screen image 1002 .
  • the boundary part between the main screen image 1002 and the sub screen image 1003 that should not be moved can be prevented from moving, while highly precise motion compensation can be achieved. Consequently, high picture quality video images can stably be provided.
  • the television receiver 100 receives a digital broadcasting signal, but the television receiver 100 may receive an analog broadcasting signal.
  • the video processor is a television receiver
  • the video processor may be a mobile receiver such as a mobile telephone, an automobile TV, an automobile navigation system, and a PDA (Personal Digital Assistance).
  • a mobile receiver such as a mobile telephone, an automobile TV, an automobile navigation system, and a PDA (Personal Digital Assistance).
  • the video processor may be a personal computer including a DVD (Digital Versatile Disk) reproducing device, a DVD recording/reproducing device, a hard disk recording/reproducing device, a set top box (STB), or a digital tuner.
  • the audio output unit 105 has an audio output terminal and does not have an audio output device
  • the video output unit 110 has a video output terminal and does not have a video display device.
  • the audio output terminal and the video output terminal are connected to the audio input terminal and the video input terminal of the television receiver.
  • the audio output terminal and the video output terminal are connected to the audio input terminal and the video input terminal of the display panel.
  • characters such as a channel number are presented as an OSD and a plurality of screen images are displayed on a display panel, while the same effects can be provided when other kinds of characters such as subtitles are presented or an electric program guide (EPG) is displayed in a region of the screen.
  • the motion compensator 109 may carry out frame rate conversion based on region data indicating the region in which the subtitles are displayed or region data indicating the region in which the electric program guide is displayed.
  • All the elements of the television receivers 100 in the above described embodiments may be implemented by hardware such as electronic circuits or may partly be implemented by hardware such as a CPU (Central Processing Unit) and software such as programs.
  • a CPU Central Processing Unit
  • programs such as programs.
  • the video data output from the AV decoder 104 is an example of the first data
  • the character data or the video data output from the AV decoder 104 a is an example of the second data
  • the superimposer 106 is an example of the superimposed data generator
  • the motion compensator 109 is an example of the interpolation data generator
  • the previous compensation video data FVD is an example of the first prediction frame data
  • the present compensation video data RVD is an example of the second prediction frame data
  • the average video data AVD is an example of the third prediction frame data
  • the previous compensation region data FAD is an example of the first prediction region data
  • the present compensation region data RAD is an example of the second prediction region data
  • the region data editor 95 is an example of the prediction region data.
  • the present invention is effectively applicable to a television receiver, a personal computer, a DVD recorder, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Television Systems (AREA)
US12/440,471 2006-09-15 2007-09-12 Video processor and video processing method Expired - Fee Related US8432495B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2006251627 2006-09-15
JP2006-251627 2006-09-15
PCT/JP2007/067748 WO2008032744A1 (fr) 2006-09-15 2007-09-12 Dispositif de traitement vidéo et procédé de traitement vidéo

Publications (2)

Publication Number Publication Date
US20090303392A1 US20090303392A1 (en) 2009-12-10
US8432495B2 true US8432495B2 (en) 2013-04-30

Family

ID=39183800

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/440,471 Expired - Fee Related US8432495B2 (en) 2006-09-15 2007-09-12 Video processor and video processing method

Country Status (5)

Country Link
US (1) US8432495B2 (ja)
EP (1) EP2063636B1 (ja)
JP (1) JP4878628B2 (ja)
CN (1) CN101513051B (ja)
WO (1) WO2008032744A1 (ja)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5077037B2 (ja) * 2008-04-15 2012-11-21 株式会社Ｊｖｃケンウッド 画像処理装置
JP2011023902A (ja) * 2009-07-14 2011-02-03 Sony Corp 画像処理装置および画像処理方法
JP5574830B2 (ja) * 2010-06-03 2014-08-20 三菱電機株式会社 画像処理装置及び方法、並びに画像表示装置及び方法
JP2013031195A (ja) * 2012-08-29 2013-02-07 Jvc Kenwood Corp 画像処理装置
US20230164329A1 (en) * 2018-03-30 2023-05-25 Nikon Corporation Video compression apparatus, electronic apparatus, and video compression program

Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6225588A (ja) 1985-07-26 1987-02-03 Sony Corp 動きベクトル検出装置
JPS62175080A (ja) 1986-01-28 1987-07-31 Sony Corp 動き補正装置
US4779131A (en) 1985-07-26 1988-10-18 Sony Corporation Apparatus for detecting television image movement
US4992870A (en) 1989-04-27 1991-02-12 Sony Corporation Motion dependent video signal processing
WO1991020155A1 (en) 1990-06-19 1991-12-26 British Broadcasting Corporation Video signal processing
JPH0447785A (ja) 1990-06-14 1992-02-17 Sony Corp テレビジョン受像機
US5162907A (en) 1990-09-28 1992-11-10 Sony Broadcast & Communications Limited Motion dependent video signal processing
US5191416A (en) * 1991-01-04 1993-03-02 The Post Group Inc. Video signal processing system
JPH08149421A (ja) 1994-11-22 1996-06-07 Oki Electric Ind Co Ltd 動きベクトルを用いた動き内挿方法および動き内挿回路
JPH09214899A (ja) 1996-01-31 1997-08-15 Nippon Hoso Kyokai <Nhk> 画像予測処理方法および装置
US5929919A (en) 1994-04-05 1999-07-27 U.S. Philips Corporation Motion-compensated field rate conversion
US6219436B1 (en) 1997-10-29 2001-04-17 U.S. Philips Corporation Motion vector estimation and detection of covered/uncovered image parts
WO2001088852A2 (en) 2000-05-18 2001-11-22 Koninklijke Philips Electronics N.V. Motion estimator for reduced halos in motion compensared picture rate up-conversion
US20020085096A1 (en) 2000-05-18 2002-07-04 Mertens Mark Jozef Willem Foreground/background detector
JP2004120757A (ja) 2002-09-24 2004-04-15 Matsushita Electric Ind Co Ltd 映像信号を処理するための方法および映像処理ユニット
US20040233326A1 (en) 2003-05-19 2004-11-25 Dae-Woon Yoo Apparatus and method for deinterlace video signal
WO2005027525A1 (en) 2003-09-17 2005-03-24 Koninklijke Philips Electronics N.V. Motion vector field re-timing
CN1649397A (zh) 2004-01-30 2005-08-03 株式会社东芝 映像信号处理装置和映像信号处理方法
CN1678024A (zh) 2004-03-30 2005-10-05 松下电器产业株式会社 改进的图像边界处的运动向量估计
JP2005287049A (ja) 2004-03-30 2005-10-13 Matsushita Electric Ind Co Ltd ベクトルに基づく、画像境界における動き補償方法およびその装置
US6975324B1 (en) 1999-11-09 2005-12-13 Broadcom Corporation Video and graphics system with a video transport processor
WO2006013510A1 (en) 2004-07-29 2006-02-09 Koninklijke Philips Electronics N.V. De-interlacing
CN1783995A (zh) 2004-12-02 2006-06-07 株式会社日立制作所 帧速率变换装置和图像显示装置以及帧速率变换方法
US20060215037A1 (en) * 2005-03-25 2006-09-28 Sanyo Electric Co., Ltd Frame rate converting apparatus, pan/tilt determining apparatus, and video apparatus
WO2007040045A1 (ja) 2005-09-30 2007-04-12 Sharp Kabushiki Kaisha 画像表示装置及び方法
WO2007052452A1 (ja) 2005-11-07 2007-05-10 Sharp Kabushiki Kaisha 画像表示装置及び方法
WO2007063465A2 (en) 2005-11-30 2007-06-07 Nxp B.V. Motion vector field correction

Patent Citations (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4779131A (en) 1985-07-26 1988-10-18 Sony Corporation Apparatus for detecting television image movement
JPS6225588A (ja) 1985-07-26 1987-02-03 Sony Corp 動きベクトル検出装置
JPS62175080A (ja) 1986-01-28 1987-07-31 Sony Corp 動き補正装置
US4992870A (en) 1989-04-27 1991-02-12 Sony Corporation Motion dependent video signal processing
JPH0362689A (ja) 1989-04-27 1991-03-18 Sony Corp 動き補正付きテレビジョン方式変換器
JPH0447785A (ja) 1990-06-14 1992-02-17 Sony Corp テレビジョン受像機
JP3245417B2 (ja) 1990-06-19 2002-01-15 ブリティッシュ・ブロードキャスティング・コーポレーション ビデオ信号の画素に対する運動ベクトルの割当て方法および装置
WO1991020155A1 (en) 1990-06-19 1991-12-26 British Broadcasting Corporation Video signal processing
US5162907A (en) 1990-09-28 1992-11-10 Sony Broadcast & Communications Limited Motion dependent video signal processing
JP3287864B2 (ja) 1990-09-28 2002-06-04 ソニー・ユナイテッド・キングダム・リミテッド 映像信号のフィールド又はフレーム間の動きを表す運動ベクトルを導出する方法及びこれを使用する映像方式変換装置
US5191416A (en) * 1991-01-04 1993-03-02 The Post Group Inc. Video signal processing system
US5929919A (en) 1994-04-05 1999-07-27 U.S. Philips Corporation Motion-compensated field rate conversion
JPH08149421A (ja) 1994-11-22 1996-06-07 Oki Electric Ind Co Ltd 動きベクトルを用いた動き内挿方法および動き内挿回路
JPH09214899A (ja) 1996-01-31 1997-08-15 Nippon Hoso Kyokai <Nhk> 画像予測処理方法および装置
JP2001507552A (ja) 1997-10-29 2001-06-05 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 隠れた／露出した像部分の動きベクトル予測及び検知
US6219436B1 (en) 1997-10-29 2001-04-17 U.S. Philips Corporation Motion vector estimation and detection of covered/uncovered image parts
US6975324B1 (en) 1999-11-09 2005-12-13 Broadcom Corporation Video and graphics system with a video transport processor
WO2001088852A2 (en) 2000-05-18 2001-11-22 Koninklijke Philips Electronics N.V. Motion estimator for reduced halos in motion compensared picture rate up-conversion
US20020085096A1 (en) 2000-05-18 2002-07-04 Mertens Mark Jozef Willem Foreground/background detector
US20030206246A1 (en) 2000-05-18 2003-11-06 Gerard De Haan Motion estimator for reduced halos in MC up-conversion
JP2003533800A (ja) 2000-05-18 2003-11-11 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ Ｍｃアップコンバージョンにおけるハローを低減する動き推定器
CN1496114A (zh) 2002-09-24 2004-05-12 ���µ�����ҵ��ʽ���� 用于处理视频信号的方法和视频处理单元
US20040085480A1 (en) 2002-09-24 2004-05-06 Sven Salzer Method and video processing unit for processing a video signal
JP2004120757A (ja) 2002-09-24 2004-04-15 Matsushita Electric Ind Co Ltd 映像信号を処理するための方法および映像処理ユニット
US20040233326A1 (en) 2003-05-19 2004-11-25 Dae-Woon Yoo Apparatus and method for deinterlace video signal
CN1574951A (zh) 2003-05-19 2005-02-02 宏图像技术株式会社 视频信号的消除交错装置和方法
WO2005027525A1 (en) 2003-09-17 2005-03-24 Koninklijke Philips Electronics N.V. Motion vector field re-timing
US20070092111A1 (en) 2003-09-17 2007-04-26 Wittebrood Rimmert B Motion vector field re-timing
CN1649397A (zh) 2004-01-30 2005-08-03 株式会社东芝 映像信号处理装置和映像信号处理方法
US20050168483A1 (en) 2004-01-30 2005-08-04 Kabushiki Kaisha Toshiba Device and method for processing video signal
JP2005217971A (ja) 2004-01-30 2005-08-11 Toshiba Corp オンスクリーン重畳装置
US20050232357A1 (en) 2004-03-30 2005-10-20 Ralf Hubrich Motion vector estimation at image borders
US20050231644A1 (en) 2004-03-30 2005-10-20 Sven Salzer Vector based motion compensation at image borders
EP1585326A1 (en) 2004-03-30 2005-10-12 Matsushita Electric Industrial Co., Ltd. Motion vector estimation at image borders for frame rate conversion
JP2005287049A (ja) 2004-03-30 2005-10-13 Matsushita Electric Ind Co Ltd ベクトルに基づく、画像境界における動き補償方法およびその装置
CN1678024A (zh) 2004-03-30 2005-10-05 松下电器产业株式会社 改进的图像边界处的运动向量估计
WO2006013510A1 (en) 2004-07-29 2006-02-09 Koninklijke Philips Electronics N.V. De-interlacing
US20080007614A1 (en) 2004-12-02 2008-01-10 Hitachi, Ltd. Frame rate conversion device, image display apparatus, and method of converting frame rate
CN1783995A (zh) 2004-12-02 2006-06-07 株式会社日立制作所 帧速率变换装置和图像显示装置以及帧速率变换方法
US20060215037A1 (en) * 2005-03-25 2006-09-28 Sanyo Electric Co., Ltd Frame rate converting apparatus, pan/tilt determining apparatus, and video apparatus
WO2007040045A1 (ja) 2005-09-30 2007-04-12 Sharp Kabushiki Kaisha 画像表示装置及び方法
EP1931141A1 (en) 2005-09-30 2008-06-11 Sharp Kabushiki Kaisha Image display device and method
WO2007052452A1 (ja) 2005-11-07 2007-05-10 Sharp Kabushiki Kaisha 画像表示装置及び方法
US20090122188A1 (en) 2005-11-07 2009-05-14 Toshiharu Hanaoka Image display device and method
WO2007063465A2 (en) 2005-11-30 2007-06-07 Nxp B.V. Motion vector field correction

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
Choi et al., "New Frame Rate Up-Conversion Using Bi-directional Motion Estimation," IEEE Transactions on Consumer Electronics, vol. 46, No. 3, pp. 603-609 (Aug. 2000).
English language Abstract of JP 4-047785 A.
English language Abstract of JP 62-175080 A.
English language Abstract of JP 9-214899 A.
Office Action issued by the European Patent Office, mailed Oct. 11, 2010.
Wittebrood et al., "Tackling occlusion in scan rate conversion systems", 2003 Digest of Technical Papers International Conference on Consumer Electronics (Cat. No. 03CH37416); [International Conference on Consumer Electronics], IEEE Operations Center, US, vol. Conf. 22, Jun. 1, 2003, pp. 344-345, XP002303921, ISBN: 978-0-7803-7721-9.

Also Published As

Publication number Publication date
CN101513051B (zh) 2012-09-12
WO2008032744A1 (fr) 2008-03-20
JPWO2008032744A1 (ja) 2010-01-28
JP4878628B2 (ja) 2012-02-15
US20090303392A1 (en) 2009-12-10
EP2063636A1 (en) 2009-05-27
EP2063636A4 (en) 2010-05-05
EP2063636B1 (en) 2012-12-12
CN101513051A (zh) 2009-08-19

Similar Documents

Publication Publication Date Title
JP4747917B2 (ja) デジタル放送受信装置
US20100027914A1 (en) Image Processor and Image Processing Method
US7995146B2 (en) Image processing apparatus and image processing method
US20090059074A1 (en) Display apparatus
US8629939B1 (en) Television ticker overlay
US20050179817A1 (en) Video signal display unit
US8432973B2 (en) Interpolation frame generation apparatus, interpolation frame generation method, and broadcast receiving apparatus
US20080240617A1 (en) Interpolation frame generating apparatus, interpolation frame generating method, and broadcast receiving apparatus
US8432495B2 (en) Video processor and video processing method
US8363160B2 (en) Caption detection device, caption detection method, and pull-down signal detection apparatus
US8520008B2 (en) Picture display device
JP4261970B2 (ja) 映像情報処理装置及び映像情報処理方法
US20120008050A1 (en) Video processing apparatus and video processing method
US20110261255A1 (en) Video display control device, video display device, and recording medium having video display program recorded thereon
JP2009175182A (ja) 画像処理装置
JP2007502042A (ja) グラフィクス重畳検出
US7590302B1 (en) Image edge enhancement system and method
WO2010067456A1 (ja) 映像処理装置、映像表示装置、映像処理方法、そのプログラムおよびそのプログラムを記録した記録媒体
US20100103313A1 (en) Signal processor and signal processing method
US11930207B2 (en) Display device, signal processing device, and signal processing method
KR100698211B1 (ko) 영상기기 및 그의 디스플레이 방법
JP2008005444A (ja) テレビジョン受像装置
US20060044471A1 (en) Video signal setting device
JP2011066602A (ja) 放送信号処理装置、放送信号処理方法、放送信号処理プログラム、及び、記憶媒体
KR100781264B1 (ko) 영상표시기기 및 그의 영상 디스플레이 방법

Legal Events

Date Code Title Description
AS Assignment

Owner name: PANASONIC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TERAI, KATSUMI;OHTA, YOSHIHITO;NOZAWA, KAZUSHI;REEL/FRAME:022560/0429;SIGNING DATES FROM 20090204 TO 20090206

Owner name: PANASONIC CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TERAI, KATSUMI;OHTA, YOSHIHITO;NOZAWA, KAZUSHI;SIGNING DATES FROM 20090204 TO 20090206;REEL/FRAME:022560/0429

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20210430