New! View global litigation for patent families

US20020196349A1 - Image processing of video signal for display - Google Patents

Image processing of video signal for display Download PDF

Info

Publication number
US20020196349A1
US20020196349A1 US10234376 US23437602A US2002196349A1 US 20020196349 A1 US20020196349 A1 US 20020196349A1 US 10234376 US10234376 US 10234376 US 23437602 A US23437602 A US 23437602A US 2002196349 A1 US2002196349 A1 US 2002196349A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
signal
video
data
system
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10234376
Inventor
Yoshihiro Honma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0135Conversion of standards involving analogue television standards or digital television standards processed at pixel level involving interpolation processes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control; Control of cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in, e.g. mobile phones, computers or vehicles
    • H04N5/23293Electronic Viewfinder, e.g. displaying the image signal provided by an electronic image sensor and optionally additional information related to control or operation of the camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry
    • H04N5/46Receiver circuitry for receiving on more than one standard at will

Abstract

A video signal processing apparatus which can perform a liquid crystal display without a deterioration of a picture quality even when a CCD sensor of the NTSC system is used at the time of the PAL system is provided. The video signal processing apparatus has a 1H delay circuit and a selecting circuit. Upon PAL system, by switching the selecting circuit once every seven lines and performing a pre-interpolation, the lines are compensated from 485 lines (vertical) of the NTSC system to 575 lines (vertical) of the PAL system. In case of performing the liquid crystal display, the timing of an interpolation (LCOMP) signal is synchronized with the timing of the EN signal upon PAL system so as to coincide the portion of the lines to be compensated from 485 lines (vertical) of the NTSC system to 575 lines (vertical) of the PAL system with the portion to be thinned out at a rate of 1 line per 7 lines in the liquid crystal display. Thus, even if the CCD sensor of the NTSC system is used upon PAL system, the liquid crystal display panel can display an image without a deterioration of a picture quality.

Description

    BACKGROUND OF THE INVENTION
  • [0001]
    1. Field of the Invention
  • [0002]
    The invention relates to video signal-processing apparatus and method for processing a video signal which is displayed in a video output apparatus such as television (TV) monitor, liquid crystal display panel, or the like.
  • [0003]
    2. Related Background Art
  • [0004]
    [0004]FIG. 9 is a block diagram showing a construction of a conventional video signal processing apparatus. In the diagram, reference numeral 101 denotes a CCD sensor for converting a received video image into an electric signal; and 102 indicates a photo taking system signal processing circuit. The photo taking system signal processing circuit 102 forms a luminance signal by performing a color carrier removal, an aperture compensation, a gamma process, and the like to the video signal that is outputted from the CCD sensor 101 and, at the same time, forms color difference signals by performing a color interpolation, a matrix conversion, a gamma process, a gain adjustment, and the like to the video signal, and generates a video signal of YUV or the like.
  • [0005]
    Reference numeral 103 denotes a TV system signal processing circuit for generating a TV signal by performing processes such as chroma encoding process, band compensation, composite signal formation, and the like to the YUV signal that is generated from the photo taking system signal processing circuit 102. Reference numeral 104 denotes an LCD controller for generating a drive pulse necessary for an LCD display and converting the TV signal that is generated from the TV system signal processing circuit 103 into an RGB signal to be displayed on an LCD panel 105. Reference numeral 105 denotes the LCD panel for displaying the RGB signal that is outputted from the LCD controller 104 by an LCD device as a visible image.
  • [0006]
    Reference numeral 106 denotes a TV monitor for displaying a video image in accordance with each TV system such as NTSC system, PAL system, or the like. In the NTSC system and the PAL system, the numbers of pixels of the CCD sensors which are necessary differ. For example, in the NTSC system, the number of pixels is equal to 752 (in the horizontal direction)×485 (in the vertical direction). In the PAL system, the number of pixels is equal to 736 (horizontal)×575 (vertical). The number of pixels of the LCD panel which is used in a photo taking apparatus such as cam coder, digital camera, or the like characterized by portability is, hitherto, so small to be 279 (horizontal)×220 (vertical).
  • [0007]
    Although an LCD panel having the large number of pixels has been developed in recent years, the number of pixels is equal to up to 550 (horizontal)×220 (vertical) and is equal to ½ of that of the CCD sensor of the NTSC system. Hitherto, in case of providing an apparatus which can cope with both of the NTSC system and the PAL system using the CCD sensor (752 (horizontal)×485 (vertical)) for the NTSC system, in case of using the PAL system, 575 lines in the vertical direction are formed by compensating the insufficient lines from 485 lines in the vertical direction.
  • [0008]
    In case of displaying on an LCD panel of the small number of pixels comprising 550 (horizontal)×220 (vertical) pixels or the like, although the lines of the number of almost one field can be displayed in the NTSC system, the image data of {fraction (1/7)} line of the field cannot be displayed in the PAL system. In case of displaying the video signal of the PAL system onto the LCD panel, seven lines are thinned out by one line and the reduced video image is displayed. Such a thinning process of the lines is performed by an LCD controller designed so as to drive the LCD panel.
  • [0009]
    On the other hand, in case of outputting the video signal of the PAL system by using the CCD sensor having the number of lines according to the NTSC system, the insufficient lines are compensated by an interpolation or the like. However, when the LCD controller displays the supplied video signal of the PAL system to the LCD panel as mentioned above, the video signal is thinned out and displayed.
  • [0010]
    In case of displaying the video signal onto the LCD panel by the PAL system, consequently, a phenomenon such that the original video signal is thinned out or the like occurs and a quality of the image displayed on the LCD panel is remarkably deteriorated.
  • [0011]
    Particularly, in case of super-imposing character information or the like for a user interface onto a video image and displaying the super-imposed video image, since the character information is thinned out at the time of the LCD display of the PAL system, fine lateral lines of the characters are deleted and the function to correctly display information is deteriorated. FIGS. 10A to 10D are diagrams showing an example of a display in which a part of the character has been deleted.
  • [0012]
    Although the characters of “ERASE” are displayed in the TV monitor 106 (FIG. 10A), the character of “E” that should inherently be shown in FIG. 10B is thinned out and is not correctly displayed on the LCD panel 105. As mentioned above, the character of “E” is seen like “C” as shown in FIG. 10C or is seen like “F” as shown in FIG. 10D, so that the character information cannot be correctly displayed.
  • [0013]
    The above problem occurs because of the use of the liquid crystal display for converting the output of the CCD sensor having the number of lines for the NTSC system into the TV signal for the PAL system and displaying an image.
  • [0014]
    Hitherto, a digital camera apparatus which can easily switch an external video output according to the NTSC system and an external video output according to the PAL system is not known yet.
  • SUMMARY OF THE INVENTION
  • [0015]
    It is an object of the invention to provide image processing apparatus and method which can solve each of or all of the foregoing problems.
  • [0016]
    Under such an object, another object of the invention is to reduce the deterioration of a quality of an image that is displayed on a display.
  • [0017]
    Still another object of the invention is to reduce the deterioration of a quality of an image that is displayed when the image is displayed by using a general liquid crystal display.
  • [0018]
    Further another object of the invention is to provide video signal processing apparatus and method which can perform a liquid crystal display without a deterioration of a picture quality even by using a CCD sensor of the NTSC system when an output of the PAL system is generated.
  • [0019]
    To accomplish the above objects, according to a first aspect of a preferred embodiment of the invention, there is provided a video signal processing apparatus comprising: storage means for storing video data; read-out means for reading out the stored video data; interpolating means for interpolating the readout video data; display means for displaying the interpolated video data; and interpolation control means for matching the data in the portion that is interpolated by the interpolating means to the data in a portion that is not displayed by the display means when the video data is displayed.
  • [0020]
    Further another object of the invention is not to deteriorate a display quality of data which is super-imposed and displayed together with an image.
  • [0021]
    Under the above object, in the video signal processing apparatus according to the first aspect of the invention, the storage means stores the video data comprising photographed image data and video data for super-impose; the read-out means individually reads out the stored photographed image data and video data for super-impose; the interpolating means interpolates the photographed image data and the video data for superimpose which are individually read out; the display means displays the interpolated photographed image data and video data for super-impose onto a same picture plane; and the interpolation control means matches the photographed image data and video data for super-impose in the portions which are interpolated by the interpolating means to the data in the portion that is not displayed by the display means, respectively.
  • [0022]
    Further another object of the invention is to reduce a deterioration of a picture quality when an output of an image pickup device having the pixels of the number larger than the number of pixels that is required by a standard television system is displayed as an image by using a display having the display pixels of the number smaller than the number of pixels that is required by the standard TV system.
  • [0023]
    Further another object of the invention is to provide a digital camera apparatus which can easily cope with various standard television systems.
  • [0024]
    Further another object of the invention is to reduce a deterioration of a quality of an image that is displayed on a display of a digital camera.
  • [0025]
    The above and other objects and features of the present invention will become apparent from the following detailed description and the appended claims with reference to the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0026]
    [0026]FIG. 1 is a block diagram showing a construction of a video signal processing apparatus in the first embodiment of the invention;
  • [0027]
    [0027]FIG. 2 is a diagram showing an array of video data;
  • [0028]
    [0028]FIG. 3 is a block diagram showing a construction of a circuit to generate an interpolation (LCOMP) signal;
  • [0029]
    [0029]FIGS. 4A, 4B and 4C are timing charts showing a change in each signal;
  • [0030]
    [0030]FIG. 5 is a block diagram showing a construction of a video signal processing apparatus according to the second embodiment;
  • [0031]
    [0031]FIG. 6 is a block diagram showing a construction of a video signal processing apparatus according to the third embodiment;
  • [0032]
    [0032]FIG. 7 is a block diagram showing a construction of a video signal processing apparatus according to the fourth embodiment;
  • [0033]
    [0033]FIG. 8 is a block diagram showing a construction of a video signal processing apparatus according to the sixth embodiment;
  • [0034]
    [0034]FIG. 9 is a block diagram showing a construction of a conventional video signal processing apparatus; and
  • [0035]
    [0035]FIGS. 10A, 10B, 10C and 10D are diagrams showing an example of a display in which a part of a character has been deleted.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • [0036]
    An embodiment of video signal processing apparatus and method of the invention will now be described. The video signal processing apparatus of the embodiment is applied to an image pickup apparatus such as a digital camera or the like.
  • [0037]
    [First Embodiment]
  • [0038]
    [0038]FIG. 1 is a block diagram showing a construction of the video signal processing apparatus in the first embodiment. In the diagram, reference numeral 1 denotes a CCD sensor for converting a received video image into an electric signal. In the embodiment, the CCD sensor has pixels of the number larger than the number of pixels that is required by the NTSC system or the PAL system. Reference numeral 2 denotes an A/D converter for converting an analog video signal that is outputted from the CCD sensor 1 into a digital video signal.
  • [0039]
    Reference numeral 3 denotes a photo taking system signal processing circuit. The photo taking system signal processing circuit 3 forms a luminance signal by performing a color carrier removal, an aperture compensation, a gamma process, and the like from an output signal of the CCD sensor 1 and, at the same time, forms color difference signals by performing a color interpolation, a matrix conversion, a gamma process, a gain adjustment, and the like, and outputs a video signal of YUV or the like. Reference numeral 4 denotes a data writing circuit for writing the video signal after completion of the signal processes into a VRAM 5.
  • [0040]
    The VRAM (volatile memory) 5 is a memory for video in which ports for writing and reading out are provided for, for example, a dynamic RAM (DRAM) and which performs an addressing every horizontal line.
  • [0041]
    Reference numeral 6 denotes a 1H delay circuit. By holding data of one horizontal line (H), the 1H delay circuit 6 is used for pre-interpolation or the like of every horizontal line.
  • [0042]
    Reference numeral 7 denotes a data read-out circuit to read out the video data stored in the VRAM 5.
  • [0043]
    [0043]FIG. 2 is a diagram showing an array of the video data. The data is stored into continuous memory addresses in the VRAM 5 every horizontal line by the data writing circuit 4 in a manner such as YUYV . . . . The data is read out every horizontal line by the data read-out circuit 7 in accordance with an address pointer and a data size in a manner such as H1, H2, . . . .
  • [0044]
    Reference numeral 8 denotes a TV system signal processing circuit for performing signal processes such as chroma encoding process, band compensation, composite signal formation, and the like to the video signal of YUV read out by the data read-out circuit 7 and outputting a digital video signal for TV.
  • [0045]
    Reference numerals 9A and 9B denote D/A converters for converting the digital video signal into the analog video signal; 10A and 10B low pass filters (LPFs) for cutting high frequency noise components upon D/A conversion; and 11 a gain adjustment circuit to adjust the video signal transmitted through the LPF 10B to the signal at the level suitable for liquid crystal display.
  • [0046]
    Reference numeral 12 denotes an LCD controller for generating a drive pulse necessary for the liquid crystal display and converting the TV signal from the gain adjustment circuit 11 into the signal for the liquid crystal display; and 13 indicates an LCD panel for displaying the signal from the LCD controller 12 as a visible video image by a liquid crystal device.
  • [0047]
    When a video signal according to the given PAL system is given to the LCD controller 12 in the embodiment, the LCD controller thins out the interlaced image signals of the odd fields and even fields as will be explained hereinlater and, thereafter, displays an image of the thinned image signals onto the LCD device. Upon such a displaying, the lines of the interlaced image signals are thinned out and an image corresponding to the thinned signals is displayed as it is.
  • [0048]
    Reference numeral 14 denotes a video amplifier for outputting the video signal transmitted through the LPF 10A at a signal level and an output impedance for TV; 15 a TV monitor for displaying a video image in accordance with the TV system such as NTSC system, PAL system, or the like; 16 a timing generation circuit for generating a timing signal necessary for each circuit; and 17 a selecting circuit for switching the output of the VRAM 5 and the output of the 1H delay circuit 6 as necessary and performing a pre-interpolation.
  • [0049]
    The operation of the video signal processing apparatus having the above construction will now be described. The video signal received by the CCD sensor 1 is converted into the digital video signal by the A/D converter 2 and is processed to the video signal of the YUV format by the photo taking system signal processing circuit 3. Y denotes a luminance signal after completion of the processes such as color carrier removal, aperture compensation, gamma conversion, and the like. U and V denote a color difference signal of (B-Y) and a color difference signal of (R-Y), respectively, and these signals are formed by performing the processes such as color interpolation, matrix conversion, gamma conversion, and the like. The video signals of Y, U, and V which are generated from the photo taking system signal processing circuit 3 are sequentially stored into the VRAM 5 by the data writing circuit 4 in a manner such as YUYVYUYV . . . from the upper left position on the screen as shown in, for example, a data array of FIG. 2.
  • [0050]
    The data stored in the VRAM 5 is sequentially read out by the data read-out circuit 7 in accordance with the writing order and is processed to luminance and chroma separation signals, a composite signal, and luminance and color difference signals for liquid crystal by the TV system signal processing circuit 8.
  • [0051]
    The digital video signals outputted from the TV system signal processing circuit 8 are converted into the analog video signals by the D/A converters 9A and 9B, are band-limited by the LPFs 10A and 10B, are level-matched by the gain adjustment circuit 11, and the resultant video signals are outputted to the LCD controller 12. The level matching and the output impedance adjustment are performed by the video amplifier 14 and the resultant signals are outputted to the TV monitor 15.
  • [0052]
    As mentioned above, the numbers of pixels of the CCD sensors which are necessary in the NTSC system and the PAL system differ. For example, in the NTSC system, the number of pixels is equal to 752 (in the horizontal direction)×485 (in the vertical direction). In the PAL system, the number of pixels is equal to 736 (horizontal)×575 (vertical). The number of pixels of the LCD panel even having the large number of pixels is equal to 550 (horizontal)×220 (vertical) and is equal to about ½ of that of the CCD sensor of the NTSC system.
  • [0053]
    Therefore, even in the cam coder or digital camera corresponding to the PAL system, in the operation of an EVF (electronic view finder), rec review, or the like, particularly, when importance is made to only the liquid crystal display, the number of pixels of the NTSC system is sufficient. Therefore, it is examined to develop a system corresponding to both of an external output of the NTSC system and an external output of the PAL system by using the CCD sensor or video buffer (VRAM) of the NTSC system at low costs. An apparatus which can cope with the external output of the NTSC system and the external output of the PAL system by using an image pickup device having the pixels of the number larger than that of the NTSC system or the PAL system is demanded.
  • [0054]
    In this case, upon PAL system, the lines have to be compensated at a rate of one line per seven lines. That is, it is necessary to compensate the lines from 485 lines (vertical) of the NTSC system to 575 lines (vertical) of the PAL system by switching the selecting circuit 17 once seven lines and performing the pre-interpolation.
  • [0055]
    In case of the liquid crystal display, on the other hand, in the embodiment, the signal after compensating the lines to 575 lines (vertical) of the PAL system is supplied to the LCD controller 12. In such a case, the pixels which can be displayed are the pixels of 550 (horizontal)×220 (vertical) and the number of horizontal lines, in other words, the number of pixels in the vertical direction is almost equal to the number of lines of one field of the NTSC system. Therefore, when the signal of the PAL system is supplied to the LCD controller 12, the lines are originally thinned out at a rate of one line per seven lines and the thinned signal is supplied to the LCD panel 13.
  • [0056]
    In the embodiment, a portion of the lines to be compensated from 485 lines (vertical) of the NTSC system to 575 lines (vertical) of the PAL system and a portion where the lines are thinned out at a rate of 1 line per 7 lines in the liquid crystal display are matched. Consequently, even if the CCD sensor of the NTSC system is used at the time of the PAL system, in the liquid crystal display, the image can be displayed without a deterioration in picture quality and without largely losing an information amount of the output of the CCD sensor of the NTSC system. The line thinning-out process in the line interpolation and the liquid crystal display and its timing will now be described hereinbelow.
  • [0057]
    [0057]FIG. 3 is a block diagram showing a construction of a circuit to generate the interpolation (LCOMP) signal. In the diagram, a VD signal is a vertical sync signal, an HD signal is a horizontal sync signal, and a CLK signal is a clock signal for timing generation. A VBLK signal is a signal which is set to the H level during a video period of time and is set to the L level for a vertical blanking period of time. An LC1 signal is a first signal for interpolation; an LC2 signal is a second signal for interpolation; and the LCOMP signal is the interpolation signal which is set to the OR of the LC1 signal and the LC2 signal when an interpolation ON/OFF signal is ON.
  • [0058]
    Reference numeral 61 denotes a pulse generation circuit in an image period for receiving the VD signal, HD signal, and CLK signal and generating the VBLK signal; 62 a constant cyclic counter in an image period for receiving the VBLK signal and the CLK signal and generating the LC1 signal and the LC2 signal by using a counter and a comparator for a period of time during which the VBLK signal is at the H level; 63 an OR circuit for outputting a signal corresponding to the OR of the LC1 signal and the LC2 signal; and 64 an AND circuit for outputting the output signal of the OR circuit 63 as an LCOMP signal when the interpolation ON/OFF signal is ON. The interpolation ON/OFF signal is set to ON (H level) in case of outputting the image signal of the PAL system and is set to OFF (L level) in case of outputting the image signal of the NTSC system.
  • [0059]
    [0059]FIGS. 4A to 4C are timing charts showing a change in each signal. A VSTART signal, a VCK signal, and an EN signal are signals to drive the LCD panel 13 and are generated from the LCD controller 12 and supplied to the LCD panel 13. The interpolation ON/OFF signal, namely, a signal indicating whether t-he image signal of the PAL system or the image signal of the NTSC system is inputted is preset in the LCD controller 12. As shown in the diagram, the VD, HD, and CLK signals can be also inputted or the signals corresponding to the HD, VD, and CLK signals can be also extracted from the analog video signal that is inputted from the gain adjustment circuit 11.
  • [0060]
    The VSTART signal is a signal showing the start of the vertical direction in the liquid crystal display. The VCK signal is a clock showing the switching of the horizontal lines of the liquid crystal display. The EN signal is a signal showing the position where the horizontal lines are thinned out.
  • [0061]
    [0061]FIG. 4A shows a case where the LCD panel is driven at a signal timing of the NTSC system. FIG. 4B shows a case where the LCD panel is driven at a signal timing of the PAL system. As will be understood from those timings, the lines are not thinned out at the time of the NTSC system and the lines are thinned out at a rate of 2 lines per 14 lines at the time of the PAL system. Moreover, the thinning-out process of the rate of 1 line per 8 lines and the thinning-out process of the rate of 1 lines per 6 lines are alternately performed. FIG. 4C shows signals generated in FIG. 3. As mentioned above, by synchronizing the timing of the interpolation (LCOMP) signal with the timing of the EN signal at the time of the PAL system, even if the CCD sensor of the NTSC system is used at the time of the PAL system, the LCD panel can display the image without a deterioration of the picture quality.
  • [0062]
    In the embodiment, the generation timings of the LC1 and LC2 signals of the counter 62 are set so as to match the timing of the interpolation (LCOMP) signal to the timing of the EN signal of the PAL system. That is, the timing of the EN signal which is generated by the LCD controller 12 is preliminarily examined and the counter 62 is set on the basis of the EN signal.
  • [0063]
    By enabling the setting of the constant cyclic counter 62 in an image period and the setting of the internal comparator to be changed by a register or the like, the line interpolation can be performed at the position corresponding to each of the various thinning positions of the driving by the LCD controller 12.
  • [0064]
    Further, when the timing setting is made variable, the matching of the timings can be individually performed to the LCD panels by a number of manufacturers. In this case, by providing an ON/OFF switch for the 1H delay circuit 6 and supplying the signal at the L level to the selecting circuit 17 when the ON/OFF switch is OFF, the timings can be confirmed on the screen of the LCD. That is, when the line interpolation is performed, if the line becomes a black lateral line on the screen and this black line cannot be seen on the LCD screen, this means that the timings coincide, so that the timing matching can be easily confirmed.
  • [0065]
    To simplify the system construction, it is also possible to read out the same line in the VRAM 5 twice upon reading from the VRAM 5 by omitting the 1H delay circuit 6.
  • [0066]
    Further, the data writing circuit 4 and data reading circuit 7 can also perform the reading/writing operations by a DMA (direct memory access) transfer in place of performing the reading/writing operations on the basis of the addresses for the memory.
  • [0067]
    [Second Embodiment]
  • [0068]
    [0068]FIG. 5 is a block diagram showing a construction of a video signal processing apparatus according to the second embodiment. The same circuit blocks as those in the video signal processing apparatus of the first embodiment mentioned above are designated by the same reference numerals and their descriptions are omitted here. In the diagram, reference numeral 21 denotes a DRAM which is used for the same application as that of the VRAM 5 mentioned above. Video data for super-impose that is displayed on the screen of a TV monitor or the like has been stored in the DRAM 21 in a state where it has been super-imposed onto or replaced by the photographed image received by the CCD sensor. Although not shown, a controller (apparatus control unit) 20 is provided in a manner similar to the case of FIG. 1. The same shall also similarly apply to the third and subsequent embodiments.
  • [0069]
    Reference numeral 22 denotes an image read-out circuit for reading out the data of the photographed image received by the CCD sensor; 23 an image read-out circuit for super-impose to read out the video data for super-impose stored in the DRAM 21; and 24 a superimposing circuit for switching, super-imposing, or replacing the data of the photographed image that is generated from the image read-out circuit 22 and the video data for super-impose that is generated from the image read-out circuit 23 for super-impose and outputting resultant data. Since a construction in a range from the TV system signal processing circuit 8 to the TV monitor 15 is similar to that in case of the first embodiment mentioned above, its description is omitted.
  • [0070]
    In place of the foregoing 1H delay circuit 6, a line interpolation circuit to read out the same line twice upon line interpolation is provided for the DRAM 21. It can be realized by, for example, a process to perform the DMA transfer or the like without advancing a line address pointer upon reading. In the DRAM 21, line interpolation circuits 21 a and 21 b are separately provided for the image read-out circuit 22 and image read-out circuit 23 for super-impose, respectively.
  • [0071]
    The super-imposing circuit 24 switches, superimposes, or replaces the data of the photographed image from the image read-out circuit 22 and the video data for super-impose from the image read-out circuit 23 for super-impose and generates resultant data. This output signal is supplied to the TV system signal processing circuit 8.
  • [0072]
    The TV system signal processing circuit 8 processes the output signal from the super-imposing circuit 24 to luminance and chroma separation signals, a composite signal, and luminance and color difference signals for liquid crystal. The digital video signals which are outputted from the TV system signal processing circuit 8 are converted into analog video signals by the D/A converters 9A and 9B, are band-limited by the LPFs 10A and 10B, are level-matched by the gain adjustment circuit 11, and are outputted to the LCD controller 12. The digital video signals are also level-matched by the video amplifier 14 and are output impedance adjusted, and are outputted to the TV monitor 15.
  • [0073]
    A feature of the video signal output apparatus of the second embodiment will now be described. In case of outputting the video signal according to the PAL system by using the CCD sensor of the NTSC system, it is necessary to compensate the video signal at a rate of 1 line per 7 lines in a manner similar to the first embodiment. In this case, as video data for super-impose, if the capacity of the DRAM 21 is sufficient, by preparing the data corresponding to the PAL system (736 (horizontal)×575 (vertical) pixels), the video image can be outputted to the TV monitor 15 without performing the foregoing line interpolation.
  • [0074]
    However, since all of the pixel data cannot be displayed in case of performing the liquid crystal display, there is no need to have the data corresponding to the PAL system (736 (horizontal)×575 (vertical) pixels). In other words, when the user wants to match the display of the video data for superimpose on the LCD panel with that on the TV monitor, it is also necessary to line-interpolate the video image for super-impose in a manner similar to the photographed image.
  • [0075]
    In the case where character information or the like as a user interface (UI) is displayed to only the LCD panel by using the video data for super-impose, it is better not to have the data of the lines to be thinned out.
  • [0076]
    In the case where character information or the like as a user interface (UI) is displayed to the TV monitor by using the video data for super-impose mentioned above, it is better to prepare the data corresponding to the PAL system (736 (horizontal)×575 (vertical) pixels) and to display finer character information or the like. In the case, since the lines are thinned out in the liquid crystal display, it is necessary to enable the super-imposing images to be individually displayed on the TV monitor and the LCD panel by a method such that only the photographed image is displayed on the LCD panel or the like.
  • [0077]
    According to the second embodiment as mentioned above, the photographed image and the video image for super-impose can be individually line-interpolated and the display suitable for the display apparatus can be performed.
  • [0078]
    [Third Embodiment]
  • [0079]
    [0079]FIG. 6 is a block diagram showing a construction of a video signal processing apparatus according to the third embodiment. The same component elements as those in the first and second embodiments mentioned above are designated by the same reference numerals and their descriptions are omitted here.
  • [0080]
    In the third embodiment, 1H delay circuits 6A and 6B of one horizontal line (H) and selectors 17A and 17B are provided at the post stages of the image readout circuit 22 and image read-out circuit 23 for super-impose, respectively.
  • [0081]
    Although the line interpolation has been performed upon reading from the DRAM 21 in the second embodiment, the line interpolation is performed after the video data was read out from the DRAM 21 by using the 1H delay circuits 6A and 6B and selectors 17A and 17B in the third embodiment.
  • [0082]
    As mentioned above, not only the pre-interpolation but also a linear interpolation can be performed from the lines before and after the target line by the 1H delay circuits 6A and 6B. As compared with the second embodiment, a natural image can be displayed while suppressing an aliasing noise of a high frequency of the output image, namely, without a notch.
  • [0083]
    [Fourth Embodiment]
  • [0084]
    [0084]FIG. 7 is a block diagram showing a construction of a video signal processing apparatus according to the fourth embodiment. The same component elements as those in the third embodiment mentioned above are designated by the same reference numerals and their descriptions are omitted here.
  • [0085]
    In the fourth embodiment, different from the third embodiment, the 1H delay circuit 6 of one system and the selecting circuit 17 of one system are used and are provided at the post stage of the super-imposing circuit 24. By always matching the display on the TV monitor 15 to the display on the LCD panel 13 by this circuit construction, the circuit scale can be reduced.
  • [0086]
    [Fifth Embodiment]
  • [0087]
    The fifth embodiment relates to a case of a video signal processing apparatus of the high number of pixels in which the number of pixels of the C-CD sensor 1 is larger than (752 (horizontal)×485 (vertical) pixels) or (752 (horizonal)×575 (vertical) pixels). The other construction of the video signal processing apparatus is substantially the same as that of the first embodiment.
  • [0088]
    In this case, an image reduction is performed upon data writing of the data writing circuit 4 or upon data reading of the data reading circuit 7. As a reducing method of the image, the data is thinned out by passing through an LPF. Consequently, a photographed image can be almost accurately displayed on the TV monitor 15 or LCD panel 13 by the arbitrary number of pixels of the CCD.
  • [0089]
    Even in the constructions of FIGS. 2 and 3, by using similar means, namely, by performing the image reduction upon data writing of the data writing circuit 4 or upon data reading of the data reading circuit 7 without limiting to the video signal processing apparatus of FIG. 1, the invention can cope with the CCD sensor having the large number of pixels.
  • [0090]
    [Sixth Embodiment]
  • [0091]
    [0091]FIG. 8 is a block diagram showing a construction of a video signal processing apparatus according to the sixth embodiment. Since the video signal processing apparatus of the sixth embodiment fundamentally has the same circuit construction as that in the second embodiment, its detailed descriptions is omitted here.
  • [0092]
    In the sixth embodiment, each section is divided into two systems for the TV monitor display and the LCD display and is individually processed.
  • [0093]
    In the video signal processing apparatus, as for the liquid crystal display, it is possible to construct such that even if the data is thinned out in a manner similar to the second embodiment, the video image such as character information or the like for super-impose is not lost. On the other hand, in the display on the TV monitor, the information of 575 lines (vertical) can be displayed without thinning out the lines. Therefore, as for the video data for superimpose as well, the information of 575 lines (vertical) has been stored in a memory (DRAM 91).
  • [0094]
    Particularly, in case of displaying the information to only the TV monitor without performing the liquid crystal display, since the number of lines of the display screen is fairly larger than that of the LCD panel, finer information can be displayed. For example, a super-impose or the like can be performed in a small picture plane in the multi-screen mode.
  • [0095]
    According to the video signal processing apparatus of the embodiment, the video data is stored in the storage means, the stored video data is read out by the read-out means, the read-out video data is interpolated by the interpolating means, and when the interpolated video data is displayed by the display means, the data in the portion to be interpolated by the interpolating means is matched to the data in the portion that is not displayed by the display means by the interpolation control means. Therefore, the portion of the lines to be compensated from 485 lines (vertical) of the NTSC system to 575 lines (vertical) of the PAL system can be made coincide with the portion to be displayed in the liquid crystal display by thinning out the lines at a rate of 1 line per 7 lines. Even if the CCD sensor of the NTSC system is used at the time of the PAL system, the liquid crystal display can be performed without a deterioration of the picture quality. A similar effect can be also obtained in a video signal processing method disclosed in claim 12.
  • [0096]
    According to the video signal processing apparatus of the embodiment, the storage means stores the video data comprising the photographed image data and the video data for super-impose, the reading means individually reads out the stored photographed image data and video data for super-impose, the interpolating means interpolates the photographed image data and the video data for super-impose which are individually read out, the display means displays the interpolated photographed image data and video data for super-impose onto the same picture plane, and the interpolation control means matches the photographed image data and video data for super-impose in the portions which are interpolated by the interpolating means to the data in the portion that is not displayed by the display means, respectively. Therefore, in the case where the character information or the like for user interface is super-imposed to a video image and the resultant image is displayed, the lines to be thinned out in the liquid crystal display can be compensated from the lines before and after the present line. When the lines of the PAL system are thinned out and a resultant image is displayed by the LCD, it can be correctly displayed without thinning out the character information.
  • [0097]
    Not only the pre-interpolation but also the linear interpolation can be performed from the lines before and after the present line. A natural image can be displayed while suppressing the aliasing noise of a high frequency of the output image, namely, without a notch.
  • [0098]
    Further, the circuit for super-imposing and the circuit to individually line-interpolate the photographed image and the video image for super-impose are separately provided as two systems for the TV monitor and the liquid crystal display and are independently controlled, so that the optimum image can be displayed in accordance with each of the LCD panel and the TV monitor.
  • [0099]
    According to the embodiments, when the video data is read out from the storage means, since the interpolating means interpolates the data, the circuits such as 1H delay circuit, selector, and the like can be omitted, so that the circuit construction can be simplified.
  • [0100]
    According to the embodiments, after the process to display the photographed image data and the video data for super-impose onto the same picture plane was performed, the interpolating means interpolates the data, so that a scale of the circuit to display the photographed image and the video image for super-impose onto the same picture plane can be reduced.
  • [0101]
    The present invention is not limited to the foregoing embodiments but many modifications and variations are possible within the spirit and scope of the appended claims of the invention.

Claims (18)

    What is claimed is:
  1. 1. An image processing apparatus comprising:
    interpolating means for interpolating a video signal that is supplied; and
    output means for thinning out the video signal interpolated by said interpolating means and outputting the thinned video signal,
    wherein a position on an image to be interpolated by said interpolating means and a position to be thinned out by said output means are concerned.
  2. 2. An apparatus according to claim 1, wherein said video signal that is supplied is a signal according to the NTSC standard.
  3. 3. An apparatus according to claim 2, wherein said interpolating means forms a video signal of the number of lines adapted to the PAL standard by an interpolation.
  4. 4. An apparatus according to claim 1, wherein said output means thins out the image signal in accordance with the number of lines of a liquid crystal display.
  5. 5. An apparatus according to claim 4, further comprising liquid crystal display means for displaying the video signal which is outputted by said output means.
  6. 6. An apparatus according to claim 1, further comprising generating means for generating the video signal which is supplied to said interpolating means.
  7. 7. An apparatus according to claim 6, wherein said generating means includes a photoelectric converting device.
  8. 8. A video signal processing apparatus comprising:
    storage means for storing video data;
    read-out means for reading out said stored video data;
    interpolating means for interpolating said read-out video data;
    display control means for displaying said interpolated video data; and
    interpolation control means for controlling said interpolating means so as to match a portion to be interpolated by said interpolating means to a portion which is not displayed by said display means when said video data is displayed.
  9. 9. An apparatus according to claim 8, wherein:
    said storage means stores the video data comprising photographed image data and video data for super-impose;
    said read-out means individually reads out said stored photographed image data and video data for super-impose;
    said interpolating means interpolates said photographed image data and the video data for superimpose which are individually read out;
    said display means displays said interpolated photographed image data and video data for super-impose onto a same picture plane; and
    said interpolation control means matches the photographed image data and the video data for superimpose in portions which are interpolated by said interpolating means to data in a portion which is not displayed by said display means, respectively.
  10. 10. An apparatus according to claim 8, wherein when the video data is read out from said storage means, said interpolating means interpolates the data.
  11. 11. An apparatus according to claim 9, wherein after a process to display said photographed image data and said video data for super-impose onto the same picture plane was performed, said interpolating means interpolates the data.
  12. 12. An image signal processing method comprising the steps of:
    storing video data;
    reading out said stored video data;
    interpolating said read-out video data; and
    when said interpolated video data is displayed, matching said portion to be interpolated to a portion that is not displayed.
  13. 13. A method according to claim 12, wherein said video data is data adapted to the NTSC standard.
  14. 14. A method according to claim 13, wherein in said interpolating step, the data is interpolated so as to obtain data adapted to the PAL standard.
  15. 15. An image processing apparatus comprising:
    processing means for processing a supplied image signal in accordance with a set broadcasting standard;
    display means for displaying the image signal processed by said processing means; and
    control means for controlling said display means in accordance with the set broadcasting standard.
  16. 16. An apparatus according to claim 15, wherein said broadcasting standard includes the PAL system and the NTSC system.
  17. 17. An apparatus according to claim 15, further comprising setting means for setting said broadcasting standard.
  18. 18. An apparatus according to claim 17, wherein said display means is liquid crystal display means.
US10234376 1998-03-06 2002-09-05 Image processing of video signal for display Abandoned US20020196349A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP10-071203 1998-03-06
JP7120398 1998-03-06
US09262929 US6480230B1 (en) 1998-03-06 1999-03-05 Image processing of video signal for display
US10234376 US20020196349A1 (en) 1998-03-06 2002-09-05 Image processing of video signal for display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US10234376 US20020196349A1 (en) 1998-03-06 2002-09-05 Image processing of video signal for display

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09262929 Division US6480230B1 (en) 1998-03-06 1999-03-05 Image processing of video signal for display

Publications (1)

Publication Number Publication Date
US20020196349A1 true true US20020196349A1 (en) 2002-12-26

Family

ID=13453896

Family Applications (2)

Application Number Title Priority Date Filing Date
US09262929 Expired - Fee Related US6480230B1 (en) 1998-03-06 1999-03-05 Image processing of video signal for display
US10234376 Abandoned US20020196349A1 (en) 1998-03-06 2002-09-05 Image processing of video signal for display

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09262929 Expired - Fee Related US6480230B1 (en) 1998-03-06 1999-03-05 Image processing of video signal for display

Country Status (1)

Country Link
US (2) US6480230B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050028209A1 (en) * 2002-09-10 2005-02-03 Nokia Corporation Method in a digital mobile station, a digital mobile station, application software, and a system for displaying visual information
US20070019082A1 (en) * 2005-07-11 2007-01-25 Zenya Kawaguchi Video signal processing apparatus, video signal processing method, and imaging device

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6778211B1 (en) * 1999-04-08 2004-08-17 Ipix Corp. Method and apparatus for providing virtual processing effects for wide-angle video images
JP2001014454A (en) * 1999-06-29 2001-01-19 Sharp Corp Picture processor
KR100734927B1 (en) * 1999-12-27 2007-07-03 엘지.필립스 엘시디 주식회사 Lcd
JP2002142149A (en) * 2000-11-06 2002-05-17 Mega Chips Corp Picture processing circuit
US6625342B2 (en) * 2001-07-03 2003-09-23 Network Photonics, Inc. Systems and methods for overcoming stiction using a lever
US7151514B2 (en) * 2001-07-25 2006-12-19 Chi Mei Optoelectronics Corp. Method for handling a signal and the application thereof
CN100448286C (en) 2002-11-25 2008-12-31 卡西欧计算机株式会社 Image signal generation unit, digital camera, and image signal generation method
JP4169340B2 (en) * 2002-11-25 2008-10-22 カシオ計算機株式会社 Output signal generation circuit for a display panel, the output signal generation method for digital cameras and the display panel
US7570238B2 (en) * 2004-04-01 2009-08-04 Seiko Epson Corporation System and method for reducing power consumption by a display controller
JP2007279740A (en) * 2006-04-07 2007-10-25 Gunko Kagi (Shenzhen) Yugenkoshi Display device and method of transmitting signal therein
US20080117192A1 (en) * 2006-11-17 2008-05-22 Chunghwa Picture Tubes, Ltd Cancellation method and its circuit of line-decimated phenpmenon
WO2011077300A3 (en) * 2009-12-23 2011-11-24 Schlumberger Technology Bv Processing of geological data
CN104299593B (en) * 2014-11-07 2017-01-25 深圳市华星光电技术有限公司 The liquid crystal display device
KR20160115023A (en) * 2015-03-25 2016-10-06 한화테크윈 주식회사 Apparatus and method for converting video signal

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5459520A (en) * 1992-12-08 1995-10-17 Sony Corporation Electronic camera with over-sampling filter and method for over-sampling and interpolating electronic camera image data
US5541651A (en) * 1992-08-26 1996-07-30 Hitachi, Ltd. Multi-format digital image pickup apparatus
US6097437A (en) * 1996-12-18 2000-08-01 Samsung Electronics Co., Ltd. Format converter
US6118486A (en) * 1997-09-26 2000-09-12 Sarnoff Corporation Synchronized multiple format video processing method and apparatus
US6130711A (en) * 1991-09-04 2000-10-10 Canon Kabushiki Kaisha Video camera with slower than standard read-out from CCD
US6144411A (en) * 1996-04-09 2000-11-07 Canon Kabushiki Kaisha Image processing apparatus with format conversion capabilities
US6144412A (en) * 1996-10-15 2000-11-07 Hitachi, Ltd. Method and circuit for signal processing of format conversion of picture signal
US6256068B1 (en) * 1996-05-08 2001-07-03 Matsushita Electric Industrial Co., Ltd. Image data format conversion apparatus

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6130711A (en) * 1991-09-04 2000-10-10 Canon Kabushiki Kaisha Video camera with slower than standard read-out from CCD
US5541651A (en) * 1992-08-26 1996-07-30 Hitachi, Ltd. Multi-format digital image pickup apparatus
US5459520A (en) * 1992-12-08 1995-10-17 Sony Corporation Electronic camera with over-sampling filter and method for over-sampling and interpolating electronic camera image data
US6144411A (en) * 1996-04-09 2000-11-07 Canon Kabushiki Kaisha Image processing apparatus with format conversion capabilities
US6256068B1 (en) * 1996-05-08 2001-07-03 Matsushita Electric Industrial Co., Ltd. Image data format conversion apparatus
US6144412A (en) * 1996-10-15 2000-11-07 Hitachi, Ltd. Method and circuit for signal processing of format conversion of picture signal
US6097437A (en) * 1996-12-18 2000-08-01 Samsung Electronics Co., Ltd. Format converter
US6118486A (en) * 1997-09-26 2000-09-12 Sarnoff Corporation Synchronized multiple format video processing method and apparatus

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050028209A1 (en) * 2002-09-10 2005-02-03 Nokia Corporation Method in a digital mobile station, a digital mobile station, application software, and a system for displaying visual information
US20070019082A1 (en) * 2005-07-11 2007-01-25 Zenya Kawaguchi Video signal processing apparatus, video signal processing method, and imaging device
US8553050B2 (en) * 2005-07-11 2013-10-08 Canon Kabushiki Kaisha Video signal processing apparatus, video signal processing method, and imaging device

Also Published As

Publication number Publication date Type
US6480230B1 (en) 2002-11-12 grant

Similar Documents

Publication Publication Date Title
US5781241A (en) Apparatus and method to convert computer graphics signals to television video signals with vertical and horizontal scaling requiring no frame buffers
US5712680A (en) Image pickup device for obtaining both moving and still images
US6871010B1 (en) Video recorder for recording moving and still picture information
US5047858A (en) Multiple image processing and display system
US6876380B2 (en) Electronic endoscopic apparatus connectable with electronic endoscope having different number of pixels
US20020122119A1 (en) Color imaging device and method
US5473382A (en) Video signal converting apparatus for converting an interlace video signal into a non-interlace video signal for reduction
US6342921B1 (en) Lattice-type solid state image pickup device
US5227882A (en) Video display apparatus including display device having fixed two-dimensional pixel arrangement
US4364090A (en) Method for a compatible increase in resolution in television systems
US4729028A (en) Television receiver with multipicture display
US20040095485A1 (en) Imaging apparatus and control method thereof
US5812210A (en) Display apparatus
US6778216B1 (en) Method and apparatus for digital camera real-time image correction in preview mode
US6211918B1 (en) Video signal converter and television signal processing apparatus
US4249213A (en) Picture-in-picture television receiver
US5581301A (en) Image processing apparatus with adjustable low-pass optical filter characteristics
US4953025A (en) Apparatus for defining an effective picture area of a high definition video signal when displayed on a screen with a different aspect ratio
US6801250B1 (en) Converting a multi-pixel image to a reduced-pixel image to provide an output image with improved image quality
US5734427A (en) High resolution electronic still camera with an electronic viewfinder for displaying a reduced image
US4903132A (en) Electronic still camera with slow-in, fast out memory addressing
US5267045A (en) Multi-standard display device with scan conversion circuit
US6166777A (en) Picture-in-picture type video signal processing circuit and method of using the same for a multi-picture display circuit
US5657034A (en) Display apparatus and method for displaying signals of different aspect ratios left and right viewing
US5444483A (en) Digital electronic camera apparatus for recording still video images and motion video images