WO2006064604A1 - Dispositif de traitement d’image - Google Patents

Dispositif de traitement d’image Download PDF

Info

Publication number
WO2006064604A1
WO2006064604A1 PCT/JP2005/018228 JP2005018228W WO2006064604A1 WO 2006064604 A1 WO2006064604 A1 WO 2006064604A1 JP 2005018228 W JP2005018228 W JP 2005018228W WO 2006064604 A1 WO2006064604 A1 WO 2006064604A1
Authority
WO
WIPO (PCT)
Prior art keywords
image data
bus
moving image
memory
image processing
Prior art date
Application number
PCT/JP2005/018228
Other languages
English (en)
Japanese (ja)
Inventor
Akio Kobayashi
Toru Asaeda
Hidefumi Okada
Mitsuaki Kurokawa
Original Assignee
Sanyo Electric Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sanyo Electric Co., Ltd. filed Critical Sanyo Electric Co., Ltd.
Priority to US11/792,481 priority Critical patent/US8072643B2/en
Publication of WO2006064604A1 publication Critical patent/WO2006064604A1/fr

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/907Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/7921Processing of colour television signals in connection with recording for more than one processing mode
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding

Definitions

  • the present invention relates to an image processing apparatus, and more particularly to an image processing apparatus that is applied to, for example, a video camera and displays a moving image of an object scene on a monitor.
  • Conventional technology is applied to, for example, a video camera and displays a moving image of an object scene on a monitor.
  • Patent Document 1 Japanese Laid-Open Patent Publication No. 2 0 2 2 4 7 5 1 7
  • Patent Document 1 Japanese Laid-Open Patent Publication No. 2 0 2 2 4 7 5 1 7
  • a composite image signal is created based on the moving image data of the photographed subject, and the created composite image signal is output to the monitor.
  • a real-time moving image of the object scene is displayed on the monitor screen.
  • a main object of the present invention is to provide a novel image processing apparatus.
  • Another object of the present invention is to provide an image processing apparatus capable of executing processing conforming to a plurality of formats without causing failure.
  • the image processing apparatus comprises the following: a fetching means for fetching the first moving image data to be written to the first memory through the first bus; a first read from the first memory through the first bus First processing means for performing first processing on moving image data and generating second moving image data to be written to the first memory through the first bus; second processing data read from the first memory through the first bus A first output means for applying an output process directed to the first monitor to the moving image data; from the first memory through the first bus; Reducing means for reducing the resolution of the second moving image data read out to create the third moving image data to be written to the second memory through the second bus; and from the second memory to the second bus. Second output means for performing output processing directed to the second monitor on the read third moving image data.
  • the first moving image data is fetched by the fetching means and written to the first memory through the first bus.
  • the first moving image data stored in the first memory is read through the first bus and subjected to the first processing by the first processing means.
  • the second moving image data created by the first process is written to the first memory through the first bus.
  • the second moving image data stored in the first memory is read through the first bus and subjected to output processing directed to the first monitor by the first output means. As a result, the corresponding moving image is displayed on the first monitor screen.
  • the reduction means reduces the resolution of the second moving image data read from the first memory through the first bus.
  • the third moving image data thus created is written to the second memory through the second bus.
  • the third moving image data stored in the second memory is read through the second bus and subjected to output processing directed to the second monitor by the second output means. As a result, the corresponding moving image is displayed on the screen of the second monitor.
  • a series of processes for creating the second moving image data output to the first monitor is executed using the first bus and the first memory.
  • a series of processes for generating the third moving image data output toward the second monitor is executed using the second pass and the second memory.
  • the resolution of the second moving image data is higher than the resolution of the third moving image data.
  • the first pass and first memory are used for high-speed processing such as high-resolution moving image data processing
  • the second bus and second memory are used for low-speed processing such as low-resolution moving image data processing. Is used. As a result, processing conforming to multiple formats can be executed without causing a failure.
  • An image processing apparatus is dependent on claim 1, wherein the first moving image data is data in which any one of a plurality of colors is assigned to each pixel, and the first processing is all of the plurality of colors. Color processing for assigning to each pixel.
  • the first moving image data By temporarily storing the first moving image data in the first memory, the first moving image data can be captured. Flexibility.
  • An image processing apparatus is dependent on claim 1, wherein the second moving image data has a first resolution corresponding to the first aspect ratio, and the third moving image data is the second image. Has a second resolution corresponding to the aspect ratio.
  • An image processing apparatus is dependent on claim 3, wherein the first aspect ratio is 16: 9 and the second aspect ratio is 4: 3.
  • a moving image based on the second moving image data can be displayed on an HD TV (High Definition TV)
  • a moving image based on the third moving image data can be displayed on an NTSC, P A L, or S E CA M M TV.
  • the image processing apparatus is dependent on claim 1, and the second moving image data and the third moving image data have the same frame rate.
  • a moving image having the same smoothness can be displayed on each of the first monitor and the second monitor.
  • An image processing apparatus is dependent on claim 1, and the capturing means includes photographing means for periodically photographing the object scene. This realizes a video power camera that creates moving image data that conforms to multiple formats.
  • An image processing apparatus is dependent on claim 6, and the imaging means includes an imaging surface on which a plurality of partial imaging areas are formed, and a plurality of output paths respectively assigned to the plurality of partial imaging areas. And the capturing means further includes a creating means for creating the first moving image data based on the charges output from the plurality of output paths. As a result, the first moving image data with improved resolution and frame rate can be obtained.
  • the image processing apparatus is dependent on claim 1, compressing the data amount of the second moving image data read from the first memory through the first bus, and passing the first memory through the first path. It further includes a first compression means for creating fourth moving image data to be written. By transferring both the second video data before compression and the fourth video data after compression using the common first bus, high-speed compression processing is realized.
  • An image processing apparatus is dependent on claim 8, and is a first compression means. Performs the compression process when the first predetermined operation is performed.
  • An image processing device is dependent on claim 8 and further comprises: the fourth moving image data read from the first memory through the first bus to the second memory through the second bus A first writing means for writing; and a moving image recording means for recording the fourth moving image data read from the second memory through the second pass on a recording medium.
  • An image processing device is dependent on claim 1, and performs a second process on the first still image data of one frame forming the first moving image data, and a second bus is provided to the second memory. And a second processing means for creating second still image data to be written through.
  • the first still image data is extracted from the first moving image data transferred through the first bus, and converted to the second still image data by the second process.
  • the converted second still image data is written to the second memory through the second bus.
  • the image processing device is dependent on claim 11 and the second processing means executes the second process when the second predetermined operation is performed.
  • the image processing device is dependent on claim 11 and compresses the amount of data of the second still image read from the second memory through the second bus to the second memory.
  • Second compression means for creating third still image data to be written through the second bus is further provided.
  • High-speed compression processing is realized by transferring both the second still image data before compression and the third still image data after compression using the common second path.
  • the image processing apparatus is dependent on claim 13 and further includes a still image recording means for recording the third still image data created by the second compression means on the recording medium.
  • FIG. 1 is a block diagram showing the configuration of an embodiment of the present invention
  • FIG. 2 is an illustrative view showing an example of the configuration of a CCD imager applied to the embodiment of FIG.
  • Fig. 3 is an illustrative view showing an example of the configuration of the imaging surface of the CCD imager shown in Fig. 2;
  • FIG. 4 is an illustrative view showing one example of a mapping state of the S D RAM applied to the embodiment of FIG. 1;
  • FIG. 5 is an illustrative view showing an example of another SD RAM mapping state applied to the embodiment of FIG. 1;
  • FIG. 6 is a block diagram showing an example of the configuration of the S D RAM controller applied to the FIG. 1 embodiment
  • FIG. 7 is a block diagram showing an example of the configuration of another SDRAM controller applied to the FIG. 1 embodiment
  • Fig. 8 (A) is an illustration showing the aspect ratio of the moving image displayed on the HDTV
  • Figure 8 (B) is an illustration showing the aspect ratio of the video displayed on the LCD monitor
  • Fig. 8 (C) is an illustration showing the aspect ratio of recorded still images.
  • a digital video camera 10 of this embodiment includes a CCD imager 12.
  • the optical image of the object scene is irradiated onto the imaging surface of the CCD imager 12 through an optical lens (not shown).
  • the imaging surface is covered with a primary color filter array color filter 1 2 f.
  • the charge generated in each of the plurality of light receiving elements formed on the imaging surface has color information of R (Red), G (Green), or B (Blue).
  • the TG (Timing Generator) 16 is activated by the CPU 44.
  • TGI 6 generates multiple timing signals including horizontal sync signal Hsync and vertical sync signal Vsync.
  • the Each of drivers 14a and 14b drives CCD imager 12 in response to such timing signals.
  • a charge image signal corresponding to one frame is output from the CCD imager 12.
  • the vertical synchronization signal Vs ync is generated every 1Z30 seconds, and the raw image signal output from the CCD imager 12 has a frame rate of 30 fps.
  • the imaging surface of CCD imager 12 has partial imaging areas IML and IMR.
  • the partial imaging area IML is formed on the left side of the boundary line BL extending vertically from the center of the imaging surface, and the partial imaging area IMR is formed on the right side of the same boundary line BL.
  • the imaging surface has a resolution of horizontal 1324 pixels x vertical 9696 pixels.
  • Each of the partial imaging areas IML and IMR has a resolution of horizontal 662 pixels ⁇ vertical 996 pixels. Therefore, the partial imaging areas IML and IMR touch each other at the boundary line.
  • the effective area irradiated with the optical image is an area of horizontal 1300 pixels x vertical 975 pixels allocated almost at the center of the imaging surface.
  • a plurality of vertical transfer registers are assigned to each of the partial imaging areas IML and IMR. Further, the horizontal transfer register HL is assigned to the partial imaging area IML, and the horizontal transfer register HR is assigned to the imaging area IMR. Therefore, the charges generated by the plurality of light receiving elements on the partial imaging area IML are output from the channel CH 1 via the vertical transfer register and the horizontal transfer register HL (not shown). Similarly, the charges generated by the plurality of light receiving elements on the imaging area IMR are also output from the channel CH2 via a vertical transfer register (not shown) and the horizontal transfer register HR.
  • the dryino I 4 a performs a raster scan (interlaced scan) on the partial image area IML based on the timing signal from the TG 16, and outputs the raw image signal of the left 12 frames from the channel CH1.
  • the driver 14b performs raster scanning (interlace scanning) on the imaging area IMR based on the timing signal from the TG16, and outputs the raw image signal of the right 12 frames from the channel CH2.
  • the transfer direction of the horizontal transfer register HR is the opposite of the transfer direction of the horizontal transfer register HL. For this reason, the last evening scanning direction is also the partial imaging area IML.
  • I MR invert each other.
  • the CDSZAGCZAD circuit 18a in response to the timing signal from TG16, performs a series of processes such as correlated double sampling, automatic gain adjustment, and AZD conversion on the raw image signal of channel CH1.
  • ⁇ 03 / / 080 ⁇ 80 circuit 1 8b in response to the timing signal from TG16, it correlates with the raw image signal of channel CH2 A series of processing of double sampling, automatic gain adjustment and AZD conversion Apply.
  • the timing signal has a frequency of 27 MHz. Therefore, each of the CDS / AGCZAD converters 18a and 18b outputs raw image data as a digital signal at a clock rate of 27 MHz.
  • the channel matching circuit 22 provided in the AS IC 20 cuts out the raw image data given from each of the A / D converters 18a and 18b, and performs a series of matching processes such as clamping and white balance adjustment.
  • Raw image data belonging to the valid area is extracted by a clipping process.
  • the level difference between channels is eliminated by the clamping process.
  • the white balance deviation is eliminated by the white balance adjustment process.
  • This matching process is executed in response to the timing signal output from TG16.
  • the channel matching circuit 22 issues a write request to the SDRAM controller 30 every time a predetermined amount of matching processing is completed.
  • the SDRAM controller 30 is configured as shown in FIG.
  • the request issued by the channel matching circuit 22 is given to the arbitration circuit 30a.
  • the arbitration circuit 30a includes a signal processing circuit 24, an MPEG codec 26, a D4-I / F 28, an XBUS-I / F 34, a stream I / F 36, a CCD output circuit 38, D 1—Receives requests from I-NO F 40 and CPU 44 and accepts any one request according to preset priority.
  • the arbitration circuit 30a gives an approval signal to the issuer of the approved request, and instructs the memory access circuit 30b to perform processing corresponding to the approved request.
  • the memory access circuit 3 Ob writes a predetermined amount of data transferred from the issuer of the write request via the path B 1 or B 2 to the SDRAM 32. If the approved request is a read request, the memory access circuit 30 b A predetermined amount of data according to the request is read from SDR AM 32, and the read data is transferred to the issuer of the read request via bus B1 or B2.
  • the channel matching circuit 22 transfers the fixed amount of raw image data that has undergone the matching process to the SD RAM controller 30 through the path B 1.
  • the raw image data given from the channel matching circuit 22 is written into the raw image area 3 2 a (see FIG. 4) by the SD RAM controller 30.
  • the raw image data of channel C H 1 is written to the left side of the raw image area 3 2 a, and the raw image data of channel C H 2 is written to the right side of the raw image area 3 2 a.
  • raw image data of horizontal 1300 pixels x vertical 975 pixels representing one frame object scene image is secured in the raw image area 3 2 a.
  • the signal processing circuit 24 repeatedly issues a read request to the SDRAM controller 30 in order to read the raw image data stored in the raw image area 3 2 a by a predetermined amount.
  • the raw image data read by the SD RAM controller 30 is given to the signal processing circuit 24 through the scan B 1.
  • the signal processing circuit 24 performs processing such as color separation and YUV conversion on the transferred raw image data. This series of processing is executed at a clock rate of 54 MHz.
  • a YUV image data having a resolution of horizontal 1280 pixels X vertical 720 pixels is generated at a rate of one frame per 1300 seconds.
  • the YUV image data generated in this way is transferred to the SDRAM controller 30 by a predetermined amount through the bus B1.
  • the write request is repeatedly issued, and the YUV image data is written into the moving image area 3 2 b (see FIG. 4) by the SDRAM controller 30.
  • the aspect ratio of the image based on this raw image data is 4: 3.
  • the resolution of the YUV image data generated by the signal processing circuit 24 is horizontal 1280 pixels x vertical 720 pixels, so the aspect ratio of the image based on this YUV image data is 1 6: 9. Therefore, when generating YUV image data, The vertical ends of the evening are partially removed.
  • the D 1—I / F 40 repeatedly issues a read request to the SDRAM controller 30, and reads YUV image data stored in the moving image area 32b by a predetermined amount.
  • the YUV image data is read out from the moving image area 32b in a raster scanning manner (interlaced scanning manner), and given to the D1-I / F 40 via the path B1.
  • the YUV image data is input to D1-I / F40 at a rate of 1 frame per 1Z30 seconds.
  • D l— lZF4 (Hi, format conversion processing is applied to the given YUV image data. This processing is performed according to the 27 MHz clock rate, and the processed YU V image data is 720 pixels horizontal by X vertical. It has a resolution of 480 pixels and an aspect ratio of 4: 3 In this way, YUV image data conforming to the D1 standard is generated at a rate of 1 frame per 1/30 second.
  • the aspect ratio of YUV image data given to D1-IZF40 is 16: 9, while the aspect ratio of YUV image data output from D1-IZF40 is 4: 3. . Therefore, letterpox components are assigned to both ends in the vertical direction of the YUV image data output from D1-IZF40.
  • the YUV image data generated by D 1-I / F 40 is output to D 1—IZF 52 provided in AS I C 42.
  • D l—IZF52 also captures YUV image data according to a clock rate of 27 ⁇ ⁇ .
  • SDRAM controller 56 is formed by arbitration circuit 56a and memory access circuit 56b, similarly to SDRAM controller 39 shown in FIG. Further, the arbitration circuit 56 a and the memory access circuit 56 b operate in the same manner as the arbitration circuit 30 a and the memory access circuit 30 b shown in FIG. Therefore, duplicate descriptions are omitted.
  • the SDRAM controller 56 writes a predetermined amount of YUV image data transferred from the D 1—I 52 in the moving image area 54 b (see FIG. 5). YUV image data is written to the video area 54b at a rate of 1 frame per 1/30 second.
  • the NTSC encoder 62 repeatedly issues a read request to the SDRAM controller 56 in order to read out the YUV image data stored in the moving image area 54b by a predetermined amount.
  • the YUV image data is read out by the SDRAM controller 56 and supplied to the NTS C encoder 62 through the bus B3.
  • the NTS C encoder 62 converts the supplied YUV image data into an NTS C format composite video signal.
  • the composite video signal is also generated at a rate of 1 frame per 1/30 second, and the generated composite video signal is output to the LCD monitor 66.
  • a real-time moving image (through image) of the object scene is displayed on the monitor screen as shown in Fig. 8 (B).
  • D4-IZF 28 When the D4-IZF 28 is connected to an HDTV (not shown), the CPU 44 activates the D4-I / F 28 instead of the D1-IZF 40 or together with the D1-IZF 40.
  • D4—IZF 28 reads the YUV image data stored in the moving image area 32 b by a predetermined amount through path B 1 and SDRAM controller 30. YUV image data is read out in a lath scanning mode (sequential scanning mode) according to a frame rate of 30 f ps.
  • D4—IZF28 converts the read YUV image data into a video signal conforming to the D4 standard, and outputs the converted video signal to HDTV. As a result, a high-quality through image is displayed on the TV screen as shown in Fig. 8 (A).
  • the MPEG4 codec 26 and the stream IZF 36 are activated by the CPU 44.
  • the MP 4 codec 26 reads out the YUV image data stored in the moving image area 32 b (see FIG. 4) of the SDRAM 32 by a predetermined amount in the same manner as described above. That is, a read request is repeatedly issued to the SDRAM controller 30, and Y UV image data is acquired by a predetermined amount through the bus B1. The acquired YUV image data is compressed according to the MPEG4 format.
  • Such read processing and compression processing are executed at a rate of one frame per 130 seconds.
  • the MPEG4 stream generated by the compression process is the same as that described above.
  • a predetermined amount is supplied to the SDR AM controller 30 through 1 and written in the MPEG area 32 c of the SDRAM 32 (see FIG. 4).
  • the stream I / F 36 reads the MP EG 4 stream stored in the MPEG area 32 c by a predetermined amount through the bus B 1 and the SDRAM controller 30 and reads the read MPEG 4 stream to the stream provided in the AS I C 42. Output to IZF 48.
  • the stream IZF 48 gives the given MP EG4 stream to the SDRAM controller 56 by a predetermined amount through the bus B 3 and writes it to the MP EG area 54 c (see FIG. 5) of the SDRAM 54.
  • the CPU 44 repeatedly issues a read request to the SDRAM controller 56 in order to read the MPEG4 stream stored in the MPEG area 54c in a fixed amount.
  • the MP EG4 stream read by the SDRAM controller 56 is given to the card I / F 58 through the bus B 4 and is recorded in the memory card 64 by the card I / F 58.
  • the MPEG4 stream is stored in an MP EG file formed on the memory card 64.
  • the CPU 44 activates the CCD output circuit 38, the signal processing circuit 50, and the JPEG codec 60.
  • the CCD output circuit 38 issues a read request to the SDRAM controller 30 to read a predetermined amount of the raw image data of one frame from the raw image area 32 a of the SDRAM 32 (see FIG. 4).
  • the raw image data read by the S DRAM controller 30 is given to the CCD output circuit 38 via the bus B1.
  • the CCD output circuit 38 outputs one frame of raw image data thus given to the signal processing circuit 50 provided in the AS IC 42.
  • the signal processing circuit 50 performs processing such as color separation and YUV conversion on the raw image data given from the CCD output circuit 38, and as shown in Fig. 8 (C), the resolution of 1280 pixels horizontal x 960 pixels vertical and 4 : YUV image data having an aspect ratio of 3 is generated.
  • the generated YUV image data is sent to SDRAM controller via bus B3. After being given to the roller 56, it is written in the still image area 54d of the S DRAM 54 (see FIG. 5).
  • the J PEG codec 60 repeatedly issues a read request to the SDRAM controller 56 to read the YUV image data stored in the still image area 54 d by a predetermined amount.
  • the YUV image data is read out by the SDRAM controller 56 and supplied to the J PEG codec 60 via the bus B 3.
  • the J PEG codec 60 performs J PEG compression on the given YUV image data, and repeatedly requests the SDR AM controller 56 to write the compressed image data, that is, J PEG data.
  • the SDRAM controller 56 writes the J PEG data given from the J PEG codec 60 through the bus B 3 into the JP EG area 54 a of the SDR AM 54.
  • the CPU 44 reads one frame of JPEG data secured in the JPEG area 54 a in this way through the bus B4 and the SDRAM controller 56 by a predetermined amount, and reads the read JPEG data into the bus B4 and card IZF. Record to memory card 64 through 58. As a result, a J PEG file is created in the memory card 64.
  • the CPU 44 accesses the memory card 64 through the bus B 4 and the power I / F 58. Play the MP EG 4 stream from the desired MPEG file.
  • the reproduced MP EG 4 stream is given to the SDRAM controller 56 by a predetermined amount through the bus B 4 and written into the MPEG area 54 c (see FIG. 5) of the SDRAM 54 by the SDRAM controller 56.
  • the stream IZF 48 repeatedly issues a read request to the SDRAM controller 56, and reads the MPEG 4 stream stored in the MP EG area 54c by a predetermined amount.
  • the read MP EG 4 stream is given to the stream IZF 48 through the bus B3 and then outputted to the stream IZF 36.
  • Stream IZF36 writes a given MP EG 4 stream to SD Requests to the RAM controller 30 repeatedly.
  • the SDRAM controller 30 writes the MPEG4 stream supplied from the stream IZF 36 through the bus B 1 to the MPEG area 32 c of the SDRAM 32 (see FIG. 4).
  • the MPEG4 codec 26 reads the MP EG 4 stream stored in the MP EG area 32 c by a predetermined amount through the SDRAM controller 30.
  • the read MPEG4 stream is given to the MPEG4 codec 26 through path B1 and decompressed according to the MPEG4 format.
  • the decompressed YUV image data is output from the MP EG4 codec 26 at a rate of 1 frame per 1/30 second, and given to the SDRAM controller 30 through the bus B 1 by a predetermined amount. After that, the YUV image data is written in the moving image area 32 b (see Fig. 4) of SDRAM32. '
  • the D 1—IZF 40 reads YUV image data from the moving image area 32 b through the SDRAM controller 30 and performs the same format conversion processing as described above on the YUV image data input through the bus B 1.
  • the resolution of YUV image data is reduced from horizontal 1280 pixels x vertical 720 pixels to horizontal 720 pixels x horizontal 480 pixels, and letterbox components are assigned to both ends of the reduced YUV image data in the vertical direction.
  • This YUV image data is also created at a rate of 1 frame per 1 to 30 seconds, and the created YUV image data is output to D 1—IZF 52.
  • D 1—I ZF 40 Data transfer to D 1—I ZF 40 is performed according to a clock rate of 54 MHz, and data transfer from D 1—I / F 40 to D 1 -I / F 52 is 27 MH It is executed according to the clock rate of z.
  • the D 1 -I / F 52 supplies the YUV image data of each frame given from the Dl—IZF 40 to the SDRAM controller 56 by a predetermined amount through the path B 3.
  • the YUV image data is written into the moving image area 54b (see FIG. 5) of the SDRAM 54 by the SDRAM controller 56.
  • the NT SC encoder 62 reads the YUV image data stored in the moving image area 754b by a predetermined amount through the SDRAM controller 56 and converts the YUV image data given through the bus B 3 into an NT SC composite video signal. To do. Read processing and conversion processing are also executed at a rate of 1 frame per 30 seconds. It is. The converted composite video signal is output to the LCD monitor 66, whereby the playback moving image is displayed on the monitor screen in the manner shown in FIG. 6 (B).
  • D4—IZF28 When D4—IZF28 is connected to an HDTV, D4—I / F 28 is activated along with D1—IZF40 or with D1—IZF40.
  • D4—The IZF 28 reads YUV image data from the moving image area 3 2b (see FIG. 4) of the SDRAM 32 through the SDRAM controller 30. The YUV image data for each frame is read out in the last evening scanning mode (sequential scanning mode) every 1Z30 seconds, and given to D4_I / F 28 through bus B1.
  • D4—IZF28 converts the provided YUV image data into a video signal conforming to the D4 standard, and outputs the converted video signal to the HDTV. As a result, high-quality playback video is displayed on the TV screen as shown in Fig. 6 (A).
  • the CPU 44 accesses the memory card 64 through path B 4 and card I / F 58, and stores the J JPEG file stored in the desired J PEG file. Play the PEG video.
  • the reproduced J PEG data is written into the J PEG area 54a (see FIG. 5) of the S DRAM 54 through the bus B 4 and the SDRAM controller 56.
  • the J PEG codec 60 reads the J PEG data stored in the J PEG area 54a by a predetermined amount through the SDRAM controller 56, and decompresses the J PEG data given through the bus B3.
  • the JPEG codec 60 further requests the SDRAM controller 56 to write the extended YUV image data.
  • the SDRAM controller 56 writes the YUV image data transferred through the path B 3 in the still image area 54 d of the SDRAM 54 (see FIG. 5).
  • the NTS C encoder 62 reads the YUV image data stored in the still image area 54d through the bus B 3 and the SDRAM controller 56, and converts the read YUV image data into an NTSC C composite video signal. At this time, the resolution is reduced from horizontal 1280 pixels x vertical 960 pixels to horizontal 720 pixels x horizontal 480 pixels.
  • the read process and conversion process are executed at a rate of 1 frame per 1300 seconds, as described above.
  • the converted composite video signal is output to the LCD monitor 66, and the playback still image is displayed on the monitor screen. Indicated.
  • XBUS—I / F46 When D4-I / F28 is connected to HDTV, XBUS—I / F46 is activated instead of NTS C encoder 62.
  • XBUS—IZF46 reads YUV image data from still image area 54d through bus B4 and SDRAM controller 56, and reads the read YUV image data to XBUS—I / F 34 provided in AS I C20. Output to.
  • the XBUS—I / F 34 writes the given Y UV image data through the bus B 2 and the SDRAM controller 30 to the still image area 32 d (see FIG. 4) of the SDRA M32 by a predetermined amount.
  • D4—IZF 28 reads a predetermined amount of YUV image data from static image area 32 d through bus B 1 and SDRAM controller 30, and converts the read YUV image data into a D4 standard video signal.
  • the reading process and conversion process are executed at a rate of 1 frame per 1 Z 30 seconds.
  • the converted video signal is output to the HD TV, and as a result, a high-quality still image is displayed on the TV screen.
  • the resolution of YUV image data read from the still image area 32d is 1280 pixels x 960 pixels horizontally, while the resolution of the video signal output to the HDTV is 1280 pixels x 720 pixels vertically. Therefore, a still image that is partially missing at both ends in the vertical direction is displayed on the TV screen.
  • the raw image data (first moving image data) output from each of the circuits 03a and 18b 18a and 18b is transmitted by the channel matching circuit 22 (capture means). It is fetched and written to SDRAM32 (first memory) through bus B 1 (first bus). The raw image data stored in the first memory is read through the bus B 1 and subjected to processing (first processing) such as color separation and YUV conversion by the signal processing circuit 24 (first processing means). The YUV image data (second moving image data) created by the signal processing circuit 24 is written to the SDRAM 32 through the path B 1.
  • first processing such as color separation and YUV conversion by the signal processing circuit 24 (first processing means).
  • the YUV image data (second moving image data) created by the signal processing circuit 24 is written to the SDRAM 32 through the path B 1.
  • the YUV image data stored in the SDRAM 32 is read out via the bus B1, and output processing directed to the HDTV (first monitor) is performed by the D4-IZF28 (first output means). As a result, the corresponding video is displayed on the HDTV screen.
  • D 1-I / F40 (reduction measure) reads from SDRAM 32 through bus B 1 Reduce the resolution of the output YUV image data.
  • the low-resolution YUV image data (third moving image data) is written to SDRAM 54 (second memory) through path B 3 (second bus).
  • the YUV image data stored in the SDRAM 54 is read through the bus B 3 and subjected to output processing directed to the LCD monitor (second monitor) by the NTSC encoder 62 (second output means). As a result, the corresponding moving image is displayed on the second monitor screen.
  • a series of processes for creating HDTV YUV image data is executed using the bus B 1 and the SDRAM 32.
  • a series of processing for creating YUV image data for the LCD monitor 66 is executed using the bus B 3 and the SDRAM 54.
  • the resolution of YUV image data for HDTV is higher than the resolution of YUV image data for LCD monitors.
  • bus B 1 and SDRAM 32 are used for high-speed processing such as high-resolution video data processing, and bus B 3 and SDR for low-speed processing such as low-resolution video processing.
  • AM54 is used.
  • YUV image data read from the SDRAM 32 through the path B 1 is compressed by the MPEG codec 26 (first compression means).
  • the MPEG4 stream (fourth moving image data) created in this way is written to the SDRAM 32 through the bus B1.
  • High-speed compression processing is realized by transferring both the uncompressed YUV image data and the compressed MP EG 4 stream using the common path B1.
  • the MP EG 4 stream is then read from SDRAM 32 via bus B 1 and written to SDRAM 54 via path B 3. Thereafter, the MPEG4 stream is read from the SDRAM 54 through the bus B 3 and recorded on the memory card 64 (recording medium) by the card I / F 58 (moving image recording means).
  • the CCD output circuit 38 second processing means
  • YUV image data second still image data
  • Is converted to The converted YUV image data is written to the SD RAM 54 through path B 3, and then subjected to JPEG compression and memory power. — Recorded at 58.
  • a CCD imager is used as the image sensor, but other image sensors such as a CMOS imager may be adopted instead.
  • the J PEG method is adopted as a still image compression method, but the J PEG 2000 method may be adopted instead.
  • the MP EG 4 system is adopted as the moving picture compression system, but other video compression systems such as the MJ PEG system, the MJ PEG2000 system, or the H.264 system are employed instead. May be.

Abstract

La présente invention concerne un dispositif de traitement d’image (10) comprenant un bus (B1) et un bus (B2). Une série de traitements destinés à créer des données d’image YUV pour HDTV sont exécutés à l’aide du bus (B1) et d’un SDRAM (32). Une série de traitements destinés à créer les données d’image YUV pour un moniteur à cristaux liquides (66) sont exécutés à l’aide du bus (B3) et d’un SDRAM (54). La résolution des données d’image YUV pour HDTV est supérieure à celle des données d’image YUV du moniteur à cristaux liquides. Le bus (B1) et le SDRAM (32) sont utilisés pour traiter les données d’image animée à haute résolution et le bus (B3) et le SDRAM (54) sont utilisés pour traiter les données d’image animée à faible résolution.
PCT/JP2005/018228 2004-12-17 2005-09-26 Dispositif de traitement d’image WO2006064604A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11/792,481 US8072643B2 (en) 2004-12-17 2005-09-26 Image processing apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004-365820 2004-12-17
JP2004365820A JP4118272B2 (ja) 2004-12-17 2004-12-17 画像処理装置

Publications (1)

Publication Number Publication Date
WO2006064604A1 true WO2006064604A1 (fr) 2006-06-22

Family

ID=36587668

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2005/018228 WO2006064604A1 (fr) 2004-12-17 2005-09-26 Dispositif de traitement d’image

Country Status (3)

Country Link
JP (1) JP4118272B2 (fr)
CN (1) CN101061531A (fr)
WO (1) WO2006064604A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BRPI0809662A2 (pt) 2007-04-11 2014-10-14 Red Com Inc Câmaras de vídeo e métodos de gravação de vídeo de movimento com câmara e de processamento de imagens
US8237830B2 (en) 2007-04-11 2012-08-07 Red.Com, Inc. Video camera
WO2014127153A1 (fr) 2013-02-14 2014-08-21 Red. Com, Inc. Caméra vidéo
US11019336B2 (en) 2017-07-05 2021-05-25 Red.Com, Llc Video image data processing in electronic devices

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09319352A (ja) * 1996-05-28 1997-12-12 Oki Electric Ind Co Ltd ディスプレイ制御回路
JP2002247517A (ja) * 2001-02-14 2002-08-30 Sanyo Electric Co Ltd ディジタルカメラ

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09319352A (ja) * 1996-05-28 1997-12-12 Oki Electric Ind Co Ltd ディスプレイ制御回路
JP2002247517A (ja) * 2001-02-14 2002-08-30 Sanyo Electric Co Ltd ディジタルカメラ

Also Published As

Publication number Publication date
JP4118272B2 (ja) 2008-07-16
JP2006171524A (ja) 2006-06-29
CN101061531A (zh) 2007-10-24

Similar Documents

Publication Publication Date Title
JP4131052B2 (ja) 撮像装置
US8072643B2 (en) Image processing apparatus
US20120327285A1 (en) Electronic camera for producing quickview images
JP4253881B2 (ja) 撮像装置
US8005342B2 (en) Digital camera
JP4261673B2 (ja) デジタル出力可能な電子内視鏡装置
US7236194B2 (en) Image signal processing apparatus
WO2006064604A1 (fr) Dispositif de traitement d’image
JP3893441B2 (ja) 表示装置およびその制御方法
JP4158245B2 (ja) 信号処理装置
JP2000152051A (ja) 撮像装置
JP2713295B2 (ja) 固体撮像素子の駆動方法と撮像装置
JP2000092349A (ja) 画像処理装置
JP2000115693A (ja) 画像データ記録方法、画像データ記録装置、画像データ再生方法、画像データ再生装置、情報記録媒体及びコンピュータ読み取り可能な記録媒体
JP2000115694A (ja) 画像データ記録方法、画像データ記録装置、画像データ再生方法、画像データ再生装置、情報記録媒体及びコンピュータ読み取り可能な記録媒体
JP3745605B2 (ja) 電子スチルカメラ
JPH07322114A (ja) 撮像装置
JPH0884299A (ja) 固体撮像装置
JP3777723B2 (ja) 電子スチルカメラ
JPH10145650A (ja) 撮像装置
JP2000278677A (ja) 電子内視鏡装置
JP2003143562A (ja) 映像信号伝送方法及び映像信号伝送装置
JPH11239284A (ja) 撮像方法及び撮像装置
JPH06209435A (ja) 画像入出力伝送システム
JPH11191859A (ja) 撮像装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 200580039175.2

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 11792481

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 05788329

Country of ref document: EP

Kind code of ref document: A1

WWW Wipo information: withdrawn in national office

Ref document number: 5788329

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 11792481

Country of ref document: US