KR100754223B1 - Apparatus for image processing and method thereof - Google Patents

Abstract

Provided are an image processing apparatus and method capable of recording or reproducing an image in a standard format of a television during high speed photography. An image processing apparatus according to the present invention includes an imaging means 111 for imaging a subject in a first period to generate a first image, and a second image 301 by arranging a plurality of first images generated by the imaging means. Image generating means (113) and (127) for generating an image, and storage means (128) for storing a second image sequentially generated by the image generating means in a second period, wherein the second period is a first period. Longer than one cycle, the second image is an image determined by a predetermined television standard.

Description

Apparatus for image processing and method

1 is a block diagram showing a schematic configuration of a video recording apparatus according to the present embodiment.

2 is an explanatory diagram showing a schematic configuration of a captured image according to the present embodiment.

3A is an explanatory diagram showing an example of a schematic configuration of a multi-image according to the present embodiment.

3B and 3C are explanatory diagrams showing schematic structural modifications of the multi-image according to the present embodiment.

4 is a block diagram showing a schematic configuration of a video reproducing apparatus according to the present embodiment.

5 is an explanatory diagram showing an outline of normal reproduction or high speed photographic reproduction by the video reproducing apparatus according to the present embodiment.

<Explanation of symbols for main parts of the drawings>

101 Video Recorder

102 Video playback device

111 Imaging Section

112 sync signal generator

113 control unit

114 video signal amplifier

115 A / D Converter

116 Video signal processor

117 exchange switch

127 memory

128 registers

131 Playback

133 resolution converter

135 video encoder

137-1, 137-2 DAC

The present invention relates to image processing, and more particularly, to an image processing apparatus and method capable of high-speed imaging.

Recent advances in digital technology have made it possible to shoot at high speeds faster than usual. For example, in sports such as baseball and golf, slow motion reproduction of the form of the player has been utilized.

In the case of high-speed photography, it is necessary to obtain a signal having a frequency band equivalent to that of the standard television signal by the image speed. For example, in the case of imaging at a scanning speed of 3 times, a data rate of 3 times that of a standard television signal is required as the output of a camera (for example, see Japanese Patent Laid-Open No. 6-169419).

However, since the television signal output from the camera is different from the format of a normal video signal, it is not universal, and the transmission means for transmitting the signal and the recording means for recording the image were high-speed imaging imaging apparatuses. In addition, there is a problem that the configuration of the imaging device is large in size and very expensive.

In addition, since the image recorded by the high speed shooting is incompatible, the playback device may not reproduce the image recorded by the high speed shooting, and the user may not be able to check the image.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to perform an image processing apparatus and method capable of recording an image in a standard standard of a television at the time of high-speed photography, and to execute the image processing method on a computer. A computer readable recording medium having a program recorded thereon is provided.

Another technical problem to be solved by the present invention is an image processing apparatus and method capable of reproducing an image to a standard standard of a television during high-speed shooting, and a computer-readable recording medium recording a program for executing the image processing method on a computer. To provide.

An image processing apparatus for achieving the above technical problem comprises: an imaging unit configured to generate a first image by photographing a subject in a first period; An image generation unit arranged to arrange a plurality of first images generated by the image pickup unit to generate a second image determined by a television standard; And a storage unit for storing the second image sequentially generated by the image generation unit in a second period longer than the first period.

The image processing method for achieving the technical problem comprises the steps of: photographing a subject in a first period to generate a first image; Sequentially arranging the generated first images to sequentially generate a second image defined by a television standard; And storing the sequentially generated second image in a second period longer than the first period.

According to another aspect of the present invention, an image processing apparatus includes a second image having a television standard generated by arranging a plurality of first images generated by photographing a subject in a first period, in a second period longer than the first period. A second image reading unit to read out; And a first image reading unit configured to sequentially read out the plurality of first images included in the second image.

According to another aspect of the present invention, there is provided a method of processing a second image having a television standard generated by arranging a plurality of first images generated by photographing a subject in a first period, in a second period longer than the first period. Reading; And reading out the plurality of first images included in the second image in order.

In order to solve the above problems, imaging means for imaging a subject in a first period to generate a first image, image generating means for arranging a plurality of first images generated by the imaging means to generate a second image, and an image Storage means for storing the second image sequentially generated by the generating means in a second period, wherein the second period is longer than the first period, and the second image is an image determined by a predetermined television standard. An image processing apparatus is provided.

The second image may be a high definition (HD) image. In addition, the said HD image is an image, such as 1920x1080 pixel or 1280x720 pixel, for example.

The second image may be configured such that the first image includes one or two or more pairs of units arranged in a row from left to right. By the above configuration, the visibility to the second image is improved.

According to another aspect of the present invention for solving the above problems, there is provided a computer program characterized in that a computer functions as the image processing apparatus.

According to another aspect of the present invention, in order to solve the above problems, a first image is generated by capturing a subject in a first period, and a second image generated by arranging a plurality of the first images is read out in a second period. Is provided with a second image reading means, the second period is longer than the first period, and the second image is an image determined to a predetermined television standard.

The second image may be configured such that the first image includes one or two or more pairs of units arranged in a row from left to right. The second image may be an HD image.

The image processing apparatus may further include first image reading means for reading out the first image included in the second image in order.

The image processing apparatus may further include resolution converting means for converting the resolution of the first image read out by the first image reading means into a predetermined resolution. In addition, the predetermined resolution may exemplify, for example, the resolution of an SD (Standard Definition) image. According to the above configuration, it is possible to display the first image after conversion to a TV or the like which is widely used for displaying an SD image.

According to another aspect of the present invention for solving the above problems, there is provided a computer program characterized in that a computer functions as the image processing apparatus.

EMBODIMENT OF THE INVENTION Hereinafter, preferred embodiment of this invention is described in detail, referring an accompanying drawing. In addition, in the following description and attached drawings, the component which has substantially the same function and a structure is attached | subjected with the same code, and the overlapping description is abbreviate | omitted.

(About the video recording device 101)

First, the video recording apparatus 101 according to the present embodiment will be described with reference to FIG. 1 is a block diagram showing the schematic configuration of the video recording apparatus 101 according to the present embodiment.

The video recording device 101 shown in FIG. 1 is a device capable of recording an image generated by photographing a subject.

Furthermore, in this embodiment, the image to be recorded is shown below taking the case of HD which is a standard standard as an example. In this case, the HD standard will be described taking the case of an interlaced image of 1080 / 60i of 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction as an example.

As shown in FIG. 1, the image recording apparatus 101 includes an image capturing unit 111, a synchronization signal generating circuit 112, a controller 113, an image signal amplifier 114, an A / D converter 115, A video signal processor 116, an exchange switch 117, a memory 127, and a recorder 128 are provided.

The imaging unit 111 includes a zoom, a wide photographing function, and the like, and outputs a video signal to the video signal amplifier 114 in accordance with the synchronization signal from the synchronization signal generating circuit 112. Moreover, the imaging part 111 is equipped with the imaging element (imaging device) at least.

In addition, the imaging device may photoelectrically convert an optical image received from a subject by a plurality of pixels including photoelectric conversion elements provided two-dimensionally on a light receiving surface, and output the electrical image signal. For example, a solid-state imaging device, such as CCD which consists of several types, is mentioned as an imaging element.

The synchronizing signal generating circuit 112 generates a synchronizing signal based on the frame frequency serving as a reference when the image capturing unit 111 picks up the image. For example, the synchronization signal generated by the synchronization signal generating circuit 112 has a frame frequency of about HD of about 30 Hz, and in high-speed imaging, for example, a predetermined multiple of 30 Hz (30 × 6 = 180 Hz). Etc.).

The control unit 113 includes an image capturing unit 111, a synchronization signal generating circuit 112, a video signal amplifier 114, an A / D converter 115, and a video signal processing unit 116 of the video recording device 101. Control of the exchange switch 117, the memory 127, and the recording unit 128.

The video signal amplifier 114 outputs the signal output from the imaging unit 111 at the time of high speed imaging to the A / D converter 115 by raising the gain as compared with normal HD imaging. The gain is increased because the charge of the image pickup device is short in high-speed photography, and the image becomes dark.

The A / D converter 115 outputs a video signal obtained by A / D conversion of the video signal output by the video signal amplifier 114 from an analog signal to a digital signal to the video signal processor 116.

The image signal processor 116 performs image processing on the RGB image signal output by the A / D converter 115. The video processing is, for example, converting an RGB video signal output by the A / D converter 115 into an HD standard video signal of Y / Pb / Pr.

The exchange switch 117 may output the video signal to the memory 127 once, output the data to the recording unit 128 as it is, or change one of the two to switching control by the controller 113. Further, by outputting a video signal to the memory 127, a multi-image can be generated, and the multi-image can be output to the recording unit 128, which will be described later.

The memory 127 is a storage means having a storage area of a predetermined size. The memory 127 stores an image output from the video signal processing unit 116.

The video signal processed by the video signal processing unit 116 is transmitted to a recording unit 128 capable of recording a digital image of HD. The recording unit 128 may include, for example, a storage unit such as a magnetic disk or a semiconductor memory in the device itself, and may store HD video information or the like in the storage unit, and can be attached or detached to the recording unit 128 (tape, The recording unit 128 may be recorded on an optical disk, a magnetic disk, or a semiconductor memory.

Next, the picked-up image which concerns on this embodiment is demonstrated with reference to FIG. Moreover, FIG. 2 is explanatory drawing which shows schematic structure of the picked-up image which concerns on this embodiment.

As shown in FIG. 2, the image normally picked up by the imaging unit 111 becomes an image 201 of HD standard consisting of 1920 × 1080.

In addition, as shown in FIG. 2, in the case of high speed photography, the image picked up by the imaging unit 111 becomes an image 203 corresponding to VGA of 640 × 480.

For example, the synchronization signal generating circuit 112 is synchronized so that only 640 pixels (horizontal direction) x 480 pixels (vertical direction) at the center of the imaging elements provided in the imaging unit 111 are read out by the imaging unit 111. When the signal is changed, the image 203 can be read out by doubling the frame frequency without changing the read frequency of the pixel from the HD frequency. In this way, high-speed shooting at 6x speed can be realized. Optically, for example, the zoom amount of the imaging unit 111 is adjusted to the wide side so as to fit in the imaging area of 640x480.

Accordingly, in the case of high speed photography, the image capturing unit 111 captures a subject and outputs an image signal of the image 203 to the image signal amplifier 114. The image output by the video signal amplifier 114 is output to the memory 127 through the A / D converter 115 and the video signal processor 116 as described above.

In addition, in the video recording apparatus 101 according to the present embodiment, when the user receives an instruction from the user with an input button, for example, which image mode to select from normal shooting or high speed shooting, the control unit 113 receives the imaging unit 111. Give high-speed or normal shooting instructions to each part.

Moreover, although the video recording apparatus 101 which concerns on this embodiment was demonstrated to the example which is the apparatus which can capture and image recording from either normal photography or high speed photography, it is not limited to the said example, For example, video The recording apparatus 101 can be implemented even in the case of a device capable of only high speed shooting and image recording.

(About a multi-image)

Next, the multi-image concerning this embodiment is demonstrated with reference to FIG. 3A. Moreover, FIG. 3A is explanatory drawing which shows an example of schematic structure of the multi-image which concerns on this embodiment.

When recording high speed photography, a plurality of images 203 as shown in FIG. 3A, for example, are embedded by the control unit 113 using the memory 127 before the recording process by the recording unit 128. One multi-image 301 is created.

More specifically, as described above with reference to Fig. 2, the 640 x 480 image 203 is divided into one area of A area, B area, C area,... Six images 203-1 to 203-6 are arranged up to the F area in the order of M to generate the multi-image 301. Furthermore, as shown in Fig. 3A, since the image 301 is an HD image composed of 1920x1080, even if six images 201 are arranged, some of the image area is redundant.

The multi-image 301 is recorded in the recording unit 128 in the same manner as in the normal HD image.

Furthermore, as illustrated in FIG. 3A, the multi-image 301 according to the present embodiment has been described taking the case where six images 203 are included as an example. However, the multi-image 301 includes one or two or more images 203. ) May be included.

In addition, as illustrated in FIG. 3A, the multi-image 301 has a case in which two pairs of units consisting of three images 203 are arranged in a horizontal line exist as an example, but the present invention is not limited thereto. For example, the multi-image 301 can be implemented even when there are one or two or more pairs of units composed of one or two or more images 203 in a horizontal line.

In addition to the multi-image 301 shown in FIG. 3A, for example, as shown in FIG. 3B, the multi-image 301 including four images 203 so as not to overlap with the image 203 on the top, bottom, left and right sides, and FIG. Similarly, the multi-image 301 including the six images 203 may be used so as not to overlap the images 203 on the top, bottom, left and right sides.

The video recording apparatus 101 according to the present embodiment has excellent effects as described below.

(1) In either normal shooting or high speed shooting, the recording unit 128 can record an HD image (multi-image 301 in high-speed shooting) as a standard.

(2) Since the recording unit 128 records the multi-image 301 which is an HD image, the recording mechanism is not complicated, so that the video recording apparatus 101 can be prevented from being enlarged and the production cost can be reduced.

(3) Conventionally, since bit reduction is performed at the time of high speed photography, the recording rate needs to be reduced and the image quality is poor. However, the video recording apparatus 101 according to the present embodiment can shoot high speed without degrading the image quality.

(About the video reproduction device 102)

First, the video reproducing apparatus 102 according to the present embodiment will be described with reference to FIG. 4 is a block diagram showing a schematic configuration of the video reproducing apparatus 102 according to the present embodiment.

The video reproducing apparatus 102 shown in Fig. 4 is a device capable of reproducing an already recorded image and outputting the image to a display unit (screen) corresponding to a display apparatus or the like. Furthermore, the image according to the present embodiment can exemplify a moving image or the like.

In the present embodiment, the image to be recorded is shown below, taking the case of HD as an example. In this case, the HD standard will be described taking the case of an interlaced image of 1080 / 60i of 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction as an example.

As shown in FIG. 4, the video reproducing apparatus 102 includes a control unit 113a, an exchange switch 117a, a memory 127a, a playback unit 131, a resolution converter 133, a video encoder 135, DA converters (DAC) 137-1 and 137-2 are provided.

The control unit 113a processes the switch 117a, the memory 127a, the playback unit 131, the resolution converter 133, the video encoder 135, and the DAC 137 of the video reproducing apparatus 102. To control.

The exchange switch 117a outputs the video signal read out by the playback unit 131 to the memory 127a, or to the DAC 137-1 as it is, or sends either one to the control unit 113a. Can be switched to the switching control. Furthermore, by outputting the multi image 301 to the memory 127a, the video reproducing apparatus 102 extracts each of the images 203 included in the multi image 301 and outputs the image to the DAC 137-2. However, details will be described later.

The resolution converting unit 133 converts the resolution of the image 203 when each image 203 included in the multi-image 301 is transmitted. For example, the resolution converter 133 may convert the horizontal resolution of the 640 × 480 pixel image 203 output from the memory 127a and convert the image into a 720 × 480 pixel image. In other words, the image converted from the image 203 by the resolution converting unit 133 corresponds to an image of an NTSC signal which is a standard of television.

The reproducing unit 131 may include, for example, a storage device such as a magnetic disk or a semiconductor memory in the device, and may read out an image such as the multi-image 301 of HD recorded in the storage device. The reproduction unit 131 may read out an image recorded on a recording medium (tape, optical disk, magnetic disk, semiconductor memory, or the like) that can be attached to and detached from the 131.

The DACs 137-1 and 137-2, when the video signal is converted to be output to the display unit by the video encoder 135, displays the video signal obtained by converting the video signal from a digital signal to an analog signal. Output at the time). The image may be output on the screen of the display unit, and the image reproducing apparatus 102 may reproduce the image.

Furthermore, for example, a television (TV), a liquid crystal display device, or the like is exemplified, and the display unit can output a still image or the like in addition to a moving image or an audio.

More specifically, the DAC 137-1 converts a digital signal into a component signal of Y / Pb / Pr made of analog and outputs it as an HD image. The DAC 137-2 converts a digital signal into an analog signal and outputs it as a composite signal of Y / Cb / Cr, which is a video signal of SD, or a composite signal of Y / C.

As shown in Fig. 5A, in the normal playback mode, a frame image composed of two field images per frame as an HD image is sequentially output on the screen.

That is, as shown in Fig. 5A, the field image 1-1 of the first frame, the field image 1-2, the field image 2-1 of the second frame, and the field image 2-2),… Are played in order as shown.

In the high-speed shooting reproduction mode in which each of the high-speed photographed images 203 is reproduced, slow motion is reproduced at a reproduction speed of normal reproduction 1/6.

That is, as shown in the upper part of Fig. 5B, the frame image composed of the field image 1-1 and the field image 1-2 is repeatedly output six times. As shown in the lower part of Fig. 5 (b), the images 203 are cut out and read out sequentially from the one-frame multi-image 301, so that all six images 203 present in the multi-image 301 are in order. Is played back.

Moreover, FIG. 5 is explanatory drawing which shows the outline of normal reproduction or high speed image | photographic reproduction by the video reproducing apparatus 102 which concerns on this embodiment.

As described above, the resolution of the 640x480 pixels 203 read from the memory 127a is converted by the resolution converting unit 133 in the horizontal resolution. Therefore, for example, the SD image can be easily reproduced by converting a 720 x 480 pixel video signal, that is, an NTSC signal that is a television signal of a standard standard. In this way, high-speed imaging of SD quality can be obtained by encoding the NTSC signal.

Furthermore, the video reproducing apparatus 102 according to the present embodiment has been described taking as an example a system that outputs 6 times high speed shooting as a 720 × 480 / 60i NTSC signal using a 1920 × 1080 / 60i system. For example, the video reproducing apparatus 102 converts the horizontal and vertical resolutions of the 640x480 image 203 using 1920x1080 / 50i images to convert 720x576 / 50i images. This can also be done when outputting as a PAL signal.

Unlike the video reproducing apparatus 102 according to the present embodiment, even in the case of a reproducing apparatus or the like which does not correspond to the high speed shooting reproducing mode and cannot reproduce in slow motion, the reproducing apparatus displays the multi-image 301 in the normal reproducing mode as it is. It can be output on the screen as an image.

In the video reproducing apparatus 102 according to the present embodiment, there are excellent effects as described below.

(1) Since the image read out by the reproduction unit 131 is an HD image, the production cost can be reduced by preventing the system of the image reproducing apparatus 102 from becoming large.

(2) Even if the playback device does not correspond to the high-speed shooting reproduction mode, the recorded image is an HD image, so that the user can confirm the recorded content if the playback device is HD compatible.

(3) Since bit reduction has not been performed on each of the high-speed photographed images 203, it is possible to improve the image quality of the image displayed on the screen.

Moreover, the above-described series of processes may be performed by dedicated hardware or by software. When a series of processes are performed by software, a program constituting the software is installed in an information processing apparatus such as a general purpose computer or a microcomputer, and the information processing apparatus is installed in the video recording apparatus 101 and / or video reproducing apparatus ( 102).

As mentioned above, although preferred embodiment of this invention was described with reference to an accompanying drawing, this invention is not limited to the said example. It will be apparent to those skilled in the art that various modifications or changes can be made within the scope of the technical idea described in the claims, and they are naturally understood to belong to the technical scope of the present invention.

In the above embodiment, the video recording apparatus 101 has described a case where an image generated by capturing an object can be recorded as an example, but the present invention is not limited to the above example. For example, the video recording device 101 may be provided with a reproduction function for outputting the recorded image to an output device such as a display device together with the recording function.

In the above embodiment, the video reproducing apparatus 102 has described the case in which the recorded image can be outputted to and reproduced by an output device such as a display apparatus as an example, but the present invention is not limited to the above example. For example, the video reproducing apparatus 102 may have a recording function for recording an image generated by photographing a subject together with the reproduction function.

In the above embodiment, the imaging unit 111 provided in the video recording apparatus 101, the synchronization signal generating circuit 112, the control unit 113, the video signal amplifier 114, the A / D converter 115, Although the video signal processing unit 116, the exchange switch 117, the memory 127, and the recording unit 128 are made of hardware as an example, the present invention is not limited to the above examples. For example, the imaging unit 111, the synchronization signal generating circuit 112, the control unit 113, the image signal amplifier 114, the A / D conversion unit 115, the image signal processing unit 116, and the exchange switch 117. ), At least one of the memory 127 or the recording unit 128 may be a program consisting of one or more modules or components.

In the above embodiment, the control unit 113a, the exchange switch 117a, the memory 127a, the playback unit 131, the resolution converter 133, the video encoder 135, and the like provided in the video reproducing apparatus 102 Although the DAC 137 has been described taking the case of hardware as an example, the present invention is not limited to the above example. For example, at least one of the control unit 113a, the exchange switch 117a, the memory 127a, the playback unit 131, the resolution converter 133, the video encoder 135, or the DAC 137 may be 1 or the like. This may be the case of a program composed of two or more modules or components.

The present invention can be embodied as code that can be read by a computer (including all devices having an information processing function) on a computer-readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable recording devices include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like.

Although the foregoing description has been focused on the novel features of the invention as applied to various embodiments, those skilled in the art will appreciate that the apparatus and method described above without departing from the scope of the invention. It will be understood that various deletions, substitutions, and changes in form and detail of the invention are possible. Accordingly, the scope of the invention is defined by the appended claims rather than in the foregoing description. All modifications within the scope of equivalents of the claims are to be embraced within the scope of the present invention.

As described above, according to the present invention, it is possible to record or reproduce an image in standard television standards at the time of high speed photography. It also has the following effects:

At the time of recording, (1) either normal shooting or high-speed shooting can be recorded by the recording unit 128 in the HD standard image (multi-image 301 during high-speed shooting), and (2) the recording unit 128 Since the recording mechanism is not complicated because the multi-image 301 which is an HD image is recorded, it is possible to prevent the image recording apparatus 101 from being enlarged and to reduce the production cost. (3) In the related art, bit reduction is performed during high-speed shooting. Therefore, although the recording rate needs to be reduced and the image quality is poor, the video recording apparatus 101 according to the present embodiment can shoot at high speed without compromising image quality.

At the time of reproduction, since (1) the image read out by the reproduction unit 131 is an HD image, it is possible to reduce the production cost by preventing the system of the image reproducing apparatus 102 from becoming large, and (2) the high speed shooting reproduction mode. Since the recorded image is an HD image, even if the playback apparatus does not support, the user can check the recorded content if the playback apparatus is HD compatible. (3) Bit reduction was not performed for each of the high-speed photographed images 203. Therefore, the image quality of the image displayed on the screen can be improved.

Claims (11)

An imaging unit which generates a first image by photographing a subject in a first period; An image generation unit arranged to arrange a plurality of first images generated by the image pickup unit to generate a second image determined by a television standard; And And a storage unit for storing the second image sequentially generated by the image generation unit in a second period longer than the first period. The image processing apparatus of claim 1, wherein the second image is a high definition (HD) standard image. A second image reading unit for reading a second image having a television standard generated by arranging a plurality of first images generated by photographing a subject in a first period in a second period longer than the first period; And And a first image reading unit configured to sequentially read out the plurality of first images included in the second image. The image processing apparatus of claim 3, wherein the second image is a high definition (HD) standard image. The image processing apparatus according to claim 3, further comprising a resolution converting unit for converting the resolution of the first image read out by the first image reading unit into a resolution corresponding to an image of a television standard. Imaging the subject in a first period to generate a first image; Sequentially arranging the generated first images to sequentially generate a second image defined by a television standard; And And storing the sequentially generated second image in a second period longer than the first period. The image processing method of claim 6, wherein the second image is an image of a high definition (HD) standard. Reading a second image having a television standard generated by arranging a plurality of first images generated by photographing a subject in a first period in a second period longer than the first period; And And reading out the plurality of first images included in the second image in order. The image processing method of claim 8, wherein the second image is a high definition (HD) standard image. 9. The image processing method according to claim 8, further comprising converting the resolution of the read first image into a resolution corresponding to an image of a television standard. A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 6 to 10 on a computer.

Images