KR20110072846A - Supervisory camera apparatus and video data processing method - Google Patents

Abstract

PURPOSE: A monitoring camera apparatus and an image data processing method are provided to crop the ROI of a predetermined size and transmit the cropped ROI after the high definition photographing of a monitoring region. CONSTITUTION: An ROI(Region Of Interest) selection unit(22) selects ROI with the global search of the output source image frame of an image sensor. A cropping unit(24) crops an area having a size suitable for transmission capacity from the source image frame on the basis of the selected ROI. An output unit(26) transmits image data corresponding to a cropping area to a remote image system.

Description

Surveillance camera apparatus and video data processing method

The present invention relates to a surveillance camera device, and more particularly, to a surveillance camera device and a video data processing method capable of high-resolution image acquisition and transmission.

Surveillance camera systems for preventing theft or monitoring the surroundings are installed and operated in parking lots, banks and public buildings as well as private homes.

The surveillance camera system is a system for recognizing an object and monitoring a specific area by processing an image inputted through a surveillance camera device installed at a specific place or mobilely. Such a surveillance camera system can detect and track intruders by long / short distance and day / night remote control using a surveillance camera device. Surveillance camera systems having such a function can be used for surveillance and tracking of dangerous areas or illegal parking control.

The surveillance camera apparatus used in the conventional surveillance camera system photographs most of the surveillance region according to the installed position, not photographing the subject of interest. In this case, the surveillance camera device acquires image data captured at a low resolution while having a wide angle to capture a wider surveillance area due to limitations in storage capacity and transmission capacity. As a result, even if a subject intrudes in the surveillance area, the surrounding environment including the subject is included together, making it difficult to identify the subject and obtaining accurate evidence. have.

The background art described above is technical information possessed by the inventors for the derivation of the present invention or acquired during the derivation process of the present invention, and is not necessarily a publicly known technique disclosed to the general public before the application of the present invention.

The present invention is to provide a surveillance camera apparatus and image data processing method that overcomes the limitations of storage capacity and transmission capacity by transmitting a cropping area of interest of a predetermined size after taking a high-resolution recording of the surveillance area; will be.

Another object of the present invention is to provide a surveillance camera device and an image data processing method for easily identifying an object and obtaining accurate evidence by obtaining high resolution image data of a region of interest.

Another object of the present invention is to provide a surveillance camera apparatus and an image data processing method capable of digitally tracking a surveillance target while using an image sensor having a wide viewing angle.

Other objects of the present invention will be readily understood through the following description.

According to an aspect of the invention, the image sensor for generating and outputting the original image frame corresponding to the predetermined surveillance area; And a digital signal processor which crops and outputs a region of interest selected in the original image frame.

The digital signal processor may include a region of interest selection unit for searching and selecting the region of interest through a global search for the original image frame, and a cropping unit for cropping the selected region of interest within the original image frame. And an output unit configured to output image data corresponding to the cropping region cropped by the cropping unit. The region of interest may be a region having a singularity including at least one of a region where a movement occurs, a region recognized by a human face, and a region recognized by a license plate of a vehicle.

In addition, the original image frame may have a megapixel size, and the cropping area may have a size of VGA or D1 or less.

Alternatively, the digital signal processor may include a subsampling unit performing subsampling on the original image frame, and an interest of searching and selecting the ROI with respect to the image frame subsampled by the subsampling unit. A region selection unit, a cropping unit performing cropping on the selected region of interest in the original image frame, image data corresponding to the cropping region cropped by the cropping unit, and the subsampled image frame. It may include an output unit for outputting one or more. The region of interest may be a region having a singularity including at least one of a region where a movement occurs, a region recognized by a human face, and a region recognized by a license plate of a vehicle.

The original video frame may have a megapixel size, and the subsampled area may have a VGA size or a D1 size. In addition, the cropping area may have a size of VGA or D1 or less.

When the output unit has one output port, the image data corresponding to the cropping region and the subsampled image frame are alternately outputted, and when the output unit has two or more output ports, the cropping region The image data corresponding to the subsampled image frame may be output at the same time.

According to another aspect of the present invention, there is provided a method for processing image data in a digital signal processor connected to a rear end of an image sensor that generates and outputs an original image frame corresponding to a predetermined surveillance region, and a program for performing the method. A recorded record carrier is provided.

According to one or more exemplary embodiments, a method of processing image data includes: (a) receiving an original image frame for the surveillance region output from the image sensor; (b) searching and selecting a region of interest by performing a global search on the original image frame; (c) performing cropping in the original image frame corresponding to the selected region of interest; And (d) outputting image data corresponding to the cropped region.

In the step (b), a region having a singularity including at least one of a region where a movement occurs, a region recognized as a human face, and a region recognized as a license plate of the vehicle may be searched and selected as the region of interest.

The original image frame may have a megapixel size, and the cropped region may have a size of VGA or D1 or less.

According to another exemplary embodiment, an image data processing method includes: (a) receiving an original image frame for the surveillance area output from the image sensor; (b) performing subsampling on the original image frame; searching and selecting the ROI with respect to the subsampled image frame; (d) performing cropping on the selected region of interest within the original image frame; And (e) outputting one or more of image data corresponding to the cropped region and the subsampled image frame.

In step (c), a region having a singularity including at least one of a region where a movement occurs, a region recognized by a human face, and a region recognized by a license plate of the vehicle may be searched and selected as the region of interest.

The original video frame may have a megapixel size, and the subsampled area may have a VGA size or a D1 size. In addition, the cropped area may have a size of VGA or D1 or less.

In the step (e), when the digital signal processor includes one output port, image data corresponding to the cropped region and the subsampled image frame are alternately outputted, and the digital signal processor When two or more output ports are provided, image data corresponding to the cropped region and the subsampled image frame may be simultaneously output.

Other aspects, features, and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

According to an exemplary embodiment of the present invention, after capturing a surveillance area at a high resolution, cropping and transmitting a region of interest having a predetermined size may overcome limitations of storage capacity and transmission capacity.

In addition, by acquiring high resolution image data of the ROI, it is possible to easily identify a subject that requires a movement, a face of a person, a license plate of a vehicle, etc., and to secure accurate evidence.

In addition, while using an image sensor having a wide viewing angle, there is an effect that can be digitally tracked.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and scope of the present invention. In the following description of the present invention, if it is determined that the detailed description of the related known technology may obscure the gist of the present invention, the detailed description thereof will be omitted.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. As used herein, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Also, the term "part" or the like, as described in the specification, means a unit for processing at least one function or operation, and may be implemented by hardware, software, or a combination of hardware and software.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of a surveillance camera device and an imaging system according to an embodiment of the present invention, Figure 2 is a block showing the configuration of a digital signal processor included in a surveillance camera device according to an embodiment of the present invention It is also.

The surveillance camera device 1 according to an embodiment of the present invention obtains high resolution image data for a surveillance region and then crops a region of interest (ROI) of a predetermined size corresponding to a transmission capacity. ) And transmit the cropped image data to the remotely located image system 50.

Referring to FIG. 1, a surveillance camera device 1 according to an embodiment of the present invention includes an image sensor 10 and a digital signal processor 20.

The image sensor 10 generates and outputs an image signal corresponding to an external image. The output video signal is a high resolution image frame, and has a high resolution of VGA level (640X480) or D1 level (720X480), for example, megapixel level (1.3 to 8M), and is referred to as an original image frame.

The image sensor 10 may have various frame rates (fps) and has a viewing angle characteristic of wide angle (eg, 180 °).

The digital signal processor 20 transmits image data having a size suitable for a transmission capacity, which is a result of performing digital signal processing based on the image signal output from the image sensor 10, to the image system 50 located remotely.

According to an embodiment of the present invention, the original video frame has a megapixel size, and when the original video frame is transmitted to the remotely located video system 50 as it is, the bottleneck (bottleneck) due to the limitation of the transmission capacity This phenomenon can occur and requires a large storage capacity.

Therefore, the digital signal processor 20 overcomes the limitations of the transmission capacity and the storage capacity by cropping and transmitting an area having a size suitable for the transmission capacity in the original image frame for the surveillance region captured by the image sensor 10. You can do it. To this end, the digital signal processor 20 needs to search for and select a region of interest to be cropped.

Referring to FIG. 2, the digital signal processor 20 according to an embodiment of the present invention includes a region of interest selector 22, a cropping unit 24, and an output unit 26.

The ROI selector 22 searches for and selects an ROI through global search for the original image frame output from the image sensor 10.

The ROI is a partial region in the original image frame that satisfies a predetermined condition.

The predetermined condition may be, for example, an original image such as one or more of an area where a movement beyond a threshold occurs, an area recognized as a face when the subject is a person, an area recognized by a license plate when the subject is a vehicle, and the like. When compared with other areas of the frame may be a region having a singularity.

For conditions related to motion, satisfaction may be determined through motion detection using a motion vector, and for conditions related to face recognition, satisfaction may be determined through face detection. Could be.

In this case, when a region of motion is selected as the region of interest, when motion is detected in a plurality of regions in the original image frame, a region having a lot of motion is selected as the region of interest or two or more regions in which the movement is detected are sequentially selected. Alternatively, you can select the area of interest at the same time. In addition, even when a region recognized as a face or a vehicle license plate is selected as the region of interest, when a face or a license plate is recognized in a plurality of regions in the original image frame, a relatively large region is selected as the region of interest or two or more regions recognized as a region of interest. Can be selected sequentially or simultaneously as the region of interest.

Alternatively, the ROI selecting unit 22 may select a plurality of regions divided into a predetermined size with respect to the entire original image frame as the ROIs sequentially or in any order.

The cropping unit 24 crops from the original image frame an area having a size suitable for the transmission capacity based on the ROI selected by the ROI selecting unit 22. Here, the size of the cropping area cropped by the cropping unit 24 may be VGA or D1 or less, which is the size of a general surveillance video frame.

The cropping area is preferably an area which overlaps with the ROI selected by the ROI selection unit 22 as much as possible. For example, the cropping region may be obtained by windowing a rectangular image frame having a vertical or horizontal VGA or D1 size having the center pixel of the ROI as the center pixel.

The cropping area corresponds to an image frame captured at a high resolution corresponding to the ROI satisfying the above-described predetermined condition, so that the user can easily identify the subject and ensure accurate evidence.

Auto exposure (AE) may be performed based on the cropping area to enable easier subject identification. For this purpose, the image sensor 10 may provide a predetermined frame rate (for example, 30 fps). It is desirable to have.

The output unit 26 transmits the image data corresponding to the cropping area to the image system 50 located remotely. The output by the output unit 26 is an NTSC / PAL method capable of transmitting video data of VGA level or D1 level, and is combined with a digital analog converter (DAC, Digital Analog Converter) to output analog signals through analog output lines, or YUV. It has an output format of and can be digitally output via LAN.

Here, the image data output from the output unit 26 may be moving image data having a predetermined frame rate. Therefore, the image data corresponding to the cropping region may be transmitted by compressing the image using the Moving Picture Experts Group 4 (MPEG4) or the H.264 standard.

The video system 50, which is connected to the surveillance camera device 1 by wire or / or wirelessly, receives the image data of the cropping area from the surveillance camera device 1 so that the region of interest is displayed on the display unit 70. . In addition, the surveillance camera device 1 and the imaging system 50 may be wired connected through one or more of an analog output line, a LAN, or the like, or wirelessly connected through wireless communication.

The video system 50 is a high-resolution recording system capable of recording and reproducing for a long time by compressing and restoring an image by using MPEG4 or H.264 standard on the image data transmitted from the surveillance camera device 1, which is a digital image. A storage device (DVR, Digital Video Recorder) 60, and a display unit 70 for displaying the video data reproduced by the digital image storage device (60).

When the image data output from the surveillance camera device 1 is an analog signal, the digital image storage device 60 may include an analog digital converter (ADC) for converting the analog signal into a digital signal.

The digital image storage device 60 stores image data output from the surveillance camera device 1 by using a storage unit such as a hard disk (HDD), a digital video disk (DVD), and in this case, the image data is stored as a digital signal. Because of this, it is easy to search and easy to edit and transfer images.

The digital signal processor according to the present embodiment may further include a buffer (not shown) for temporarily storing the original image frame output from the image sensor 10. The ROI may be selected and cropped with respect to the original image frame stored in the buffer, and may be updated with the subsequent original image frame output from the image sensor 10 after the cropping region is output by the output unit 26. Can be.

The digital signal processor according to the present embodiment may be implemented as one chip to provide a surveillance camera device having a simple configuration.

In the above description, the surveillance camera apparatus 1 performing global search on the original image frame output from the image sensor 10 when searching and selecting the ROI is described. Hereinafter, the ROI is searched at a higher speed. The surveillance camera device 1 that can be selected by way of example will be described with reference to the related drawings.

3 is a block diagram showing the configuration of a digital signal processor included in a surveillance camera device according to another embodiment of the present invention. Referring to FIG. 3, the digital signal processor 20 according to another embodiment of the present invention may include a subsampling unit 30, an ROI selecting unit 32, a cropping unit 34, and an output unit 36. Can be. Here, the region of interest selector 32, the cropping unit 34, and the output unit 36 perform the same or similar functions as those of the elements shown in FIG. 2, and the following description will focus on differences.

The subsampling unit 30 performs subsampling on an image signal output from the image sensor 10, that is, a high-resolution megapixel-level original image frame, and outputs a subsampled image frame.

The subsampling unit 30 first performs subsampling to generate a subsampled image frame whose size is reduced to D1 or VGA level or less when compared with the original image frame, and searches in the subsampled image frame. This allows a region of interest selection with a high accuracy while having a low accuracy.

Here, the subsampling unit 30 may perform subsampling to have a size suitable for a transmission capacity, that is, a VGA class or a D1 class, so that the subsampled image frame can be output by the output unit 26. . The subsampled image frame enables to check the entire image of the surveillance region photographed by the surveillance camera device 1 in a remotely located imaging system 50.

The ROI selector 32 searches for and selects an ROI with respect to the image frame subsampled by the subsampling unit 30. Since the search and selection of the ROI have been described in detail with reference to FIG. 2, the description thereof will be omitted.

The cropping unit 34 crops an area having a size suitable for a transmission capacity based on the original image frame based on the ROI selected by the ROI selecting unit 32. Cropping has also been described in detail with reference to FIG. 2 and will not be described herein.

The output unit 36 transmits the image data corresponding to the cropping area cropped by the cropping unit 34 to the remotely located image system 50.

In addition, the output unit 36 may transmit image data corresponding to the image frame subsampled by the subsampling unit 30 to the image system 50.

In this case, when there is only one output port, the cropping region and the subsampled image frame are alternately outputted. When there is more than one output port, one output port may be allocated to the output of the cropping region and the subsampled image frame. There will be.

The cropping area corresponds to an image frame captured in high resolution with respect to the ROI satisfying a predetermined condition, so that the user can easily identify the subject and ensure accurate evidence.

The subsampled image frame allows the user to check the outline of the entire surveillance area photographed by the surveillance camera device 1.

When the imaging system 50 receives both the image data corresponding to the cropping region and the subsampled image frame from the surveillance camera device 1, the imaging system 50 corresponds to the region of interest or the subsampled image frame corresponding to the cropping region. The user can select one of the entire surveillance zones to be displayed on the screen or display each of them sequentially. It can also be displayed.

The digital signal processor according to the present embodiment may further include a buffer (not shown) for temporarily storing the original image frame output from the image sensor 10. Subsampling, region of interest selection, and cropping may be performed on the original image frame stored in the buffer, and the image sensor 10 may be output after the output of the subsampled image frame or / and the cropping region by the output unit 26. Can be updated to the original image frame of the subsequent output.

The digital signal processor according to the present embodiment may also be implemented as a single chip to provide a surveillance camera device having a simple configuration.

4 is a flowchart illustrating a method of processing image data in a digital signal processor included in a surveillance camera device according to an embodiment of the present invention.

Surveillance camera device according to an embodiment of the present invention, as shown in Figure 1, comprises an image sensor and a digital signal processor. Each step described below may be performed by each internal component of the digital signal processor, but will be collectively described as a digital signal processor for convenience of understanding and description.

In operation S110, the digital signal processor receives an original image frame photographing a predetermined surveillance region output from the image sensor. The original video frame has a high resolution, for example megapixel size.

In operation S120, the digital signal processor searches for and selects a region of interest through the global search on the input original image frame.

The region of interest is a region within the original image frame that satisfies a predetermined condition, and may be a region in which a movement occurs or a singularity such as a face of a person or a vehicle license plate of a vehicle. When a plurality of areas having singularities are found, a region having a relatively large movement, a face, a vehicle license plate, or the like may be selected, or two or more regions searched for may be sequentially or simultaneously selected as the region of interest.

Alternatively, the ROI may be selected by sequentially or in a random order of the plurality of regions divided into predetermined sizes with respect to the entire original image frame.

In operation S130, the digital signal processor crops a region of a predetermined size of the original image frame corresponding to the selected region of interest. The size of the cropping area may be VGA or D1 or less, and the cropping area may be an area that overlaps with the ROI as much as possible.

In operation S140, the digital signal processor transmits image data corresponding to a cropping region to a remotely located image system. The image data transmitted to the imaging system can be displayed on the display or recorded on the digital image storage device for playback when needed.

5 is a flowchart illustrating a method of processing image data in a digital signal processor included in a surveillance camera device according to another embodiment of the present invention.

The surveillance camera device according to another embodiment of the present invention, as shown in FIG. 1, includes an image sensor and a digital signal processor. Each step described below may be performed by each internal component of the digital signal processor, but will be collectively described as a digital signal processor for convenience of understanding and description.

In operation S210, the digital signal processor receives an original image frame photographing a predetermined surveillance region output from the image sensor. The original video frame has a high resolution, for example megapixel size.

In operation S220, the digital signal processor performs subsampling to have a predetermined size with respect to the original image frame. By performing subsampling, it is possible to have a higher search speed when searching for a region of interest.

In operation S230, the digital signal processor searches for and selects a region of interest with respect to the subsampled image frame.

The region of interest is a region within the original image frame that satisfies a predetermined condition, and may be a region in which a movement occurs or a singularity such as a face of a person or a vehicle license plate of a vehicle. When a plurality of areas having singularities are found, a region having a relatively large movement, a face, a vehicle license plate, or the like may be selected, or two or more regions searched for may be sequentially or simultaneously selected as the region of interest.

In operation S240, the digital signal processor crops an area of a predetermined size of the original image frame corresponding to the selected region of interest. The size of the cropping area may be VGA or D1 or less, and the cropping area may be an area that overlaps with the ROI as much as possible.

In step S250, the digital signal processor transmits the image data corresponding to the cropping region to the remotely located image system. The image data corresponding to the cropping region transmitted to the image system can be displayed on the display unit or recorded on the digital image storage device and reproduced when needed.

In operation S260, the digital signal processor transmits the subsampled image frame to the image system. The subsampled image frames transmitted to the imaging system can be displayed on the display or recorded on the digital image storage device for playback when needed.

When the digital signal processor has one output port, steps S250 and S260 may be alternately performed sequentially, and when the digital signal processor has two or more output ports, steps S250 and S260 may be simultaneously performed.

In the imaging system, the image data corresponding to the cropping region and the subsampled image frame may be simultaneously displayed on the display unit or may be displayed in a PIP or PBP method.

According to the image data processing method according to the present invention, the surveillance camera device can use a wide-angle image sensor to ensure a wide viewing angle, and a high-resolution image sensor can be used to high-resolution image data for the required subject Can be ensured to provide a high accuracy in identifying the subject in the imaging system.

Naturally, the above-described image data processing method may be performed by an automated procedure in a time-series order by a software program embedded in a digital signal processor. The codes and code segments that make up the program can be easily deduced by a computer programmer in the field.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

1 is a block diagram showing the configuration of a surveillance camera device and an imaging system according to an embodiment of the present invention.

2 is a block diagram showing the configuration of a digital signal processor included in a surveillance camera device according to an embodiment of the present invention.

3 is a block diagram showing the configuration of a digital signal processor included in a surveillance camera device according to another embodiment of the present invention.

4 is a flowchart illustrating a method of processing image data in a digital signal processor included in a surveillance camera device according to an embodiment of the present invention.

5 is a flowchart of a method of processing image data in a digital signal processor included in a surveillance camera device according to another embodiment of the present invention.

Claims (18)

An image sensor generating and outputting an original image frame corresponding to a predetermined surveillance region; And And a digital signal processor which crops and outputs a region of interest selected in the original image frame. The method of claim 1, The digital signal processor, A region of interest selection unit configured to search for and select the region of interest through global search with respect to the original image frame; A cropping unit performing cropping on the selected ROI in the original image frame; And an output unit for outputting image data corresponding to a cropping area cropped by the cropping unit. The method of claim 2, And the ROI is an area having a singularity including at least one of an area where a movement occurs, an area recognized by a human face, and an area recognized by a license plate of a vehicle. The method of claim 2, The original video frame has a megapixel size, and the cropping area has a size of VGA or D1 or less. The method of claim 1, The digital signal processor, A subsampling unit performing subsampling on the original image frame; A region of interest selection unit for searching and selecting the region of interest with respect to the image frame subsampled by the subsampling unit; A cropping unit performing cropping on the selected ROI in the original image frame; And an output unit configured to output at least one of image data corresponding to the cropping region cropped by the cropping unit and the subsampled image frame. The method of claim 5, And the ROI is an area having a singularity including at least one of an area where a movement occurs, an area recognized by a human face, and an area recognized by a license plate of a vehicle. The method of claim 5, And the original video frame has a megapixel size, and the subsampled area has a VGA or D1 size. The method of claim 7, wherein The cropping area is a surveillance camera device, characterized in that having a size of VGA or D1 or less. The method of claim 5, When the output unit has one output port, image data corresponding to the cropping region and the subsampled image frame are alternately outputted. And the subsampled image frame is simultaneously output when the output unit includes two or more output ports. A method of processing image data in a digital signal processor connected to a rear end of an image sensor that generates and outputs an original image frame corresponding to a predetermined surveillance area, (a) receiving an original image frame for the surveillance area output from the image sensor; (b) searching and selecting a region of interest by performing a global search on the original image frame; (c) performing cropping in the original image frame corresponding to the selected region of interest; And and (d) outputting image data corresponding to the cropped region. The method of claim 10, In the step (b), the region having a singularity including at least one of a region where a movement occurs, a region recognized by a human face, and a region recognized by a license plate of the vehicle may be searched and selected as the region of interest. Image data processing method. The method of claim 10, And the original image frame has a megapixel size, and the cropped area has a size of VGA or D1 or less. A method of processing image data in a digital signal processor connected to a rear end of an image sensor that generates and outputs an original image frame corresponding to a predetermined surveillance area, (a) receiving an original image frame for the surveillance area output from the image sensor; (b) performing sub-sampling on the original image frame; searching and selecting the ROI with respect to the subsampled image frame; (d) performing cropping on the selected region of interest within the original image frame; And and (e) outputting at least one of the image data corresponding to the cropped region and the subsampled image frame. The method of claim 13, In the step (c), the region having a singularity including at least one of a region where a movement occurs, a region recognized by a human face, and a region recognized by a license plate of the vehicle may be searched and selected as the region of interest. Image data processing method. The method of claim 13, And the original video frame has a megapixel size, and the subsampled area has a VGA or D1 size. The method of claim 15, The cropped region has a size of VGA or D1 or less. The method of claim 13, In the step (e), when the digital signal processor includes one output port, image data corresponding to the cropped region and the subsampled image frame are alternately outputted, and the digital signal processor And at least two output ports simultaneously output the image data corresponding to the cropped region and the subsampled image frame. A program of instructions that can be executed by a digital processing apparatus is tangibly implemented to perform the image data processing method according to any one of claims 10 to 17, and a program that can be read by the digital processing apparatus is recorded. Record carrier.

Images