JP4509883B2 - Imaging system, imaging apparatus, imaging method, and imaging program - Google Patents

Description

  The present invention relates to an imaging system, an imaging method, and an imaging program. In particular, the present invention relates to an imaging system, an imaging method, and an imaging program that efficiently reduce the data amount of a captured image.

In recent years, monitoring devices using an imaging device are arranged in various places and used for detecting intruders and the like. Then, a reference image of the imaging region is captured in advance, and the change of the subject is detected by comparing the reference image with the captured image. When a change in the subject is detected by comparing the reference image and the captured image, a device is proposed that reduces the compression rate of the image to be captured, assuming that there is a change in the motion of the subject in the imaging area of the imaging device. (For example, refer to Patent Document 1).
JP 2002-335492 A

  The monitoring device is required to acquire a wide area image for the purpose of monitoring the behavior of the person detected in the imaging area. Furthermore, the monitoring device is also required to acquire an image having a sufficient image quality for specifying the person detected in the imaging region. Here, when a person detected in the imaging area is specified, if a moving image is continuously captured with a high-quality image sufficient to specify the person, the capacity of the storage device for storing the moving image is insufficient. There is a case. On the other hand, when a low-quality moving image is captured for the purpose of reducing communication traffic when the captured moving image is communicated with the outside of the imaging device via the Internet or the like, and saving the capacity of the storage device for storing the moving image. In some cases, the person detected in the imaging area cannot be identified.

  In the invention described in Patent Document 1, when there is a change in the movement of the subject in the imaging region, the compression rate of the image to be captured is set to be low regardless of what person the subject is. Then, while the subject is moving, imaging continues while the compression rate of the image to be captured is set low. However, in the invention described in Patent Document 1, regardless of who the subject is, and even after the subject person is authenticated, the compression rate of the captured image is set low while the subject is moving. Therefore, there is a problem that communication traffic is not reduced when a captured image is transmitted to an external device by communication. Furthermore, since the compression rate of the image remains set low, it may be difficult to efficiently reduce the data amount of the captured image.

  Therefore, an object of the present invention is to provide an imaging system, an imaging method, and an imaging program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, in the first embodiment of the present invention, an imaging unit, a setting region storage unit that stores in advance a setting region that is a partial region of a captured image captured by the imaging unit, and imaging The setting area stored in the setting area storage unit is based on the amount of data per unit area of the image in the setting area that is the image in the setting area stored in the setting area storage unit with respect to the captured image captured by the unit A data amount control unit that controls a data amount per unit area of an image outside the setting area, which is an outside image, and an image storage unit that stores a captured image whose data amount is controlled by the data amount control unit. The image pickup unit further includes an image pickup control unit that reads out pixel data from each of a plurality of light receiving elements included in the image pickup unit and obtains a picked-up image. By setting the imaging control unit to read out pixel data from a plurality of light receiving elements so as to increase the number of pixels per unit area of the in-region image, the setting is made based on the data amount per unit area of the set in-region image. The amount of data per unit area of the out-of-region image may be controlled to be small.

  The image data compression unit further compresses the image data of the captured image captured by the imaging unit, and the data amount control unit determines the setting area by the image data compression unit based on the compression ratio of the image in the setting area by the image data compression unit. By increasing the compression rate of the outside image, the data amount per unit area of the image outside the setting area may be controlled to be smaller than the data amount per unit area of the image within the setting area. The image processing apparatus further includes a person determination unit that analyzes the captured image captured by the image capturing unit and determines whether or not a person is included in the setting area image. When it is determined that a person is included, the data amount per unit area of the image outside the setting area may be controlled to be smaller than the data amount per unit area of the image within the setting area. Further, the image processing apparatus further includes a change determination unit that analyzes a moving image that is a captured image captured by the imaging unit and determines whether or not there is a change in the image in the setting area, and the data amount control unit includes the change determination unit in the setting area. When it is determined that there is a change in the image, the data amount per unit area of the image outside the setting area may be controlled to be smaller than the data amount per unit area of the image within the setting area.

  According to the second aspect of the present invention, the imaging device includes an imaging unit, a setting region storage unit that stores in advance a setting region that is a partial region of a captured image captured by the imaging unit, and an imaging unit. The setting area stored in the setting area storage unit is based on the amount of data per unit area of the image in the setting area that is the image in the setting area stored in the setting area storage unit with respect to the captured image captured by the unit A data amount control unit that controls a data amount per unit area of an image outside the setting area, which is an outside image, and an image storage unit that stores a captured image whose data amount is controlled by the data amount control unit.

  According to the third aspect of the present invention, there is provided a setting area storing step for preliminarily storing a setting area that is a partial area of a captured image captured by the imaging unit, and a captured image captured by the imaging unit. On the other hand, from the amount of data per unit area of the image in the setting area that is the image in the setting area stored in the setting area storage stage, the image outside the setting area that is outside the setting area stored in the setting area storage stage A data amount control step for controlling the data amount per unit area of the image to be small, and an image storage step for storing the captured image whose data amount is controlled by the data amount control step.

  According to a fourth aspect of the present invention, there is provided an imaging program for an imaging system, the imaging system storing in advance an imaging unit and a setting area that is a partial area of a captured image captured by the imaging unit. The setting area storage unit and the captured area imaged by the imaging unit store the setting area based on the data amount per unit area of the setting area image that is the image in the setting area stored in the setting area storage unit. A data amount control unit for controlling the data amount per unit area of the image outside the setting region, which is an image outside the setting region stored by the unit, and a captured image whose data amount is controlled by the data amount control unit It functions as an image storage unit.

  Moreover, in the 5th form of this invention, it is a 1st image pick-up part which images a 1st image pick-up area and acquires a 1st pick-up image, and a part of 1st image pick-up area which a 1st image pick-up part images. A second imaging unit that captures the second imaging region and acquires a second captured image having a higher resolution per unit area than the first captured image captured by the first imaging unit, and a first image captured by the first imaging unit A composite image generating unit that generates a composite image by replacing a region image corresponding to the second captured image in the captured image with the second captured image captured by the second image capturing unit; A second imaging region position storage unit that stores in advance the position of the region image corresponding to the second captured image acquired by the second imaging unit in the first captured image acquired by the first imaging unit; A person determination unit that analyzes the first captured image captured by the first imaging unit and determines whether or not a person is included in the region image at the position stored in the second imaging region position storage unit; And an imaging control unit that causes the second imaging unit to capture the second imaging region and acquire the second captured image when the unit determines that the area image includes a person.

  Furthermore, a second imaging area position storage unit that stores in advance the position of an area image corresponding to the second captured image acquired by the second imaging unit among the first captured images acquired by the first imaging unit; A change determination unit that analyzes a moving image that is a first captured image captured by the first imaging unit and determines whether there is a change in the region image at the position stored in the second imaging region position storage unit; When the change determination unit determines that there is a change in the area image, the image pickup control unit may further include an image pickup control unit that causes the second image pickup unit to pick up the second image pickup region and acquire the second image pickup image.

  Moreover, in the 6th form of this invention, it is an imaging device, Comprising: The 1st imaging part which images a 1st imaging area and acquires a 1st captured image, The 1st imaging area which a 1st imaging part images A second imaging section that captures a second imaging area that is a partial area of the first imaging area and obtains a second captured image having a higher resolution per unit area than the first captured image captured by the first imaging section; A composite image generating unit that generates a composite image by replacing a region image corresponding to the second captured image in the first captured image captured by the unit with the second captured image captured by the second image capturing unit;

  Moreover, in the 7th form of this invention, it is an imaging method, Comprising: The 2nd imaging in the 1st captured image which the 1st imaging part which images the 1st imaging area and acquires a 1st captured image imaged An area image corresponding to the image is captured in a second imaging area, which is a partial area of the first imaging area captured by the first imaging section, and per unit area from the first captured image captured by the first imaging section. A composite image generation step of generating a composite image by replacing the second captured image captured by the second image capturing unit that acquires the second captured image with high resolution is provided.

  Moreover, in the 8th form of this invention, it is an imaging program for imaging systems, Comprising: An imaging system, The 1st imaging part which images a 1st imaging area and acquires a 1st captured image, A 1st imaging The second imaging region, which is a partial region of the first imaging region captured by the unit, is captured, and a second captured image having a higher resolution per unit area than the first captured image captured by the first imaging unit is acquired. A composite image is generated by replacing the area image corresponding to the second captured image in the first captured image captured by the second image capturing unit and the first image capturing unit with the second captured image captured by the second image capturing unit. It functions as an image generation unit.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, when a subject such as a person is included in a preset area, a high-quality image of the subject can be captured.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an overview of an imaging system 200 according to an embodiment of the present invention. In the imaging system 200 according to the present embodiment, when a subject such as a person is included in a preset setting area, the amount of image data in the area excluding the area including the subject is reduced, and the inside of the setting area The purpose is to capture high quality images. The imaging apparatus is an example of the imaging system 200.

  The imaging system 200 captures a captured image 500 in the imaging area by the imaging unit 10. The imaging system 200 presets an area that needs to be monitored in the captured image 500 and monitors it as a setting area 600. When there is no change such as a person included in the setting area 600, the imaging system 200 compresses the data amount of the entire captured image 500 and controls the data amount to be small. The image whose data amount is controlled to be small is supplied to a monitoring device or the like. On the other hand, as shown in the captured image 510, when a change occurs in the setting area 610, such as when a subject such as a person 900 is included in the setting area 610, the imaging system 200 compresses the image data in the setting area 610. Without capturing, a high-quality image in the setting area 610 is captured. The imaging system 200 controls the data amount of the image in the portion excluding the setting area 610 of the captured image 510 to be small. Subsequently, the imaging system 200 supplies a captured image 510 including a high-quality image in the setting area 610 to a person authentication device or the like via a network such as the Internet, a memory, or the like.

  According to the imaging system 200 according to the present embodiment, when a person or the like is included in the preset setting area 610, it is possible to reduce the data amount of the image except for the setting area 610. As a result, the imaging system 200 can monitor the action of the person in the imaging area and has a high-quality image sufficient to authenticate the person 900 when the preset area 610 includes the person 900 or the like. Can be imaged. In addition, the imaging system 200 can appropriately reduce communication traffic when the captured high-quality image is transmitted to a person authentication device or the like. Furthermore, the imaging system 200 can efficiently reduce the capacity for storing frame images.

  FIG. 2 shows an example of a functional configuration of the imaging system 200 according to the present embodiment. The imaging system 200 includes an imaging unit 10, a setting area storage unit 20, a data amount control unit 30, an imaging control unit 40, an image storage unit 50, an image data compression unit 60, a person determination unit 70, a change determination unit 80, and an image output. Part 90 is provided. The imaging unit 10 includes a lens 110 and a light receiving device 120. Furthermore, the light receiving device 120 includes a plurality of light receiving elements 125.

  The imaging unit 10 causes incident light to enter the light receiving device 120 through the lens 110. The light receiving device 120 receives light at the plurality of light receiving elements 125 and acquires a captured image of the imaging region. Note that the light receiving device 120 included in the imaging unit 10 may be a device including a plurality of CCD sensors. In addition, the light receiving device 120 included in the imaging unit 10 may include a plurality of CMOS sensors, and the imaging unit 10 may acquire a captured image of the imaging region using a plurality of CMOS sensors. The light receiving device 120 supplies pixel data of the acquired captured image to the imaging control unit 40.

  The imaging control unit 40 reads pixel data from each of the plurality of light receiving elements 125 included in the imaging unit 10 and acquires a captured image. The imaging control unit 40 supplies the image data of the captured image received from the imaging unit 10 to the data amount control unit 30. The setting area storage unit 20 stores in advance a setting area that is a partial area of a captured image captured by the imaging unit 10. The setting area storage unit 20 may set a coordinate axis in the imaging area and store the setting area in association with the coordinate axis. For example, the setting area storage unit 20 can set a part that particularly needs monitoring in the imaging area as the setting area. The setting area storage unit 20 supplies information regarding the position occupied by the setting area in the imaging area to the data amount control unit 30.

  The data amount control unit 30 is based on the data amount per unit area of the setting area image that is an image in the setting area stored in the setting area storage unit 20 with respect to the captured image captured by the imaging unit 10. Also, the data amount per unit area of the image outside the setting area which is an image outside the setting area stored in the setting area storage unit 20 is controlled to be small. Specifically, the data amount control unit 30 controls the imaging control unit 40 so that the number of pixels per unit area of the image in the setting area is larger than the number of pixels per unit area of the image outside the setting area. Pixel data is thinned out from the light receiving element 125 and read out. Then, the data amount control unit 30 controls the data amount per unit area of the image outside the setting area to be smaller than the data amount per unit area of the image within the setting area. The data amount control unit 30 supplies the captured image whose data amount is controlled to the image storage unit 50.

  In addition, the imaging system 200 may include an image data compression unit 60. The data amount control unit 30 supplies the pixel data received from the imaging control unit 40 and information regarding the position of the setting area received from the setting area storage unit 20 to the image data compression unit 60. Then, the image data compression unit 60 compresses the image data of the captured image captured by the imaging unit 10. For example, when compressing a still image, the image data compression unit 60 may compress the captured image using an image compression method such as JPEG. Further, when compressing a moving image, the image data compression unit 60 may compress the captured image using an image compression method such as MPEG. The image data compression unit 60 supplies the captured image with the data amount compressed to the data amount control unit 30. Here, the data amount control unit 30 may increase the compression rate of the image outside the setting area by the image data compression unit 60 than the compression rate of the image within the setting area by the image data compression unit 60. Then, the data amount control unit 30 may control the data amount per unit area of the image outside the setting area to be smaller than the data amount per unit area of the image within the setting area.

  Thereby, the data amount control unit 30 can obtain a high-quality image for the in-setting area image. Note that the image data compression unit 60 sets the compression rate of the image data in the setting region and the image data outside the setting region to the same compression rate when there is no change such as a person included in the setting region. May be. Note that the set compression rate may be a compression rate at which image data with sufficient image quality can be obtained to identify whether or not the subject included in the setting area is a person. When there is no change in the setting area, the imaging system 200 does not need to acquire a high-quality image by making the compression rate of the data of the image in the setting area and the image outside the setting area the same. The image data with the compressed data amount can be acquired.

  In addition, the imaging system 200 may include a person determination unit 70. The data amount control unit 30 supplies the pixel data received from the imaging control unit 40 and the information regarding the position of the setting area received from the setting area storage unit 20 to the person determination unit 70. Then, the person determination unit 70 analyzes the captured image captured by the imaging unit 10 and determines whether a person is included in the setting area image. The person determination unit 70 detects a subject included in the image in the setting area by image processing such as contour extraction processing and color distribution analysis processing. And the person judgment part 70 may store the feature-value specific to a person's face previously. The characteristic amount specific to the face of a person may be, for example, the face outline, eyes, nose, mouth, eyebrows, and the distance between parts included in these faces. The person determination unit 70 may determine whether or not the subject is a person by detecting a characteristic amount specific to the face of the person from the subject included in the image in the setting area by matching or the like.

  Further, the person determination unit 70 may determine whether or not the subject included in the image in the setting area is a person based on the person's clothes and the shape and color of shoes and the like. For example, the person determination unit 70 may store in advance data such as clothes, shoes and other shapes and colors worn by a person. Then, the person determination unit 70 may determine whether or not the subject is a person by matching the subject included in the setting area image with the shape of clothes, shoes, or the like stored in advance. Furthermore, the person determination unit 70 may determine whether or not the subject is a person by skin color extraction. When the person determination unit 70 determines that a person is included in the setting area image, the person determination unit 70 supplies information indicating that the person is included in the setting area image to the data amount control unit 30. If the data amount control unit 30 receives information indicating that a person is included in the setting area image from the person determination unit 70, the data amount control unit 30 determines that the person is included in the setting area image. To do. Then, the data amount control unit 30 may control the data amount per unit area of the image outside the setting area to be smaller than the data amount per unit area of the image within the setting area.

  Further, the imaging system 200 may include a change determination unit 80. The data amount control unit 30 supplies the pixel data received from the imaging control unit 40 and information regarding the position of the setting area received from the setting area storage unit 20 to the change determination unit 80. The change determination unit 80 analyzes a moving image that is a captured image captured by the imaging unit 10 and determines whether there is a change in the image in the setting area. The change determination unit 80 compares the frame image received from the data amount control unit 30 with a plurality of frame images continuously captured from the frame image, and the movement of the subject included in the frame image is determined in advance. It is determined whether or not the amount of movement is greater than a predetermined value. For example, the change determination unit 80 compares a frame image including the subject with a frame image captured continuously from the frame image, and matches the subject. Subsequently, the change determination unit 80 calculates the amount of deviation of the subject with respect to the background included in the frame image.

  Then, the change determination unit 80 may determine whether or not the calculated shift amount of the subject included in the frame image with respect to the background is greater than or equal to a predetermined amount. When it is determined that the movement of the subject is equal to or greater than a predetermined amount, the change determination unit 80 supplies information indicating that the movement of the subject is equal to or greater than a predetermined amount to the data amount control unit 30. . When the data amount control unit 30 receives information indicating that the movement of the subject is equal to or greater than a predetermined amount from the change determination unit 80, the data determination unit 80 determines that there is a change in the image in the setting area. to decide. Then, the data amount control unit 30 may control the data amount per unit area of the image outside the setting area to be smaller than the data amount per unit area of the image within the setting area.

  The image storage unit 50 stores the captured image whose data amount is controlled by the data amount control unit 30. The image storage unit 50 stores the captured image received from the data amount control unit 30 in association with an identifier that can be uniquely identified. Then, the image storage unit 50 supplies the stored captured image to the image output unit 90. The image output unit 90 displays the captured image received from the image storage unit 50 on a monitor or the like. The image output unit 90 may supply the captured image received from the image storage unit 50 to a person authentication device or the like via a network such as the Internet and a memory.

  According to the imaging system 200 according to the present embodiment, it is possible to perform imaging by controlling the data amount of an imaging area including a predetermined setting area to be small. When a change occurs such that a subject such as a person is included in the setting area, the data amount of the image outside the setting area is controlled to be small, and a high-quality image can be captured in the setting area. Thereby, the imaging system 200 can monitor a person's behavior and can capture a high-quality image sufficient to authenticate the person. Furthermore, the imaging system 200 can save the capacity for storing captured images, and can efficiently reduce communication traffic when transmitting to a person authentication device or the like.

  FIG. 3 shows an overview of an imaging system 210 according to the second embodiment of the present invention. The imaging system 210 includes a first imaging unit 12 and a second imaging unit 14. In the first imaging unit 12, the imaging system 210 captures a low-resolution image of the imaging area and monitors a wide range. The first imaging unit 12 captures a low-resolution image in the imaging region 530 by reducing the resolution to such an extent that the behavior of the person 910 can be monitored. Then, the imaging system 210 determines whether or not a subject such as a person 910 exists in a predetermined range, that is, the second imaging area 625 that is a part of the imaging area 530. When the imaging system 210 determines that a subject such as a person 910 exists in the second imaging region 625, the imaging system 210 can capture an image with a higher resolution than the first imaging unit 12. Then, a high-resolution image of the second imaging region 620 that is a part of the imaging region 520 of the second imaging unit 14 is captured. The imaging device is an example of the imaging system 210.

  Subsequently, the imaging system 210 synthesizes the image of the imaging region 530 captured by the first imaging unit 12 and the high-resolution image of the second imaging region 620 captured by the second imaging unit 14. The imaging system 210 then combines a synthesized image 540 obtained by synthesizing the image of the imaging area 530 and the high-resolution second captured image of the second imaging area 630 via a network such as the Internet, a memory, etc. And supply.

  According to the imaging system 210 according to the present embodiment, when the person 910 or the like is not included in the second imaging area 620, a low-resolution image in the imaging area 530 is captured. And when the person 910 grade | etc., Is contained in the 2nd imaging area 620, the high-resolution image of the 2nd imaging area 620 is imaged. Then, the imaging system 210 can generate a composite image 540 that combines the low-resolution image and the high-resolution image of the second imaging region 620. As a result, the imaging system 210 can monitor the behavior of the person 910 in the imaging area, and when the second imaging area 630 includes a person 910 or the like, captures a high-resolution image sufficient to authenticate the person 910. it can. Then, the imaging system 210 can appropriately reduce communication traffic when transmitting the captured high-resolution image to a person authentication device or the like. Furthermore, the imaging system 210 can efficiently reduce the capacity for storing frame images.

  FIG. 4 shows an example of a functional configuration in the imaging system 210 according to the second embodiment of the present invention. The imaging system 210 includes a first imaging unit 12, a second imaging unit 14, a second imaging area position storage unit 25, an imaging control unit 42, an image storage unit 52, a composite image generation unit 65, a person determination unit 72, and a change determination unit. 82 and an image output unit 92. Note that the imaging control unit 42, the image storage unit 52, the person determination unit 72, the change determination unit 82, and the image output unit 92 are substantially the same as described above for the same member names in FIG. Description is omitted.

  The first imaging unit 12 captures the first imaging area and acquires a first captured image. The first imaging area may be an imaging area of the first imaging unit 12. The first imaging unit 12 supplies the captured first captured image to the imaging control unit 42. The second imaging unit 14 images a second imaging region that is a partial region of the first imaging region captured by the first imaging unit 12. Then, the second imaging unit 14 acquires a second captured image having a higher resolution per unit area than the first captured image captured by the first imaging unit 12 based on information from the imaging control unit 42. The second imaging unit 14 supplies the acquired second captured image to the imaging control unit 42.

  The second imaging region position storage unit 25 stores in advance the position of the region image corresponding to the second captured image acquired by the second imaging unit 14 among the first captured images acquired by the first imaging unit 12. . The second imaging area position storage unit 25 may set a coordinate axis in the first imaging area and store information regarding the position of the second imaging area in association with the coordinate axis. For example, the second imaging region position storage unit 25 can set a portion requiring monitoring in the first imaging region as the second imaging region. The second imaging region position storage unit 25 supplies information related to the position occupied by the second imaging region in the first imaging region to the imaging control unit 42.

  The imaging control unit 42 supplies the person determination unit 72 with information regarding the first captured image received from the first imaging unit 12 and the position of the second imaging region in the first imaging region. The person determination unit 72 analyzes the first captured image captured by the first imaging unit 12, and stores the region image at the position stored in the second imaging region position storage unit 25, that is, the second imaging region. It is determined whether or not a person is included. When it is determined that a person is included in the second imaging region, the person determination unit 72 supplies information indicating that a person is included in the second imaging region to the imaging control unit 42. Then, when receiving information indicating that a person is included in the second imaging area from the person determination unit 72, the imaging control unit 42 causes the second imaging unit 14 to image the second imaging area and performs the second imaging. Get an image. The second captured image acquired by the second imaging unit 14 is supplied to the imaging control unit 42.

  In addition, the imaging control unit 42 may supply the change determination unit 82 with the first captured image received from the first imaging unit 12 and information regarding the position occupied by the second imaging region in the first imaging region. The change determination unit 82 analyzes the first captured image captured by the first imaging unit 12 and applies the region image of the position stored in the second imaging region position storage unit 25, that is, the second imaging region. Determine if there is a change. When it is determined that there is a change in the second imaging region, the change determination unit 82 supplies information indicating that there is a change in the second imaging region to the imaging control unit 42. When the imaging control unit 42 receives information from the change determination unit 82 that there is a change in the second imaging area, the imaging control unit 42 supplies the imaging control unit 42 with information that there is a change in the second imaging area. To do. Then, when receiving information indicating that there is a change in the second imaging region from the change determination unit 82, the imaging control unit 42 causes the second imaging unit 14 to image the second imaging region, and the second captured image. To get. The imaging control unit 42 includes the second captured image acquired by the second imaging unit 14, information regarding the position of the second imaging region in the first imaging region, and the first captured image acquired by the first imaging unit 12. Is supplied to the composite image generation unit 65. Further, the imaging control unit 42 supplies the first captured image acquired by the first imaging unit 12 to the image storage unit 52.

  The composite image generation unit 65 replaces the region image corresponding to the second captured image in the first captured image captured by the first image capturing unit 12 with the second captured image captured by the second image capturing unit 14. Generate a composite image. The composite image generation unit 65 supplies the generated composite image to the image storage unit 52. The image storage unit 52 stores the composite image generated by the composite image generation unit 65 in association with an identifier that can uniquely identify the composite image. The image storage unit 52 stores the first captured image received from the imaging control unit 42 in association with an identifier that can uniquely identify the first captured image. The image storage unit 52 may store a plurality of frame images included in the first captured image in association with identifiers that can be uniquely identified. Furthermore, the image storage unit 52 may store the timing of storing the first captured image and the composite image in association with the time. The image storage unit 52 supplies the first captured image and the composite image to the image output unit 92.

  According to the imaging system 210 according to the present embodiment, when there is no change in the second imaging region, a first captured image that is a low-resolution image of the imaging region is captured. Then, when there is a change in the second imaging area, a second captured image that is a high-resolution image of the second imaging area is captured. Then, the imaging system 210 can generate a composite image obtained by combining the first captured image and the second captured image. As a result, the imaging system 210 can monitor the behavior of the person in the imaging area and can capture a high-resolution image sufficient to authenticate the person when the second imaging area changes. In addition, the imaging system 210 can appropriately reduce communication traffic when transmitting a captured high-resolution image to a person authentication device or the like. Furthermore, the imaging system 210 can efficiently reduce the capacity for storing frame images.

  FIG. 5 shows an example of the processing flow in the imaging system 210. First, in the first imaging unit 12 included in the imaging system 210, a first captured image is acquired (S1000). Then, the first captured image is supplied from the first imaging unit 12 to the imaging control unit 42. The imaging control unit 42 supplies the first captured image received from the first imaging unit 12 to the person determination unit 72. The imaging control unit 42 may supply the first captured image received from the first imaging unit 12 to the change determination unit 82. Further, the imaging control unit 42 supplies the first captured image to the composite image generation unit 65. Then, the imaging control unit 42 supplies the position information of the second imaging region stored in the second imaging region position storage unit 25 to the person determination unit 72 or the change determination unit 82.

  When the person determination unit 72 receives the first captured image and the position information of the second imaging region from the imaging control unit 42, the person determination unit 72 performs the second imaging that is a partial region of the first captured image. It is determined whether a person exists in the area (S1010). When the change determination unit 82 receives the first captured image and the position information of the second imaging region from the imaging control unit 42, the change determination unit 82 is a partial region of the first captured image. 2. It is determined whether or not there is a change in the imaging area (S1010). When the person determination unit 72 determines that no person exists in the second imaging region (S1010: No), the person determination unit 72 informs the imaging control unit 42 that there is no person in the second imaging region. Supply information indicating When the change determining unit 82 determines that there is no change in the second imaging region (S1010: No), the change determining unit 82 indicates that the imaging control unit 42 has no change in the second imaging region. Supply information indicating

  Then, the imaging control unit 42 supplies the first captured image to the image storage unit 52. The image storage unit 52 stores the first captured image received from the imaging control unit 42 in association with an identifier that can uniquely identify the first captured image (S1045). Subsequently, the image storage unit 52 supplies the stored first captured image to the image output unit 92. The image output unit 92 outputs the first captured image received from the image storage unit 52 to a monitor or the like (S1055).

  On the other hand, when the person determination unit 72 determines that a person is present in the second imaging region (S1010: Yes), the person determination unit 72 causes the imaging control unit 42 to include a person in the second imaging region. Supply information to the effect. When the change determination unit 82 determines that there is a change in the second imaging region (S1010: Yes), the change determination unit 82 indicates that there is a change in the second imaging region in the imaging control unit 42. Supply information indicating Then, the imaging control unit 42 causes the second imaging unit 14 to acquire a second captured image (S1020). The second captured image acquired by the second imaging unit 14 is supplied to the composite image generation unit 65 via the imaging control unit 42. The composite image generation unit 65 replaces the area image corresponding to the second captured image in the first captured image received from the imaging control unit 42 with the second captured image captured by the second imaging unit 14, and the composite image. Is generated (S1030).

  Then, the composite image generated by the composite image generation unit 65 is supplied from the composite image generation unit 65 to the image storage unit 52. The image storage unit 52 stores the composite image received from the composite image generation unit 65 in association with an identifier that can uniquely identify the composite image (S1040). Subsequently, the image storage unit 52 supplies the stored composite image to the image output unit 92. The image output unit 92 outputs the composite image received from the image storage unit 52 to a monitor or the like. The image output unit 92 may supply the composite image received from the image storage unit 52 to a person authentication device or the like via a network such as the Internet and a memory.

  FIG. 6 illustrates an example of a hardware configuration of the imaging system 200 and the imaging system 210 according to the present embodiment. The imaging system 200 and the imaging system 210 according to this embodiment include a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 that are connected to each other by a host controller 1582, and an input / output controller 1584. An input / output unit having a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 connected to the host controller 1582; a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584; A legacy input / output unit.

  The host controller 1582 connects the RAM 1520 to the CPU 1505 and the graphic controller 1575 that access the RAM 1520 at a high transfer rate. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 to control each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 or the like on a frame buffer provided in the RAM 1520 and displays it on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the communication interface 1530, the hard disk drive 1540, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The communication interface 1530 communicates with other devices via a network or the like. The hard disk drive 1540 stores programs and data used by the imaging system 200 and the CPU 1505 in the imaging system 210. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the imaging system 200 and the imaging system 210 are activated, a program depending on the hardware of the imaging system 200 and the imaging system 210, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 such as a parallel port, a serial port, a keyboard port, and a mouse port.

  The imaging program provided to the hard disk drive 1540 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The imaging program is read from the recording medium, installed in the imaging system 200 and the hard disk drive 1540 in the imaging system 210 via the RAM 1520, and executed by the CPU 1505. The imaging program installed and executed in the imaging system 200 and the imaging system 210 operates on the CPU 1505 and the like, and the imaging unit 10, the setting area storage unit 20, the data amount control unit 30, the imaging control unit 40, and the image storage unit 50. , Image data compression unit 60, person determination unit 70, change determination unit 80, image output unit 90, lens 110, light receiving device 120, multiple light receiving elements 125, first imaging unit 12, second imaging unit 14, second imaging The imaging system 200 described with reference to FIGS. 1 to 5 includes the region position storage unit 25, the imaging control unit 42, the image storage unit 52, the composite image generation unit 65, the person determination unit 72, the change determination unit 82, and the image output unit 92. Alternatively, the imaging system 210 is caused to function.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

1 is a conceptual diagram of an imaging system 200. FIG. 2 is a block diagram illustrating a functional configuration of an imaging system 200. FIG. 1 is a conceptual diagram of an imaging system 210. FIG. 2 is a block diagram illustrating a functional configuration of an imaging system 210. FIG. 12 is a flowchart illustrating a processing flow of the imaging system 210. 2 is a block diagram illustrating a hardware configuration of an imaging system 200 and an imaging system 210. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image pick-up part 12 1st image pick-up part 14 2nd image pick-up part 20 Setting area | region storage part 25 2nd image pick-up area position storage part 30 Data amount control part 40, 42 Image pick-up control part 50, 52 Image storage part 60 Image data compression part 65 Composition Image generation unit 70, 72 Person determination unit 80, 82 Change determination unit 90, 92 Image output unit 110 Lens 120 Light receiving device 125 Light receiving element 200, 210 Imaging system 500, 510 Captured image 520, 530 Imaging region 540 Composite image 600, 610 Setting area 620, 625, 630 Second imaging area 900, 910 Person 1505 CPU
1510 ROM
1520 RAM
1530 Communication interface 1540 Hard disk drive 1550 Flexible disk drive 1560 CD-ROM drive 1570 Input / output chip 1575 Graphic controller 1580 Display device 1582 Host controller 1584 Input / output controller 1590 Flexible disk 1595 CD-ROM

Claims (14)

An imaging unit;
A setting area storage section that stores in advance a setting area that is a partial area of a captured image captured by the imaging section;
A person determination unit that analyzes a captured image captured by the imaging unit and determines whether a person is included in the image in the setting area;
When the person determination unit determines that a person is included in the image in the setting area, the data amount per unit area of the image outside the setting area is controlled to be smaller than the data amount per unit area of the image in the setting area. In addition, if the person determination unit does not determine that a person is included in the image in the setting area, the data amount of the image outside the setting area controlled when it is determined that a person is included is the same as A data amount control unit that controls a data amount per unit area between an image in the setting area and an image outside the setting area;
An imaging system comprising: an image storage unit that stores a captured image whose data amount is controlled by the data amount control unit. An imaging unit;
A setting area storage section that stores in advance a setting area that is a partial area of a captured image captured by the imaging section;
A change determination unit that analyzes a moving image that is a captured image captured by the imaging unit and determines whether there is a change in an image in a setting region;
When the change determination unit determines that there is a change in the image in the setting area, the data amount per unit area of the image outside the setting area is controlled to be smaller than the data amount per unit area of the image in the setting area. In addition, when the change determination unit does not determine that there is a change in the image in the setting area, the setting area is set to be the same as the data amount of the image outside the setting area that is controlled when it is determined that there is a change. A data amount control unit that controls the amount of data per unit area between the image inside and the image outside the setting region;
An image storage unit for storing a captured image whose data amount is controlled by the data amount control unit;
An imaging system comprising: An image capturing control unit that reads out pixel data from each of the plurality of light receiving elements of the image capturing unit and obtains a captured image;
The data amount control unit includes pixels from a plurality of light receiving elements to the imaging control unit so that the number of pixels per unit area of the image in the setting region is larger than the number of pixels per unit area of the image outside the setting region. by read by thinning out the data, from the data amount per unit area of the image inside the set area, according to claim 1 or claim 2 for controlling small data amount per unit area of the image outside the set area Imaging system. An image data compression unit that compresses image data of a captured image captured by the imaging unit;
The data amount controller, the more the compression ratio of the image of the image data compression unit by setting region, by increasing the compression ratio of the image outside the set area by the image data compression unit, a unit of the image inside the set area the imaging system of claim 1 or claim 2 than the data amount per unit area, controls reduce the data amount per unit area of the image outside the set area. Analyzing a captured image captured by the imaging unit and determining whether or not a person is included in an image in a setting region stored in advance in the setting region storage unit;
When it is determined in the person determination step that the image in the setting area includes a person, the data amount per unit area of the image outside the setting area is smaller than the data amount per unit area of the image in the setting area. In addition to controlling, when it is not determined that the image in the setting area includes a person in the person determination step, the data amount of the image outside the setting area is controlled when it is determined that the person is included. A data amount control stage for controlling a data amount per unit area between an image in the setting region and an image outside the setting region,
An image storage method comprising: an image storage step of storing a captured image whose data amount is controlled by the data amount control step in an image storage unit . A change determination step of analyzing a moving image that is a captured image captured by the imaging unit and determining whether or not there is a change in an image in the setting area stored in advance in the setting area storage unit;
When it is determined that there is a change in the image in the setting area in the change determination step, the data amount per unit area of the image outside the setting area is controlled to be smaller than the data amount per unit area of the image in the setting area. In addition, when it is determined that there is no change in the image in the setting area in the change determination step, the data amount of the image outside the setting area is controlled when it is determined that there is a change. In addition, a data amount control stage for controlling a data amount per unit area between an image in the setting area and an image outside the setting area,
An image storage stage for storing the captured image whose data volume is controlled in the data volume control stage in an image storage unit;
An imaging method comprising: An imaging control step of reading out pixel data from each of a plurality of light receiving elements of the imaging unit and acquiring a captured image
Further comprising
In the data amount control step, pixels from a plurality of light receiving elements are used in the imaging control step so that the number of pixels per unit area of the image in the setting region is larger than the number of pixels per unit area of the image outside the setting region. By thinning out and reading out data, the data amount per unit area of the image outside the setting region is controlled to be smaller than the data amount per unit area of the image within the setting region.
The imaging method according to claim 5 or 6. An image data compression step for compressing image data of a captured image captured by the imaging unit
Further comprising
In the data amount control step, the unit of the image in the setting region is set by increasing the compression rate of the image outside the setting region in the image data compression step than the compression rate of the image in the setting region in the image data compression step. Control the amount of data per unit area of images outside the set area to be smaller than the amount of data per area.
The imaging method according to claim 5 or 6. The imaging program for making a computer perform each step with which the imaging method as described in any one of Claims 5-8 is provided. A first imaging unit that captures a first imaging region and obtains a first captured image;
Second imaging with a higher resolution per unit area than the first captured image captured by the first imaging unit by imaging a second imaging region that is a partial region of the first imaging region captured by the first imaging unit. A second imaging unit for acquiring an image;
Said one of the first image by the first imaging unit acquires the second position previously stored to that has an imaging region position storing unit area images corresponding to the captured image by the second image pickup unit acquires,
The first image pickup unit analyzes the first captured image captured, the person determining section for determining whether a person is included in the region image at a position before Symbol IMAGING area position storage unit stores,
When the person determination unit determines that a person is included in the region image, the first image pickup unit is caused to pick up the first image pickup region and the first image pickup image is acquired, and the second image pickup unit is subjected to the second image pickup. When the region is imaged and a second captured image is acquired, and the person determination unit does not determine that a person is included in the region image, the first imaging region is imaged only by the first imaging unit and the first imaging is performed. An imaging control unit for acquiring an image;
When the person determination unit determines that a person is included in the region image, the second imaging unit displays a region image corresponding to a second captured image in the first captured image captured by the first imaging unit. An imaging system comprising: a composite image generation unit that generates a composite image by replacing the captured second image. A first imaging unit that captures a first imaging region and obtains a first captured image;
Second imaging with a higher resolution per unit area than the first captured image captured by the first imaging unit by imaging a second imaging region that is a partial region of the first imaging region captured by the first imaging unit. A second imaging unit for acquiring an image;
An imaging region position storage unit that stores in advance the position of a region image corresponding to the second captured image acquired by the second imaging unit in the first captured image acquired by the first imaging unit;
A change determination unit that analyzes a moving image that is a first captured image captured by the first imaging unit and determines whether or not there is a change in a region image at a position stored in the imaging region position storage unit;
When the change determination unit determines that there is a change in the area image, the first imaging unit is caused to capture the first imaging area and the first imaging image is acquired, and the second imaging unit is configured to acquire the second imaging area. When the change determination unit does not determine that there is a change in the area image, only the first image pickup unit is caused to image the first image pickup image. An imaging control unit to acquire;
When the change determination unit determines that there is a change in the region image, the second imaging unit captures a region image corresponding to the second captured image in the first captured image captured by the first imaging unit. A synthesized image generating unit that generates a synthesized image by replacing the second captured image
An imaging system comprising: A first captured image acquisition stage in which the first imaging unit acquires a first captured image obtained by imaging the first imaging region;
A second imaging unit that captures an image having a higher resolution per unit area than the first captured image acquires a second captured image obtained by imaging a second imaging region that is a part of the first imaging region. A second captured image acquisition unit stage;
A person determination step of analyzing the first captured image and determining whether or not a person is included in an area image at a position corresponding to the second imaging area stored in advance in the imaging area position storage unit;
When it is determined in the person determination step that the area image includes a person, the first imaging unit is caused to capture an image of the first imaging region, and a first captured image is acquired. A first captured image is captured by the first image capturing unit only when the image capturing area is captured and a second captured image is acquired, and when it is not determined that the person is included in the area image in the person determining step. An imaging imaging control stage for acquiring a captured image;
When it is determined that a person is included in the region image in the person determination step, a region image corresponding to a second captured image in the first captured image captured by the first image capturing unit is represented by the second image capturing unit. A composite image generation step of generating a composite image by replacing the second captured image captured by
An imaging method comprising: A first captured image acquisition stage in which the first imaging unit acquires a first captured image obtained by imaging the first imaging region;
A second imaging unit that captures an image having a higher resolution per unit area than the first captured image acquires a second captured image obtained by imaging a second imaging region that is a part of the first imaging region. A second captured image acquisition unit stage;
A change determination step of analyzing the moving image as the first captured image and determining whether or not there is a change in the region image at a position corresponding to the second imaging region stored in the imaging region position storage unit in advance; ,
When it is determined that there is a change in the area image in the change determination step, the first imaging area is captured by the first imaging unit to acquire a first captured image, and the second imaging section is captured by the second imaging unit. When the region is imaged to acquire the second captured image and it is not determined that there is a change in the region image in the change determination step, only the first imaging unit captures the first imaged region by capturing the first captured image. An imaging control stage to be acquired;
When it is determined that there is a change in the region image in the change determination step, the second imaging unit displays a region image corresponding to the second captured image in the first captured image captured by the first imaging unit. A composite image generation step of generating a composite image by replacing the captured second captured image;
An imaging method comprising: An imaging program for causing a computer to execute each stage included in the imaging method according to claim 12 or 13.

Images