JP2008147977A - Display device, display method, imaging system, imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device capable of displaying an image picked up with high spatial resolution and high time resolution, in a suitable form. <P>SOLUTION: A monitoring system according to the present invention comprises: an image acquisition unit which acquires an image; a picture quality judging unit which judges whether the picture quality of the acquired image is higher than predetermined picture quality; a picture quality decreasing unit which decreases the picture quality of the acquired image to the level equal to or below the predetermined picture quality when the picture quality judging unit judges that the picture quality of the acquired image is higher than the predetermined picture quality; a display unit which displays the image whose picture quality is decreased by the picture quality decreasing unit when the picture quality judging unit judges that the picture quality of the image is higher than the predetermined picture quality, and displays the image that the image acquiring unit acquires when the picture quality judging unit judges that the picture quality of the image is lower than the predetermined picture quality; and a display control unit which makes the display unit display information showing that an image having picture quality higher than the predetermined picture quality is acquired while the display unit displays the image whose picture quality is decreased by the picture quality decreasing unit when the picture quality judging unit judges that the picture quality of the image is higher than the predetermined picture quality. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging system, an imaging method, and a program. In particular, the present invention relates to an imaging apparatus that captures an image, an imaging system, an imaging method, and a program for the imaging apparatus and the imaging system.

During a period when the motion vector detected by the video compression unit is less than a predetermined value, the period of the synchronization signal supplied to the imaging unit is made relatively long to lower the frame rate of imaging by the imaging unit, so that the motion vector is predetermined An imaging device is known that increases the frame rate of imaging by relatively shortening the period of the synchronization signal during a period longer than the value (see, for example, Patent Document 1).
JP 2004-200909 A

  The imaging device described in Patent Document 1 captures an image at a low frame rate while no motion is detected, and when a motion of a predetermined value or more is detected from the captured low frame rate image, the imaging frame The rate or resolution can be increased. However, even if a photographing apparatus that can capture images with a high resolution and a high frame rate is introduced as in the photographing apparatus described in Patent Document 1, a high resolution and high frame rate image captured by the imaging apparatus is displayed on the display device. If it cannot be displayed, its advantages are lost. However, if an attempt is made to introduce a display device suitable for the performance of the photographing apparatus together with a high-performance photographing apparatus, the cost of the entire monitoring system increases. Therefore, there is a demand for a display device that can appropriately display a high-quality image picked up by the photographing device even when a display device that can display only an image quality lower than the image quality of the image picked up by the photographing device is used.

  Accordingly, an object of the present invention is to provide a display device, a display method, an imaging system, an imaging method, and a program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above problems, a display device according to a first aspect of the present invention includes an image acquisition unit that acquires an image, and whether or not the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality of the image acquired by the image acquisition unit is determined in advance. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays an image with the image quality reduced. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is equal to or lower than a predetermined image quality, the display unit that displays the image acquired by the image acquisition unit and the image acquisition unit acquire The quality of the selected image is predetermined When the image quality determination unit determines that the image quality is higher, the image acquisition unit acquires an image with a higher image quality than the predetermined image quality while the display unit displays an image whose image quality has been reduced by the image quality reduction unit. And a display control unit that displays information indicating that it has been performed on the display unit.

  The image quality determination unit determines whether the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit, and the image quality reduction unit determines that the image quality of the image acquired by the image acquisition unit is If the image quality determination unit determines that the image quality is higher than the image quality that can be displayed, the image quality of the image acquired by the image acquisition unit is reduced to an image quality that can be displayed by the display unit or less. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit, the image quality reduction unit displays the image with reduced image quality, and the image acquisition unit acquires When the image quality determination unit determines that the image quality of the obtained image is lower than the image quality that can be displayed by the display unit, the image acquired by the image acquisition unit is displayed, and the display control unit acquires the image acquired by the image acquisition unit The image quality may be displayed on the display unit. When the image quality determination unit determines that the image quality is higher than the image quality that can be displayed, the image acquisition unit is higher than the image quality that the display unit can display while the display unit displays an image with the image quality reduced. Information indicating that an image having an image quality has been acquired may be displayed on the display unit.

  The image quality determination unit determines whether the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, and the image quality reduction unit determines that the resolution of the image acquired by the image acquisition unit is the display unit. When the image quality determination unit determines that the resolution is higher than the resolution that can be displayed, the resolution of the image acquired by the image acquisition unit is reduced to a resolution that is lower than or equal to the resolution that can be displayed by the display unit. When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, the image quality reduction unit displays the image with the reduced resolution, and the image acquisition unit acquires When the image quality determination unit determines that the resolution of the obtained image is less than the resolution that can be displayed by the display unit, the image acquired by the image acquisition unit is displayed, and the display control unit acquires the image acquired by the image acquisition unit Image resolution Is determined to be higher than the resolution that can be displayed by the display unit, the image acquisition unit is connected to the display unit while the display unit displays an image with the resolution reduced by the image quality reduction unit. Information indicating that an image having a resolution higher than the resolution that can be displayed has been acquired may be displayed on the display unit.

  When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than a predetermined resolution, an image holding unit that holds the image acquired by the image acquisition unit, and an image held by the image holding unit An instruction input unit that receives an instruction to display the image from the user, and the display control unit holds the image when the instruction input unit receives an instruction to display the image held by the image holding unit from the user. The partial area of the image held by the unit may be enlarged, and the partial area image may be displayed on the display unit at a resolution that can be displayed by the display unit.

  The display method according to the second aspect of the present invention includes an image acquisition stage for acquiring an image, an image quality determination stage for determining whether the image quality of the image acquired in the image acquisition stage is higher than a predetermined image quality, When it is determined in the image quality determination stage that the image quality of the image acquired in the image acquisition stage is higher than the predetermined image quality, the image quality of the image acquired in the image acquisition stage is equal to or lower than the predetermined image quality. When the image quality determination stage determines that the image quality of the image acquired in the image quality reduction stage and the image acquisition stage is higher than the predetermined image quality, the image with the image quality reduced in the image quality reduction stage is displayed. When the image quality determination stage determines that the image quality of the image acquired in the image acquisition stage is equal to or lower than the predetermined image quality, An image in which the image quality is reduced in the image quality reduction stage when it is determined in the image quality judgment stage that the image quality obtained in the display stage for displaying the obtained image and the image quality obtained in the image acquisition stage is higher than a predetermined image quality And a display control step of displaying information indicating that an image having a higher image quality than the predetermined image quality is acquired in the image acquisition step in the display step.

  According to the third aspect of the present invention, there is provided a program for a display device, wherein the display device includes an image acquisition unit that acquires an image, and whether or not the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality. An image quality determination unit that determines whether the image acquired by the image acquisition unit is higher than a predetermined image quality. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is lower than the image quality, or the image acquisition unit determines that the image quality of the image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality reduction unit displays the image with the reduced image quality When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is equal to or lower than a predetermined image quality, the display unit that displays the image acquired by the image acquisition unit and the image acquisition unit acquired Image quality is predetermined When the image quality determination unit determines that the image quality is higher, the image acquisition unit acquires an image with a higher image quality than the predetermined image quality while the display unit displays an image whose image quality has been reduced by the image quality reduction unit. It is made to function as a display control part which displays the information which shows having been performed on a display part.

  An imaging system according to a fourth aspect of the present invention includes an imaging unit that captures an image, a conformity determination unit that determines whether an image captured by the imaging unit conforms to a predetermined condition, and an imaging unit that captures an image. When the conformity determination unit determines that the captured image does not conform to the conditions, the image captured by the imaging unit is lower in image quality than when the conformity determination unit determines that the image captured by the imaging unit conforms to the conditions. An output unit that converts and outputs an image, an image acquisition unit that acquires an image output by the output unit, and an image quality determination that determines whether or not the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality And the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality of the image acquired by the image acquisition unit is equal to or lower than the predetermined image quality. The image quality reduction unit and the image acquisition unit When the image quality determination unit determines that the image quality of the obtained image is higher than the predetermined image quality, the image quality reduction unit displays the image with the reduced image quality, and the image quality of the image acquired by the image acquisition unit is determined in advance. When the image quality determination unit determines that the image quality is less than or equal to the image quality, the display unit displays the image acquired by the image acquisition unit, and the image quality indicates that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality. When the determination unit determines, information indicating that the image acquisition unit has acquired an image with a higher image quality than the predetermined image quality in a state where the display unit displays an image whose image quality has been reduced by the image quality reduction unit. A display control unit to be displayed on the display unit.

  An imaging method according to a fifth aspect of the present invention includes an imaging stage for capturing an image, a conformity determination stage for determining whether an image captured in the imaging stage conforms to a predetermined condition, and an imaging stage. When it is determined in the conformity determination stage that the captured image does not conform to the conditions, the image captured in the imaging stage is determined in the conformity determination stage that the image captured in the imaging stage conforms to the conditions. An output stage for converting and outputting an image with a lower image quality, an image acquisition stage for acquiring an image output in the output stage, and an image quality of the image acquired in the image acquisition stage being higher than a predetermined image quality In the image quality determination stage, it is determined in the image quality determination stage that the image quality of the image acquired in the image acquisition stage is higher than a predetermined image quality. The image quality reduction stage for reducing the image quality of the image acquired in the image acquisition stage to a quality lower than or equal to the predetermined image quality, and that the image quality of the image acquired in the image acquisition stage is higher than the predetermined image quality. If it is determined in the image quality determination stage, an image with reduced image quality is displayed in the image quality reduction stage, and it is determined in the image quality determination stage that the image quality of the image acquired in the image acquisition stage is equal to or lower than a predetermined image quality. If the image quality determination stage determines that the image quality of the image acquired in the image acquisition stage is higher than a predetermined image quality and a display stage for displaying the image acquired in the image acquisition stage. In a state where an image whose image quality has been reduced in the reduction stage is displayed in the display stage, the image quality is higher than a predetermined image quality in the image acquisition stage. And a display control step of displaying the display phase information indicating that the image was acquired quality.

  According to the sixth aspect of the present invention, there is provided a program for an imaging system, wherein the imaging system determines whether an imaging unit that captures an image and whether an image captured by the imaging unit meets a predetermined condition. When the conformity determination unit determines that the image captured by the imaging unit does not meet the conditions, the conformity determination determines that the image captured by the imaging unit conforms to the conditions. An output unit that converts and outputs an image with a lower quality than that determined by the image unit, an image acquisition unit that acquires an image output by the output unit, and whether the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality If the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality of the image acquired by the image acquisition unit is determined in advance. Reduced to an image quality below When the image quality determination unit determines that the image quality of the image acquired by the image quality reduction unit and the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays the image with the reduced image quality, and the image acquisition unit acquires When the image quality determination unit determines that the image quality of the obtained image is equal to or lower than the predetermined image quality, the display unit that displays the image acquired by the image acquisition unit and the image quality of the image acquired by the image acquisition unit are predetermined. When the image quality determination unit determines that the image quality is higher than the image quality, the image acquisition unit selects an image with a higher image quality than the predetermined image quality while the display unit displays an image whose image quality has been reduced by the image quality reduction unit. It is made to function as a display control part which displays the information which shows that it acquired on a display part.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, the display apparatus which can be displayed in a desired form can be provided, utilizing the spatial resolution and time resolution of an image.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an example of a usage environment of a monitoring system 110 according to an embodiment. The monitoring system 110 includes a plurality of imaging devices 100a to 100c, a transmission path 140, and a display device 175. The display device 175 includes a display control device 170, a recording device 172, and a plurality of monitors 180, 181, 182,. Although not shown, the imaging devices 100a to 100c are provided in each of the plurality of monitoring regions 150, 151, 152,... To capture the plurality of monitoring regions 150, 151, 152,. Hereinafter, the imaging devices 100 a to 100 c provided in each of the plurality of monitoring areas 150, 151, 152. Note that the monitoring system 110 may be the imaging system according to the present invention.

  The image capturing apparatus 100 transmits a moving image obtained by capturing the monitoring areas 150, 151, 152... To the display control apparatus 170 through the transmission path 140. The display control device 170 displays the moving image received from the imaging device 100 on the monitors 180, 181, 182. The monitors 180, 181, 182,... Display moving images of the monitoring areas 150, 151, 152,.

  The imaging apparatus 100 displays a frame image having a resolution higher than the monitor resolution that can be displayed by the monitors 180, 181, 182,... At a moving image display rate at which the monitors 180, 181, 182,. A moving image of the monitoring area 151 is captured at a frame rate higher than a certain monitor display rate. The imaging apparatus 100 converts the captured video into a video in which a frame image having a resolution equal to or lower than the monitor resolution is displayed at a rate equal to or lower than the monitor display rate while a human face is not detected in the captured video. The transmission continues to the display control device 170. The display control device 170 displays the moving image received from the imaging device 100 on the monitors 180, 181, 182,.

  Then, when a human face is detected in the moving image, the imaging apparatus 100 embeds the human face image in the frame image having a resolution higher than the monitor resolution included in the captured moving image in the moving image to be transmitted using the digital watermark. The display control device 170 extracts a face image embedded as a digital watermark in the moving image received from the imaging device 100 and records it in the recording device 172. The display control device 170 superimposes a display indicating that a high-resolution face image is included in the moving image received from the imaging device 100 and causes the monitors 180, 181, and 182 to display them. Then, when receiving an instruction to display the face image from the monitor, the display control device 170 enlarges the face image recorded in the recording device 172 and displays it on the monitors 180, 181, 182,.

  As described above, according to the monitoring system 110, the imaging apparatus 100 converts a video captured at a higher resolution and a higher frame rate than the monitor resolution and the monitor display rate into a video having the monitor resolution and the monitor display rate, and displays the video. It transmits to the control apparatus 170. When the person's face is detected, the imaging apparatus 100 embeds the person's face image in a moving image to be transmitted using the digital watermark technique. Therefore, even if the monitors 180, 181, 182,... Display the moving image transmitted from the imaging device 100 as it is, the monitor can monitor the moving image without feeling uncomfortable. In addition, the display control device 170 extracts the face image and records it in the recording device 172, so that the monitor can later confirm the high-resolution face image on the monitors 180, 181, and 182. Therefore, according to the monitoring system 110, even when the imaging device 100 with a high resolution and frame rate is newly introduced, the existing monitors 180, 181, 182 and the transmission path 140 can be used as they are, so that the user can take a photographing ability. It is easy to introduce an imaging device 100 having a high height.

  The monitoring areas 150, 151, 152... May be spaces in different buildings, or may be different spaces in the same building. For example, the monitoring areas 150, 151, 152... May be passages between display shelves in the store. Needless to say, the monitoring areas 150, 151, and 152 are not limited to spaces in buildings, but may be open spaces that are not surrounded by buildings.

  FIG. 2 shows an example of a block configuration of the imaging apparatus 100. The imaging apparatus 100 includes an imaging unit 200, a low data amount image generation unit 210, an object region specification unit 220, a size calculation unit 230, a conformity determination unit 240, a condition storage unit 250, an embedded image generation unit 260, an output unit 270, and a frequency. A component calculation unit 280 and an embedded region specifying unit 285 are provided.

  The imaging unit 200 captures an image. Then, the low data amount image generation unit 210 generates a low data amount image by reducing the data amount of the image captured by the image capturing unit 200. Specifically, the low data amount image generation unit 210 reduces the data amount of the image captured by the imaging unit 200 and generates a low data amount image that is equal to or smaller than a predetermined data amount.

  Then, the suitability determining unit 240 determines whether or not an object that meets a predetermined condition exists in the image captured by the image capturing unit 200. Then, when the conformity determining unit 240 determines that there is an object that meets the condition, the object region identifying unit 220 identifies an object region that includes an object that meets the condition. Then, when the matching determination unit 240 determines that there is an object that meets the conditions, the output unit 270 generates an image of the object area in the image captured by the imaging unit 200 by the low data amount image generation unit 210. It is embedded in the low data amount image and output.

  Specifically, the output unit 270 makes the viewer invisible to the low data amount image generated by the low data amount image generation unit 210 when the conformity determination unit 240 determines that there is an object that meets the conditions. The image of the object area is embedded in a simple form and output. More specifically, the output unit 270 determines that the image of the object area is generated by the low data amount image generation unit 210 when the conformity determination unit 240 determines that there is an object that satisfies the condition. The image is embedded with a digital watermark and output. For this reason, even if the image output from the imaging apparatus 100 is displayed as it is, the viewer can browse the image without feeling uncomfortable. On the other hand, if the image of the object area embedded in the low data amount image is extracted by image processing or the like, the image of the object area can be presented to the monitor.

  Specifically, the low data amount image generation unit 210 reduces the image quality of the image captured by the imaging unit 200 and generates a low quality image. Then, when the matching determination unit 240 determines that there is an object that meets the conditions, the output unit 270 generates an image of the object area in the image captured by the imaging unit 200 by the low data amount image generation unit 210. It is embedded in the low-quality image that has been output.

  More specifically, the low data amount image generation unit 210 reduces the resolution of the image captured by the imaging unit 200 and generates a low resolution image. For example, the low data amount image generation unit 210 may generate a low resolution image by thinning out pixels from the image captured by the imaging unit 200. Then, when the matching determination unit 240 determines that there is an object that meets the conditions, the output unit 270 generates an image of the object area in the image captured by the imaging unit 200 by the low data amount image generation unit 210. It is embedded in the low resolution image and output.

  Further, the low data amount image generation unit 210 may generate a low gradation image by reducing the gradation of the image captured by the imaging unit 200. In this case, when the matching determination unit 240 determines that there is an object that meets the conditions, the output unit 270 causes the low data amount image generation unit 210 to display an image of the object area in the image captured by the imaging unit 200. It is embedded in the generated low gradation image and output.

  Note that the imaging unit 200 may capture a moving image. In this case, the low data amount image generation unit 210 generates a low display rate moving image by reducing the display rate of the moving image captured by the image capturing unit 200. Then, the conformity determination unit 240 determines whether an object that conforms to a predetermined condition exists in the moving image captured by the image capturing unit 200. Then, when the conformity determining unit 240 determines that there is an object that meets the condition, the object region identifying unit 220 identifies an object region that includes an object that meets the condition. Then, when the matching determination unit 240 determines that there is an object that meets the conditions, the output unit 270 generates a moving image of the object area in the moving image captured by the imaging unit 200 by the low data amount image generating unit 210. Embedded in the low display rate video.

  Specifically, the imaging unit 200 captures a moving image including a plurality of images by continuously capturing a plurality of images. Then, the low data amount image generation unit 210 generates a low display rate moving image by reducing the display rate of the moving image captured by the imaging unit 200 by thinning out a plurality of images included in the moving image captured by the imaging unit 200. . Then, the conformity determination unit 240 determines whether or not an object that conforms to a predetermined condition exists in the image thinned out by the low data amount image generation unit 210. Then, when the conformity determining unit 240 determines that there is an object that meets the condition, the object region identifying unit 220 identifies an object region that includes an object that meets the condition. Then, when the matching determination unit 240 determines that there is an object that satisfies the condition, the output unit 270 converts the region image of the object region in the image thinned out by the low data amount image generation unit 210 into the low data amount image. The image is embedded in an image included in the low display rate moving image generated by the generation unit 210 and output.

  Note that the frequency component calculation unit 280 calculates a spatial frequency component in each of a plurality of regions of the image captured by the imaging unit 200. Then, the embedding area specifying unit 285 determines a predetermined value in a predetermined frequency area among a plurality of areas of the image captured by the imaging unit 200 based on the spatial frequency component calculated by the frequency component calculation unit 280. A region having a lower frequency component is identified as an embedded region. Specifically, the embedding region specifying unit 285 is a frequency region higher than a predetermined frequency among a plurality of regions of the image captured by the imaging unit 200 based on the spatial frequency component calculated by the frequency component calculation unit 280. A region having a frequency component lower than a predetermined value is specified as an embedded region. Then, the output unit 270 embeds the image of the object region in the low data amount image generated by the low data amount image generation unit 210 when the conformity determination unit 240 determines that there is an object that satisfies the condition. Embedded in a digital watermark and output.

  Note that the imaging unit 200 may continuously capture images with a data amount larger than the allowable data amount that is allowed to be output per unit time to the output destination output by the output unit 270. For example, the imaging unit 200 may continuously capture images with a data amount that is larger than the allowable data amount that the transmission path 140 is allowed to transmit per unit time. In addition, the imaging unit 200 may continuously capture images with a data amount larger than the data amount that the monitors 180 to 182 can process per unit time. In this case, the low data amount image generation unit 210 reduces the data amount of the image captured by the imaging unit 200, and generates a low data amount image having a data amount smaller than the allowable data amount. The output unit 270 embeds the image of the object area in the low data amount image generated by the low data amount image generation unit 210 when the conformity determination unit 240 determines that there is an object that meets the conditions. When the match determination unit 240 determines that there is no object that meets the condition, the low data amount image generation unit 210 outputs the low data amount image.

  Note that the size calculation unit 230 calculates the size of the object when the matching determination unit 240 determines that there is an object that meets the condition. Then, the object region specifying unit 220 determines that there is an object that meets the condition by the matching determination unit 240, and when the size calculated by the size calculating unit 230 is larger than a predetermined value, Identify object areas that contain objects that meet the criteria. The output unit 270 determines that the size calculated by the size calculation unit 230 is greater than a predetermined value when the matching determination unit 240 determines that there is an object that meets the conditions. The image of the object area in the image captured by the imaging unit 200 is embedded in the low data amount image generated by the low data amount image generation unit 210 and output. For this reason, according to the monitoring system 110, when an object is captured in a size that can be sufficiently monitored even with a low-resolution image, the object is output without being embedded. It is possible to prevent the amount from increasing.

  Note that the imaging unit 200 may continuously capture a plurality of images. In this case, the low data amount image generation unit 210 generates a plurality of low data amount images by reducing the data amount of each of the plurality of images captured by the imaging unit 200. Then, the output unit 270, when the conformity determination unit 240 determines that there is an object that meets the condition, the low data amount image generated from the image that is determined to have an object that conforms to the condition or After the image is captured, an image of the object region in the image thinned out by the low data amount image generation unit 210 is embedded in the low data amount image generated from the image captured by the imaging unit 200 and output.

  The embedded image generation unit 260 divides the image of the object area in the image captured by the imaging unit 200 into a plurality of partial areas when the matching determination unit 240 determines that there is an object that meets the conditions. Generate multiple embedded images. Then, the output unit 270 generates a plurality of embedded images generated by the embedded image generation unit 260 by the low data amount image generation unit 210 when the determination unit 240 determines that there is an object that meets the conditions. The images are sequentially embedded in the plurality of low data amount images. At this time, the embedded image generation unit 260 converts the image of the object region into a plurality of partial regions so that the data amount of the image output by the output unit 270 is smaller than the allowable data amount that the output unit 270 can output. A plurality of embedded images may be generated by dividing.

  Note that the condition storage unit 250 stores in advance the extraction conditions for suitable objects. Then, the matching determination unit 240 determines whether an object that matches the extraction condition stored in the condition storage unit 250 exists in the image captured by the imaging unit 200. Specifically, the condition storage unit 250 stores a lower limit value of the degree of coincidence of a shape with a predetermined object that should be included in a matching object. Then, the matching determination unit 240 determines whether or not an object having a matching degree equal to or higher than the lower limit value of the matching degree of the shape with a predetermined object exists in the image captured by the imaging unit 200.

  In addition, the condition storage unit 250 may store a lower limit value of the area of a color included in a predetermined color range that should be included in a matching object. In this case, the conformity determination unit 240 captures an object whose color area included in the predetermined color range is equal to or larger than the lower limit value of the color area stored in the condition storage unit 250 by the imaging unit 200. It is determined whether or not it exists in the image. In addition, the condition storage unit 250 may store a lower limit value of the amount of motion that the matching object should have. In this case, the conformity determination unit 240 determines whether an object having a motion amount equal to or greater than the lower limit value of the motion amount exists in the image captured by the image capturing unit 200.

  In addition, the conformity determination unit 240 may determine whether an image captured by the image capturing unit 200 conforms to a predetermined condition. Then, when the suitability determining unit 240 determines that the image captured by the image capturing unit 200 does not meet the conditions, the output unit 270 uses the image captured by the image capturing unit 200 as a condition. It may be converted into an image with a lower image quality than the case where the suitability judging unit 240 judges that it is fit, and may be output.

  As described above, according to the imaging apparatus 100, it is possible to provide a high-quality image while using the display device 175 or the transmission path 140 that cannot handle a high-quality image captured by the imaging apparatus 100. Note that the object in the present embodiment includes a region included in an image.

  FIG. 3 shows an example of an operation flow of the imaging apparatus 100. The imaging unit 200 captures a moving image in the monitoring area by continuously capturing frame images having a resolution higher than the monitor resolution of the monitors 180 to 182 at a frame rate higher than the monitor display rate of the monitors 180 to 182 (S302). ). The low data amount image generation unit 210 increments a thinning counter whose initial value is 0 each time the imaging unit 200 captures an image.

  Then, the matching determination unit 240 determines whether there is an object that matches the face of the person in the frame image captured by the imaging unit 200 (S304). For example, the matching determination unit 240 calculates the degree of coincidence of the shape between the contour of the object extracted by edge enhancement or the like and a predetermined human face pattern. For example, the matching determination unit 240 obtains a value obtained by dividing the area of the portion where the contour of the object matches the face pattern of the person having the same area as the contour of the object by the area of the contour of the object. Calculate as The matching determination unit 240 determines that there is an object that matches the face of the person when the calculated matching degree of the shape is equal to or higher than the lower limit value of the matching degree of the shape stored in the condition storage unit 250. .

  In S304, when the matching determination unit 240 determines that there is an object that matches the face of the person, the size calculation unit 230 calculates the area of the object. Then, the object area specifying unit 220 determines whether or not the area of the object that matches the person's face is larger than a predetermined reference value (S306). When the area calculated by the size calculation unit 230 is smaller than a predetermined reference value, the object region specifying unit 220 specifies a face region having a predetermined size including an object that matches the face of a person (S308). . The face area is an example of the object area in the present invention. Then, the embedded image generation unit 260 cuts out the face area specified in S308 from the image captured by the imaging unit 200, generates an embedded image, and stores the generated embedded image in the embedded image table (S310).

  Then, the low data amount image generation unit 210 determines whether or not the value of the thinning counter has reached a preset thinning number (S312). If the thinning counter has not reached the thinning number in S312, the imaging apparatus 100 shifts the process to S302. If the thinning counter reaches the thinning number in S312, the low data amount image generation unit 210 generates a low resolution image by thinning out pixels from the image captured by the imaging unit 200 (S314). At this time, the low data amount image generation unit 210 generates a low resolution image having a resolution equal to or lower than the monitor resolution.

  Then, the output unit 270 determines whether an embedded image exists in the embedded image table (S316). Specifically, when it is determined that an embedded image exists, the output unit 270 generates and stores the low-resolution image generated by the low data amount image generation unit 210 in S314 by the embedded image generation unit 260. The embedded image is embedded as a digital watermark (S318). At this time, the embedded image generation unit 260 removes the embedded image from the embedded image table. Then, the output unit 270 generates a moving image to be output from the low resolution image in which the embedded image is embedded (S320). If it is determined in S316 that there is no embedded image, the output unit 270 generates a moving image to be output from the low-resolution image generated in S314 (S320).

  Then, the imaging apparatus 100 determines whether an imaging end instruction has been received (S322). When the imaging end instruction is not received in S322, the imaging apparatus 100 proceeds to S302, and when the imaging end instruction is received in S322, the process ends. In S304, when it is determined that there is no object that matches the face of the person in S304, or when it is determined in S306 that the area of the object is larger than a predetermined value, imaging is performed. The apparatus 100 shifts the process to the determination of S312.

  As described above, the imaging device 100 generates a moving image including a frame image obtained by reducing the image captured by the imaging unit 200 to the monitor resolution, and outputs the generated moving image to the display control device 170. Then, when a face is detected, the imaging apparatus 100 embeds the detected face image as a digital watermark in a frame image included in a moving image to be output. Since the resolution of the frame image output from the imaging apparatus 100 is the monitor resolution, the monitors 180 to 182 can display the moving image transmitted from the imaging apparatus 100 as it is. In addition, since the output unit 270 embeds a person's face in a form that is invisible to the monitoring person, even if the monitors 180 to 182 display the moving image transmitted from the imaging apparatus 100 as it is, the monitoring person can monitor without discomfort as usual. be able to.

  Note that the display control device 170 may extract a face image from the moving image and record it in the recording device 172. Then, the display control device 170 may superimpose and display information indicating that a face image exists. Then, according to an instruction from the supervisor, a face image may be read from the recording device 172 and enlarged and displayed on the monitors 180 to 182. The operation of the display control device 170 will be described in more detail with reference to FIG.

  FIG. 4 shows an example of a frame image included in the moving image output from the output unit 270 in time series. The imaging unit 200 captures the frame images 411 to 419 continuously at a predetermined time interval. The low data amount image generation unit 210 generates a low resolution image from frame images selected every predetermined number of the frame images 411 to 419. For example, the low data amount image generation unit 210 thins out the pixels of the frame images 411, 415, and 419 captured at times t401, t405, and t409, or averages a plurality of pixels to thereby generate the low resolution images 421 and 425. , And 429 are generated.

  When the suitability determining unit 240 determines that a person's face exists in the frame image 414, the embedded image generating unit 260 generates embedded images 431 and 432 obtained by dividing the face image 430 including the person's face into two. The embedded image generation unit 260 divides the face image 430 into a size that can be embedded in the low resolution image. An example of a method for determining the number of divisions will be described later. Then, the output unit 270 embeds the embedded images 431 and 432 in the low resolution images 425 and 429, respectively, with a digital watermark. Then, the output unit 270 generates a moving image using the low resolution images 421, 425, and 429. For example, the output unit 270 may generate a moving image by MPEG encoding the low resolution images 421, 425, and 429.

  FIG. 5 shows an example of a method in which the output unit 270 embeds an embedded image. The output unit 270 embeds the bit value 1 included in the embedded image data by increasing the luminance value of the second pixel adjacent to the first pixel from the luminance value of the first pixel, and the luminance of the first pixel The bit value 0 is embedded by making the luminance value of the second pixel smaller than the value. Further, the output unit 270 embeds the embedded image by increasing the luminance value of the second pixel from the intensity value of the first pixel for each of the luminance values of the plurality of color components indicating the intensities of the plurality of color components. The bit value 1 included in the data may be embedded, and the bit value 0 may be embedded by making the luminance value of the second pixel smaller than the luminance value of the first pixel. Accordingly, the output unit 270 can embed 1 bit of the embedded image per 2 pixels for each of the plurality of color components.

  The embedding area specifying unit 285 specifies a partial area having a low high-frequency component as an embedding area, and the output unit 270 embeds an embedded image in the embedding area specified by the embedding area specifying unit 285. Specifically, the frequency component calculation unit 280 calculates a spatial frequency component for each of a plurality of partial regions in the low resolution images 421, 425, and 429. Then, the embedding area specifying unit 285 specifies, as an embedding area, a partial area in which the spatial frequency component is equal to or less than a predetermined value in a spatial frequency area equal to or higher than a predetermined frequency. As described above, since the embedding area specifying unit 285 specifies an area having a low spatial frequency as an embedding area, for example, it is possible to reduce the amount of image quality degradation caused by changing the luminance value of an adjacent pixel.

  FIG. 6 shows another example of a method in which the output unit 270 embeds an embedded image. When the output unit 270 encodes and transmits a plurality of frame images by MPEG encoding, the DCT coefficient of the block (luminance block or color difference block) calculated in the MPEG encoding process is used as the bit value of the embedded image data. Embed in. For example, the output unit 270 embeds the bit value of the embedded image data in the DCT coefficient obtained by DCT conversion for the Y, Cr, and Cb components of each block of the low resolution image.

  For example, the output unit 270 embeds the bit value 0 of the embedded image data by converting the DCT coefficient to the even number closest to the calculated DCT coefficient, and converts the DCT coefficient to the odd number closest to the calculated DCT coefficient. As a result, the bit value 1 of the embedded image data is embedded. The output unit 270 can embed the embedded image data in all the DCT coefficients in the block, but may embed the embedded image data in the DCT coefficient indicating a low frequency component equal to or lower than a predetermined frequency. The number of bits that can be embedded in the block is determined according to the frequency region to be embedded.

  In this way, the output unit 270 can embed the bit value of the embedded image data in the frequency domain of the frame image to be output. In addition, the output unit 270 can use various embedding methods such as directly embedding the bit value of the embedded image data in the lower bits of the bit string indicating the luminance value of one pixel. In addition, the embedded image generation unit 260 calculates the number of pixels of an image that can be embedded in the embedded region based on the number of pixels in the embedded region specified by the embedded region specifying unit 285, and the calculated pixel number and output unit 270 The division number of the face image 450 is determined based on the number of bits that can be embedded per pixel and the number of bits that represent the face image 450.

  FIG. 7 shows an example of the conditions stored in the condition storage unit 250. The condition storage unit 250 stores the area of the person, the speed of movement of the object, the area of the change area, the area of the specific color, the degree of coincidence of the shape with the reference object, and the degree of coincidence of the movement direction with the reference direction For each, a lower limit value (S1, V1, Sα, Sβ, sγ, md) is stored. Then, in the frame image captured by the image capturing apparatus 100, the conformity determination unit 240 is configured such that the area of a person equal to or higher than the lower limit value stored in the condition storage unit 250, the moving speed of the object, the area of the change region, When an object having a degree of coincidence with the reference object or a degree of coincidence with the reference direction is detected, the condition storage unit 250 stores the object or the frame image. Judged to meet the conditions.

  Note that the condition storage unit 250 uses the lower limit value of the number of pixels having a pixel value changed by a predetermined value or more as a lower limit value of the area of the change region between a plurality of frame images captured by the imaging unit 200. May be stored. Further, the condition storage unit 250 may store a lower limit value of the ratio of the number of pixels having a pixel value changed by a predetermined value or more with respect to the total number of pixels of the frame image as a lower limit value of the area of the change region. . Note that the pixel value may be a luminance value.

  In addition, the condition storage unit 250 may store the lower limit value of the number of pixels having colors included in a predetermined color range included in the plurality of frame images as the lower limit value of the area of the specific color. Further, the condition storage unit 250 may store the lower limit value of the ratio of the number of pixels having a color included in a predetermined color range with respect to the total number of pixels of the frame image as the lower limit value of the area of the specific color. Good.

  In addition, the condition storage unit 250 uses the lower limit value of the area of the portion overlapping the predetermined reference object having the same area as the contour of the object included in the frame image as the lower limit value of the degree of coincidence of the shape with the reference object. May be stored as In addition, the condition storage unit 250 sets the lower limit value of the ratio of the area of the portion overlapping the predetermined reference object having the same area as the outline of the object included in the frame image to the area of the object to the reference object. It may be stored as the lower limit value of the shape matching degree.

  In addition, the condition storage unit 250 sets the lower limit value of the index value that is inversely proportional to the angle formed between the movement direction of the object included in the frame image and a predetermined reference direction, and the lower limit value of the matching degree between the reference direction and the movement direction. It may be stored as a value. The reference direction may be a predetermined direction on the frame image or may be a predetermined direction in real space. Note that the condition storage unit 250 is a lower limit value of an index value that is inversely proportional to the angle formed between the moving direction of the subject indicated by the object included in the frame image or the averaged image and the direction from the position of the subject toward the imaging unit 200. May be stored as the lower limit value of the degree of coincidence between the reference direction and the moving direction.

  As described above, the condition storage unit 250 is an object having a color included in a predetermined specific color area, an object that moves between a plurality of frames, or an area that has changed between a plurality of frames. Therefore, the imaging apparatus 100 can extract an object that is desirable as a monitoring target.

  FIG. 8 shows an example of a block configuration of the display device 175. The display device 175 includes an image acquisition unit 700, an image quality reduction unit 710, an image quality determination unit 740, an image holding unit 750, a high image quality region specifying unit 760, a display unit 770, a display control unit 780, and an instruction input unit 790. .. Are examples of the display unit 770, and the recording device 172 is an example of the image holding unit 750.

  The image acquisition unit 700 acquires an image. Specifically, the image output by the output unit 270 is acquired. Then, the image quality determination unit 740 determines whether the image quality of the image acquired by the image acquisition unit 700 is higher than a predetermined image quality. Then, when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the predetermined image quality, the image quality reduction unit 710 sets the image quality of the image acquired by the image acquisition unit 700 in advance. Reduce to an image quality that is less than or equal to the specified image quality. When the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the predetermined image quality, the display unit 770 displays the image with the image quality reduction unit 710 reduced in image quality. When the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is equal to or lower than a predetermined image quality, the image acquired by the image acquisition unit 700 is displayed.

  Then, when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the predetermined image quality, the display control unit 780 displays an image in which the image quality reduction unit 710 has reduced the image quality. While the unit 770 is displaying, the display unit 770 displays information indicating that the image acquisition unit 700 has acquired an image with a higher image quality than a predetermined image quality. Specifically, the display control unit 780 displays the image quality displayed by the display unit 770 when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than a predetermined image quality. The reduction unit 710 causes the display unit 770 to display characters indicating that the image acquisition unit 700 has acquired an image with a higher image quality than a predetermined image quality by superimposing the image with the image quality reduced. For example, when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than a predetermined image quality, the display control unit 780 displays the image quality reduction unit 710 displayed by the display unit 770. May be superimposed on an image with reduced image quality and characters including a term indicating high image quality may be displayed on the display unit 770.

  In addition, the display control unit 780 reduces the image quality displayed by the display unit 770 when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than a predetermined image quality. The display unit 770 may display a mark indicating that the image acquisition unit 700 has acquired an image with a higher image quality than a predetermined image quality by superimposing the image with the image quality reduced by the unit 710.

  The image quality determination unit 740 may determine whether the image quality of the image acquired by the image acquisition unit 700 is higher than the image quality that can be displayed by the display unit 770. In this case, the image quality reduction unit 710 is acquired by the image acquisition unit 700 when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the image quality that can be displayed by the display unit 770. The image quality of the processed image is reduced to an image quality that can be displayed by the display unit 770. When the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the image quality that can be displayed by the display unit 770, the image quality reduction unit 710 reduces the image quality. The image acquired by the image acquisition unit 700 is displayed when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is lower than the image quality that can be displayed by the display unit 770. Is displayed. Then, when the image quality determination unit 740 determines that the image quality of the image acquired by the image acquisition unit 700 is higher than the image quality that can be displayed by the display unit 770, the image quality reduction unit 710 determines the image quality. In a state where the reduced image is displayed on the display unit 770, the image acquisition unit 700 causes the display unit 770 to display information indicating that an image with a higher image quality than the display unit 770 can display.

  In addition, the image quality determination unit 740 determines whether the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that the display unit 770 can display. Then, the image quality reduction unit 710 acquires the image acquisition unit 700 when the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that the display unit 770 can display. The resolution of the image is reduced to a resolution equal to or lower than the resolution that the display unit 770 can display. When the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that can be displayed by the display unit 770, the image quality reduction unit 710 reduces the resolution. The image acquired by the image acquisition unit 700 is displayed when the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is equal to or lower than the resolution that can be displayed by the display unit 770. Is displayed. When the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that can be displayed by the display unit 770, the display control unit 780 determines the resolution. In a state where the reduced image is displayed on the display unit 770, the image acquisition unit 700 causes the display unit 770 to display information indicating that an image having a higher resolution than the display unit 770 can display.

  The image holding unit 750 holds the image acquired by the image acquisition unit 700 when the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than a predetermined resolution. Then, the instruction input unit 790 receives an instruction to display the image held by the image holding unit 750 from the user. Then, when the instruction input unit 790 receives an instruction to display the image held by the image holding unit 750 from the user, the display control unit 780 displays at least a part of the image held by the image holding unit 750. The partial area is enlarged, and an image of the partial area is displayed on the display unit 770 at a resolution that can be displayed by the display unit 770.

  In addition, when the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that can be displayed by the display unit 770, the image acquisition unit 700 In the acquired image, a high-quality area higher than the resolution that can be displayed by the display unit 770 is specified. When the image quality determination unit 740 determines that the resolution of the image acquired by the image acquisition unit 700 is higher than the resolution that can be displayed by the display unit 770, the display control unit 780 determines the resolution. In a state where the reduced image is displayed on the display unit 770, a frame surrounding the high image quality area specified by the high image quality area specifying unit 760 is displayed on the display unit 770.

  The image acquisition unit 700 acquires a moving image. Specifically, the image quality determination unit 740 determines whether the image quality of the moving image acquired by the image acquisition unit 700 is higher than a predetermined image quality. The image quality reduction unit 710 determines the moving image acquired by the image acquisition unit 700 when the image quality determination unit 740 determines that the image quality of the moving image acquired by the image acquisition unit 700 is higher than the predetermined image quality. The image quality is reduced to below the desired image quality. Then, when the image quality determination unit 740 determines that the image quality of the moving image acquired by the image acquisition unit 700 is higher than a predetermined image quality, the display unit 770 displays the moving image with the image quality reduction unit 710 reduced in image quality. When the image quality determination unit 740 determines that the image quality of the moving image acquired by the image acquisition unit 700 is equal to or lower than the predetermined image quality, the moving image acquired by the image acquisition unit 700 is displayed. Then, when the image quality determination unit 740 determines that the image quality of the moving image acquired by the image acquisition unit 700 is higher than a predetermined image quality, the display control unit 780 displays the moving image in which the image quality reduction unit 710 has reduced the image quality. In a state where the unit 770 is displaying, the display unit 770 displays information indicating that the image acquisition unit 700 has acquired a moving image having a higher image quality than a predetermined image quality.

  Specifically, the image quality determination unit 740 determines whether the display rate of the moving image acquired by the image acquisition unit 700 is higher than the display rate that the display unit 770 can display. Then, when the image quality determination unit 740 determines that the display rate of the moving image acquired by the image acquisition unit 700 is higher than the display rate that can be displayed by the display unit 770, the image acquisition unit 700 The display rate of the acquired moving image is reduced to a display rate equal to or lower than the display rate that the display unit 770 can display. Then, when the image quality determination unit 740 determines that the display rate of the moving image acquired by the image acquisition unit 700 is higher than the display rate that can be displayed by the display unit 770, the image quality reduction unit 710 When the image quality determination unit 740 determines that the display rate of the video acquired by the image acquisition unit 700 is equal to or lower than the display rate that can be displayed by the display unit 770, the image acquisition unit 700 Displays videos acquired by. When the image quality determination unit 740 determines that the display rate of the moving image acquired by the image acquisition unit 700 is higher than the display rate that the display unit 770 can display, the display control unit 780 determines that the image quality reduction unit 710 In the state where the display unit 770 displays a moving image with a reduced display rate, the display unit 770 displays information indicating that the image acquisition unit 700 has acquired an image with a higher image quality than the display rate that the display unit 770 can display. To display.

  The image holding unit 750 determines that the image acquisition unit 700 determines that the display rate of the moving image acquired by the image acquisition unit 700 is higher than the display rate that the display unit 770 can display. Hold the acquired video. Then, the instruction input unit 790 receives an instruction from the user to display the moving image held by the image holding unit 750. Then, when the instruction input unit 790 receives an instruction to display the moving image held by the image holding unit 750 from the user, the display control unit 780 includes a plurality of moving images included in the moving image held by the image holding unit 750. The image is displayed on the display unit 770 at a display rate that the display unit 770 can display.

  FIG. 9 shows an example of the operation flow of the display device 175. The image acquisition unit 700 acquires a moving image from the imaging device 100 (S902). Then, the image acquisition unit 700 extracts a series of frame images from the moving image acquired in S902 (S904). For example, when the MPEG acquisition moving image is acquired from the output unit 270, the image acquisition unit 700 extracts a plurality of pictures from an I picture to a picture immediately before the next I picture as a series of frame images. . In addition, the image acquisition unit 700 may acquire a predetermined number of frame images constituting a moving image of a predetermined period, or one scene of moving image determined based on a change in the image content of the moving image. May be acquired as a series of frame images.

  Then, the image quality determination unit 740 determines whether to display a frame image (S906). For example, when the image quality determination unit 740 displays a moving image on the display unit 770 by appropriately thinning out the moving image acquired from the imaging device 100, the number of thinned frame images after the display unit 770 displays the previous frame image is calculated. When the frame image thinning number to be thinned out to display the frame image at the display rate that can be displayed by the display unit 770 is reached, it is determined that the frame image is displayed. If it is determined in S906 that the frame image is not displayed, the image holding unit 750 stores the frame image (S932), and the process proceeds to S904.

  Then, the image quality determination unit 740 determines whether or not a region having a resolution higher than the resolution that can be displayed by the display unit 770 exists in the frame image (S908). When the output unit 270 partially outputs a high-resolution image, the output unit 270 outputs a moving image together with information indicating the resolution for each region. In this case, the image quality determination unit 740 displays the resolution. By referring to the information to be shown, it may be determined whether or not a region having a resolution higher than the resolution that can be displayed by the display unit 770 exists in the frame image. If it is determined in S908 that a high-resolution area exists in the frame image, the image holding unit 750 stores the image of the high-resolution area (S910). Then, the image quality reduction unit 710 converts the frame image to a resolution that can be displayed by the display unit 770 (S912). Then, the display control unit 780 superimposes a frame indicating the high-resolution area specified by the high-quality area specifying unit 760 on the low-resolution frame image converted by the image quality reduction unit 710 (S914).

  Then, the display control unit 780 determines whether there is a frame image that is not displayed (S916). Specifically, if it is determined in S906 that no frame image is displayed in a period from a current time to a current time, a determination is made that there is a frame image that is not displayed. If it is determined in S916 that there is a frame image that is not displayed, the display control unit 780 superimposes the frame advance button on the low-resolution frame image converted by the image quality reduction unit 710 (S918). The display unit 770 displays the frame image on the display unit 770 (S920).

  Then, it is determined whether or not all of the moving images acquired in S902 have been processed (S922). If all of the moving images have been processed, the processing ends. If all of the moving images have not been processed, the processing ends. The process returns to S904. If it is determined in S916 that there is no frame image not displayed, the process proceeds to S920. If it is determined in S908 that the high-resolution area does not exist in the frame image, the process proceeds to S916.

  In the above description, the operation of the display device 175 has been described using a sequential processing flow in order to avoid complicating the description. However, some of the above processing may be different from other processing. Needless to say, it can be done in parallel. For example, the process of acquiring a moving image in S902 and the process of extracting a series of frame images in S904 can be performed in parallel with other processes. As described above, the display device 175 converts the high display rate and high resolution video captured by the imaging device 100 into a form that can be displayed by the display unit 770, and displays the high display rate or high resolution. It is possible to indicate to the monitoring person that the moving image is obtained by a frame or a frame advance button.

  FIG. 10 shows an example of timing at which the display unit 770 displays an image. The image acquisition unit 700 acquires a moving image including the frame images 1001 to 1020 from the imaging device 100. The image quality reduction unit 710 then displays the frame images 1012, 1013, 1014, and 1016 included in the moving image so that the display rate of the frame image displayed on the display unit 770 is equal to or lower than the display rate that the display unit 770 can display. Thin out 1017, 1018, 1020. The image holding unit 750 stores the thinned frame images 1012, 1013, 1014, 1016, 1017, 1018, 1020.

  In addition, when the resolution of the frame image is equal to or higher than the resolution that can be displayed by the display unit 770, the image quality reduction unit 710 can display the frame images 1011, 1015, and 1019 to the resolution that can be displayed by the display unit 770. The display frame images 1021, 1025, and 1029 are generated by reducing the resolution. The display unit 770 displays the moving image with reduced resolution and display rate by sequentially displaying the display frame images 1021, 1025, and 1029. Since the resolution of the frame image is higher than the resolution that the display unit 770 can display, the image holding unit 750 also stores the frame images 1011, 1015, and 1019.

  Then, when there is a thinned frame image, the display control unit 780 causes the display unit 770 to display a frame advance mark on the display frame images 1025 and 1029. Further, when the resolution of the frame image is equal to or higher than the resolution that can be displayed by the display unit 770, the display control unit 780 indicates that a high resolution can be displayed on the display frame images 1021, 1025, and 1029. Are superimposed and displayed on the display unit 770.

  Note that if a high-resolution area partially exists, the high-quality area specifying unit 760 specifies the high-resolution area. In addition, when the image capturing apparatus 100 embeds an object in a frame image with a digital watermark or the like, the high image quality region specifying unit 760 specifies a region including the object. Then, the display control unit 780 causes the display unit 770 to display the frame surrounding the high-resolution region or the region including the object on the frame images 1021, 1025, and 1029 to be displayed.

  As described above, the display device 175 causes the monitor to recognize that an image having a display rate or resolution higher than the display capability of the display unit 770 is obtained by superimposing a mark or a frame on the frame image. be able to.

  FIG. 11 shows an example of an image displayed on the display unit 770. The display control unit 780 causes the display unit 770 to display a frame 1102 surrounding an object that can be displayed with high image quality, superimposed on the low-quality image (screen 1100). The image in the frame 1102 is held by the image holding unit 750. When the area in the frame 1102 is touched by the finger of the supervisor or the area in the frame 1102 is pointed by an input device such as a mouse, the instruction input unit 790 displays the image in the frame 1102 in an enlarged manner. Accept.

  When the instruction input unit 790 accepts that the image in the frame 1002 is enlarged and displayed, the image of the object surrounded by the selected frame 1102 is acquired from the image holding unit 750 and displayed on the display unit 770. Since the image of the object held in the image holding unit 750 is higher in resolution than the display unit 770 can display, the object is enlarged and displayed on the display unit 770. In this way, the monitor can check on the existing monitors 180 to 182 a high-resolution image including an object such as an important person as a monitoring target.

  FIG. 12 shows another example of an image displayed on the display unit 770. When the frame image is thinned and displayed, the display control unit 780 superimposes a mark 1202 indicating that the thinned frame image can be played back by frame forwarding on the frame image to be displayed (screen 1200). When the position where the mark 1202 is displayed is touched with the finger of the supervisor or pointed with an input device such as a mouse, the instruction input unit 790 accepts an instruction to display frame advance.

  When the instruction input unit 790 receives an instruction for frame-by-frame display, the thinned frame image is acquired from the image holding unit 750, and whenever the instruction input unit 790 further receives an instruction for frame-by-frame display, The information is sequentially displayed on the display unit 770. Note that the frame image held in the image holding unit 750 may be played back at a display rate that can be displayed by the display unit 770. In this case, the display unit 770 plays back more slowly than it actually is. Through the above operation, the supervisor can confirm the detailed movement of the person.

  FIG. 13 illustrates an example of a hardware configuration of a computer 1500 related to the imaging device 100 and the display device 175. The computer 1500 includes a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a communication interface 1530 connected to the host controller 1582 by an input / output controller 1584. An input / output unit having a hard disk drive 1540 and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the computer 1500. The communication interface 1530 communicates with the imaging device 100 and the display device 175 via the network, and provides programs and data to the imaging device 100 and the display device 175. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the computer 1500 is started up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the communication interface 1530 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program is read from the recording medium, provided to the communication interface 1530 via the RAM 1520, and transmitted to the imaging device 100 and the display device 175 via the network. The program transmitted to the imaging device 100 and the display device 175 is installed and executed in the imaging device 100 and the display device 175.

  A program that is installed and executed in the imaging apparatus 100 includes the imaging apparatus 100 described with reference to FIGS. 1 to 11, the low data amount image generation unit 210, the object area identification unit 220, and the size calculation. Unit 230, conformity determination unit 240, condition storage unit 250, embedded image generation unit 260, output unit 270, frequency component calculation unit 280, and embedded region identification unit 285. The program that is installed and executed on the display device 175 includes the image acquisition unit 700, the image quality reduction unit 710, the image quality determination unit 740, the image holding unit 750, and the high image display unit 175 described with reference to FIGS. It functions as an image quality region specifying unit 760, a display unit 770, a display control unit 780, and an instruction input unit 790.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1500 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

2 is a diagram illustrating an example of a usage environment of a monitoring system 110. FIG. 1 is a diagram illustrating an example of a block configuration of an imaging apparatus 100. FIG. 3 is a diagram illustrating an example of an operation flow of the imaging apparatus 100. FIG. It is a figure which shows an example of the frame image of the moving image which the output part 270 outputs in a time series. It is a figure which shows an example of the method the output part 270 embeds an embedded image. It is a figure which shows another example of the method by which the output part 270 embeds an embedded image. It is a figure which shows an example of the conditions which the condition storage part 250 has stored. 3 is a diagram illustrating an example of a block configuration of a display device 175. FIG. 12 is a diagram illustrating an example of an operation flow of the display device 175. FIG. It is a figure which shows an example of the timing which the display part 770 displays an image. It is a figure which shows an example of the image which the display part 770 displays. It is a figure which shows another example of the image which the display part 770 displays. FIG. 25 is a diagram illustrating an example of a hardware configuration of a computer 1500 related to the imaging device 100 and the display device 175.

Explanation of symbols

100 imaging device 110 monitoring system 140 transmission path 150 monitoring region 151 monitoring region 152 monitoring region 170 display control device 172 recording device 175 display device 180 monitor 181 monitor 182 monitor 200 imaging unit 210 low data amount image generation unit 220 object region specifying unit 230 Size calculation unit 240 Conformity determination unit 250 Condition storage unit 260 Embedded image generation unit 270 Output unit 280 Frequency component calculation unit 285 Embedded region specification unit 700 Image acquisition unit 710 Image quality reduction unit 740 Image quality determination unit 750 Image holding unit 760 High image quality region Specification unit 770 Display unit 780 Display control unit 790 Instruction input unit

Claims (15)

An image acquisition unit for acquiring images;
An image quality determination unit for determining whether the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality of the image acquired by the image acquisition unit is equal to or lower than the predetermined image quality. An image quality reduction unit to reduce,
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays an image with reduced image quality, and the image acquisition unit acquires A display unit for displaying the image acquired by the image acquisition unit when the image quality determination unit determines that the image quality of the image obtained is equal to or lower than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display unit displays an image with the image quality reduced by the image quality reduction unit A display device comprising: a display control unit that causes the display unit to display information indicating that the image acquisition unit has acquired an image having a higher image quality than a predetermined image quality. The image quality determination unit determines whether the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit;
The image quality reduction unit, when the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit, Reducing the image quality to an image quality below the image quality that the display unit can display,
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit, the display unit reduces the image quality of the image. And when the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is lower than the image quality that can be displayed by the display unit, the image acquired by the image acquisition unit is displayed. And
The display control unit reduces the image quality when the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the image quality that can be displayed by the display unit. 2. The display unit displays information indicating that the image acquisition unit has acquired an image with higher image quality than can be displayed by the display unit in a state where the display unit displays an image. The display device described in 1. The image quality determination unit determines whether the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit;
The image quality reduction unit, when the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, Reducing the resolution to a resolution below the resolution that the display unit can display,
When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, the display unit reduces the resolution of the image. And when the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is lower than the resolution that can be displayed by the display unit, the image acquired by the image acquisition unit is displayed. And
When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that the display unit can display, the display control unit reduces the resolution. 3. The display unit displays information indicating that the image acquisition unit has acquired an image having a higher resolution than the display unit can display in a state where the display unit displays an image. The display device described in 1. An image holding unit that holds the image acquired by the image acquisition unit when the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than a predetermined resolution;
An instruction input unit for receiving an instruction to display an image held by the image holding unit from a user;
The display control unit, when the instruction input unit receives an instruction to display an image held by the image holding unit from a user, at least a partial area of the image held by the image holding unit The display device according to claim 3, wherein an image of the partial area is displayed on the display unit at a resolution that can be displayed by the display unit. When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, in the image acquired by the image acquisition unit, the display unit It further includes a high-quality area specifying unit that specifies a high-quality area higher than the resolution that can be displayed,
When the image quality determination unit determines that the resolution of the image acquired by the image acquisition unit is higher than the resolution that can be displayed by the display unit, the display control unit reduces the resolution. The display device according to claim 3, wherein a frame surrounding the high-quality area specified by the high-quality area specifying unit is displayed on the display unit in a state where the display unit displays an image. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display control unit displays the image quality reduction unit displayed on the display unit. The display device according to claim 1, wherein a character indicating that the image acquisition unit has acquired an image having a higher image quality than a predetermined image quality is displayed on the display unit so as to be superimposed on an image with reduced image quality. When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display control unit displays the image quality reduction unit displayed on the display unit. 2. The display device according to claim 1, wherein a mark indicating that the image acquisition unit has acquired an image with a higher image quality than a predetermined image quality is displayed on the display unit so as to be superimposed on an image with reduced image quality. The image acquisition unit acquires a video,
The image quality determination unit determines whether the image quality of the moving image acquired by the image acquisition unit is higher than a predetermined image quality,
When the image quality determination unit determines that the image quality of the moving image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality reduction unit determines the moving image acquired by the image acquisition unit as the predetermined image quality. Reduced to the following image quality,
When the image quality determination unit determines that the image quality of the moving image acquired by the image acquisition unit is higher than a predetermined image quality, the display unit displays the moving image with the image quality reduced, When the image quality determination unit determines that the image quality of the video acquired by the image acquisition unit is equal to or lower than a predetermined image quality, the video acquired by the image acquisition unit is displayed.
When the image quality determination unit determines that the image quality of the moving image acquired by the image acquisition unit is higher than a predetermined image quality, the display control unit displays the moving image having the image quality reduced by the image quality reduction unit. The display device according to claim 1, wherein information indicating that the image acquisition unit has acquired a moving image having a higher image quality than a predetermined image quality is displayed on the display unit in a state where is displayed. The image quality determination unit determines whether a display rate of the moving image acquired by the image acquisition unit is higher than a display rate that can be displayed by the display unit;
The image quality reduction unit is acquired by the image acquisition unit when the image quality determination unit determines that the display rate of the moving image acquired by the image acquisition unit is higher than a display rate that can be displayed by the display unit. The display rate of the video is reduced to a display rate that is lower than the display rate that the display unit can display,
When the image quality determination unit determines that the display rate of the moving image acquired by the image acquisition unit is higher than the display rate that can be displayed by the display unit, the image quality reduction unit reduces the image quality. When the image quality determination unit determines that the display rate of the video acquired by the image acquisition unit is equal to or lower than the display rate that can be displayed by the display unit, the image acquisition unit acquires Displayed,
When the image quality determination unit determines that the display rate of the moving image acquired by the image acquisition unit is higher than the display rate that can be displayed by the display unit, the image quality reduction unit displays the display rate. Information indicating that the image acquisition unit has acquired an image with a higher image quality than the display rate that can be displayed by the display unit in a state where the display unit displays a moving image with reduced image quality. The display device according to claim 1. Image holding that holds the video acquired by the image acquisition unit when the image quality determination unit determines that the display rate of the video acquired by the image acquisition unit is higher than the display rate that the display unit can display And
An instruction input unit that receives an instruction from the user to display the moving image held by the image holding unit;
The display control unit includes a plurality of moving image configurations included in the moving image held by the image holding unit when the instruction input unit receives an instruction to display the moving image held by the image holding unit from a user. The display device according to claim 9, wherein an image is displayed on the display unit at a display rate that the display unit can display. An image acquisition stage for acquiring images;
An image quality determination step of determining whether the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality;
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, the image quality of the image acquired in the image acquisition step is equal to or lower than the predetermined image quality. Image quality reduction stage to reduce to the image quality of
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, an image whose image quality has been reduced in the image quality reduction step is displayed, and the image acquisition A display step of displaying the image acquired in the image acquisition step when it is determined in the image quality determination step that the image quality of the image acquired in the step is equal to or lower than a predetermined image quality;
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, an image whose image quality has been reduced in the image quality reduction step is displayed in the display step. A display control step of displaying in the display step information indicating that an image having a higher image quality than the predetermined image quality has been acquired in the image acquisition step. A program for a display device, wherein the display device is
An image acquisition unit for acquiring images;
An image quality determination unit for determining whether the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality of the image acquired by the image acquisition unit is equal to or lower than the predetermined image quality. Image quality reduction section to reduce,
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays an image with reduced image quality, and the image acquisition unit acquires A display unit that displays the image acquired by the image acquisition unit when the image quality determination unit determines that the image quality of the image is less than or equal to a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display unit displays an image with the image quality reduced by the image quality reduction unit A program that causes the display unit to function as a display control unit that displays information indicating that the image acquisition unit has acquired an image with a higher image quality than a predetermined image quality. An imaging unit that captures an image;
A conformity determination unit that determines whether an image captured by the image capturing unit conforms to a predetermined condition;
When the conformity determining unit determines that the image captured by the image capturing unit does not conform to the condition, the image captured by the image capturing unit is determined to indicate that the image captured by the image capturing unit conforms to the condition. An output unit that converts and outputs a lower quality image than the case where the conformity determination unit determines;
An image acquisition unit for acquiring an image output by the output unit;
An image quality determination unit for determining whether the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than the predetermined image quality, the image quality of the image acquired by the image acquisition unit is equal to or lower than the predetermined image quality. An image quality reduction unit to reduce,
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays an image with reduced image quality, and the image acquisition unit acquires A display unit that displays the image acquired by the image acquisition unit when the image quality determination unit determines that the image quality of the obtained image is equal to or lower than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display unit displays an image with the image quality reduced by the image quality reduction unit An image pickup system comprising: a display control unit that causes the display unit to display information indicating that the image acquisition unit has acquired an image having a higher image quality than a predetermined image quality. An imaging stage for capturing an image;
A conformity determination step of determining whether or not an image captured in the imaging step conforms to a predetermined condition;
When it is determined in the conformity determination stage that the image captured in the imaging stage does not meet the condition, the image captured in the imaging stage conforms to the condition. An output stage for converting and outputting an image of lower quality than that determined in the suitability judgment stage;
An image acquisition step of acquiring the image output in the output step;
An image quality determination step of determining whether the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality;
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, the image quality of the image acquired in the image acquisition step is equal to or lower than the predetermined image quality. Image quality reduction stage to reduce to the image quality of
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, an image with the image quality reduced in the image quality reduction step is displayed, and the image acquisition step A display step of displaying the image acquired in the image acquisition step when it is determined in the image quality determination step that the image quality of the image acquired in step S is less than or equal to a predetermined image quality;
When it is determined in the image quality determination step that the image quality of the image acquired in the image acquisition step is higher than a predetermined image quality, an image whose image quality has been reduced in the image quality reduction step is displayed in the display step. And a display control step of displaying in the display step information indicating that an image having a higher image quality than the predetermined image quality has been acquired in the image acquisition step. A program for an imaging system, wherein the imaging system is
An imaging unit for capturing an image;
A conformity determination unit that determines whether an image captured by the image capturing unit conforms to a predetermined condition;
When the conformity determining unit determines that the image captured by the image capturing unit does not conform to the condition, the image captured by the image capturing unit is determined to indicate that the image captured by the image capturing unit conforms to the condition. An output unit that converts and outputs a lower quality image than the case where the conformity determination unit determines,
An image acquisition unit for acquiring an image output by the output unit;
An image quality determination unit for determining whether the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality of the image acquired by the image acquisition unit is equal to or lower than the predetermined image quality. Image quality reduction section to reduce,
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the image quality reduction unit displays an image with reduced image quality, and the image acquisition unit acquires A display unit that displays the image acquired by the image acquisition unit when the image quality determination unit determines that the image quality of the image is less than or equal to a predetermined image quality;
When the image quality determination unit determines that the image quality of the image acquired by the image acquisition unit is higher than a predetermined image quality, the display unit displays an image with the image quality reduced by the image quality reduction unit A program that causes the display unit to function as a display control unit that displays information indicating that the image acquisition unit has acquired an image with a higher image quality than a predetermined image quality.

Images