JP2008141700A - Monitoring system and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system capable of appropriately monitoring an area high in probability relating to the action of a suspicious person and preventing the data amount of monitoring images from increasing more than needed. <P>SOLUTION: This monitoring system includes: an imaging unit for picking up a motion picture in a monitored area; an object extraction unit for extracting an object meeting predetermined conditions from the motion picture picked up by the imaging unit; a moving direction specifying unit for specifying a moving direction of the object extracted by the object extraction unit based on image contents of the motion picture picked up by the imaging unit; an image generating unit which generates a motion picture constitutive image which includes the object and of which an image width in the moving direction is wider than an image width vertical to the moving direction by trimming a motion picture constitutive image included in the motion picture picked up by the imaging unit; and an output unit for outputting the motion picture including the motion picture constitutive image generated by the image generating unit. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a monitoring system, a monitoring method, and a program. In particular, the present invention relates to a monitoring system and a monitoring method for monitoring by an image, and a program for the monitoring system.

During a period when the motion vector detected by the video compression unit is less than a predetermined value, the period of the synchronization signal supplied to the imaging unit is made relatively long to lower the frame rate of imaging by the imaging unit, so that the motion vector is predetermined An imaging device is known that increases the frame rate of imaging by relatively shortening the period of the synchronization signal during a period longer than the value (see, for example, Patent Document 1).
JP 2004-200909 A

  The imaging device described in Patent Literature 1 captures images at a low frame rate while no motion is detected, and when a motion of a predetermined value or more is detected from the captured low frame rate image, the imaging frame rate Or increase the resolution of imaging. However, according to the photographing apparatus described in Patent Document 1, there is a case where the resolution of an image in an area that is not related to the suspicious person's action is also increased. For this reason, the imaging device described in Patent Document 1 has a problem that the data amount increases more than necessary.

  Then, an object of this invention is to provide the monitoring system, the monitoring method, and program which can solve the said subject. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, the monitoring system according to the first aspect of the present invention extracts an image that captures a moving image of a monitoring area and an object that meets a predetermined condition from the moving image captured by the image capturing unit. An object extracting unit, a motion direction specifying unit for specifying the moving direction of the object extracted by the object extracting unit based on the image content of the moving image captured by the imaging unit, and an image width of the moving direction including the object. An image generation unit that generates a moving image composition image larger than the image width in the vertical direction from the moving image composition image included in the moving image captured by the imaging unit, and a moving image including the moving image composition image generated by the image generation unit And an output unit.

  A motion amount calculating unit that calculates a motion amount of the object between the plurality of moving image constituent images in the direction specified by the motion direction specifying unit based on the plurality of moving image constituent images included in the moving image captured by the imaging unit; The image generation unit includes, in the moving image captured by the image capturing unit, a moving image constituent image having a larger image width in the motion direction specified by the motion direction specifying unit when the motion amount calculated by the motion amount calculating unit is larger. It may be generated by trimming from a moving image constituent image.

  The image generation unit includes an object, and the moving image configuration included in the moving image captured by the imaging unit includes a moving image configuration image in which the region on the moving direction side with respect to the object is wider than the region on the opposite side of the moving direction with respect to the object The image may be generated by trimming.

  The monitoring method according to the second aspect of the present invention includes an object extraction stage for extracting an object that meets a predetermined condition from a moving image captured by a capturing unit that captures a moving image of a monitoring area, and a moving image captured by the imaging unit. A moving direction specifying step for specifying the moving direction of the object extracted in the object extracting step based on the image content of the image, and a moving image constituting image including the object, wherein the image width in the moving direction is larger than the image width in the direction perpendicular to the moving direction. The imaging unit sets the imaging range of the imaging unit so that the imaging unit captures a moving image including the image, and the imaging unit captures an image with the imaging range set in the imaging control step, and imaging the monitoring area in the imaging unit An output stage for outputting a moving image.

  According to the third aspect of the present invention, there is provided a program for a monitoring system, wherein the monitoring system includes an imaging unit that captures a moving image of a monitoring area, and an object that conforms to a predetermined condition from the moving image captured by the imaging unit. An object extraction unit for extracting the image, a motion direction specifying unit for specifying the movement direction of the object extracted by the object extraction unit based on the image content of the moving image captured by the imaging unit, and the image width of the movement direction includes the movement direction. The imaging range is set by the imaging control unit and the imaging control unit that set the imaging range of the imaging unit so that the imaging unit captures a moving image including a moving image configuration image larger than the vertical image width, and causes the imaging unit to capture the monitoring area. It is made to function as an output unit that outputs a moving image captured by the imaging unit in the set state.

  A monitoring system according to a fourth aspect of the present invention includes an imaging unit that captures a moving image of a monitoring area, an object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit, and an imaging unit Includes a motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the moving image captured by the object extraction unit, and an object extracted by the object extraction unit. An image generation unit that generates a moving image constituent image wider than a region on the side opposite to the moving direction from a moving image constituent image included in the moving image captured by the imaging unit, and a moving image constituent image generated by the image generation unit And an output unit for outputting a moving image including.

  The monitoring method according to the fifth aspect of the present invention includes an imaging stage for capturing a moving image of a monitoring area, an object extraction stage for extracting an object that meets a predetermined condition from the moving image captured in the imaging stage, and imaging A moving direction specifying step for specifying the moving direction of the object extracted in the object extracting step based on the moving image captured in the step, and an object extracted in the object extracting step, In an image generation stage in which a moving image constituent image is generated by trimming from a moving image constituent image included in the moving image captured in the imaging step, the moving image constituent image is wider than the region on the side opposite to the moving direction with respect to the object. An output stage for outputting a moving image including the generated moving image composition image.

  According to the sixth aspect of the present invention, there is provided a program for a monitoring system, the imaging system capturing an image of a moving image in the monitoring area, and an object conforming to a predetermined condition from the moving image captured by the imaging unit. Including an object extraction unit that extracts an object, a motion direction specification unit that specifies a movement direction of the object extracted by the object extraction unit based on a moving image captured by the imaging unit, and an object extracted by the object extraction unit. Image generation unit that generates a moving image composition image in which the region on the direction side is wider than the region on the opposite side of the moving direction with respect to the object from the moving image composition image included in the moving image captured by the imaging unit, image generation The unit functions as an output unit that outputs a moving image including the moving image composing image generated by the unit.

A monitoring system according to a seventh aspect of the present invention includes an imaging unit that captures a moving image of a monitoring area, an object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit, and an imaging unit Based on the video captured by the object extraction unit, the movement direction specifying unit that specifies the movement direction of the object extracted by the object extraction unit, and the region on the side of the movement direction with respect to the object is the movement direction with respect to the object. In the state where the imaging range of the imaging unit is set so that the imaging unit captures a moving image composition image wider than the region on the opposite direction side, and the imaging range is set by the imaging control unit. A monitoring system comprising: an output unit that outputs a moving image captured by an imaging unit.

  The monitoring method according to the eighth aspect of the present invention includes an object extraction stage that extracts an object that meets a predetermined condition from a moving image captured by a capturing unit that captures a moving image of a monitoring area, and a moving image captured by the imaging unit. Based on the movement direction specifying step for specifying the movement direction of the object extracted in the object extraction step, and the region on the side of the movement direction with respect to the object is opposite to the movement direction with respect to the object. The imaging unit sets the imaging range of the imaging unit to cause the imaging unit to capture a moving image composition image wider than the area on the side, and the imaging unit sets the imaging range in the imaging control stage in which the imaging range is set. And an output stage for outputting the captured moving image.

  According to the ninth aspect of the present invention, there is provided a program for a monitoring system, wherein the monitoring system includes an imaging unit that captures a moving image of a monitoring area, and an object that conforms to a predetermined condition from the moving image captured by the imaging unit. An object extracting unit for extracting the object, a moving direction specifying unit for specifying the moving direction of the object extracted by the object extracting unit based on the moving image captured by the imaging unit, and an area on the side of the moving direction with respect to the object An imaging control unit that sets an imaging range of the imaging unit so that the imaging unit captures a moving image constituent image wider than an area on the opposite side of the moving direction with respect to the object, and captures the image by the imaging control unit It functions as an output unit that outputs a moving image captured by the imaging unit with the range set.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, while monitoring the area | region with high probability relevant to a suspicious person's action appropriately, the monitoring system which can prevent that the data amount of a monitoring image increases more than necessary can be provided. .

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an example of a usage environment of a monitoring system 110 according to an embodiment. The monitoring system 110 includes a plurality of imaging devices 100a to 100c, a transmission path 140, a server 170, and a plurality of display devices 180, 181, 182,. The server 170 and the plurality of display devices 180, 181, 182,... Are provided in a monitoring room 160 far from the monitoring areas 150, 151, 152,. The imaging devices 100a to 100c are provided in each of the plurality of monitoring regions 150, 151, 152,... To capture the plurality of monitoring regions 150, 151, 152,. Hereinafter, the imaging devices 100 a to 100 c provided in each of the plurality of monitoring areas 150, 151, 152.

  The image capturing apparatus 100 transmits moving images obtained by capturing the monitoring areas 150, 151, 152... To the server 170 through the transmission path 140. The server 170 displays the moving image received from the imaging device 100 on the display devices 180, 181, 182,. The display devices 180, 181, 182,... Display moving images in the monitoring areas 150, 151, 152,.

  The imaging apparatus 100 displays a moving image that can be displayed by the display devices 180, 181, 182... With a frame image having a higher resolution than the monitor resolution that can be displayed by the display devices 180, 181, 182. A moving image is captured at a frame rate higher than the monitor display rate, which is the rate. The imaging device 100 converts the moving image captured by the imaging device 100 into a moving image in which a frame image having a resolution equal to or lower than the monitor resolution is displayed at a rate equal to or lower than the monitor display rate while no person or change is detected in the captured moving image. Convert and continue to send to server 170.

  Then, when a person or change is detected in the moving image, the imaging apparatus 100 continues to transmit the captured high resolution / high frame rate moving image to the server 170 until no person or change is detected in the moving image. The server 170 records the moving image received from the imaging device 100 and displays the received moving image on the display devices 180, 181, 182,... According to the monitor resolution and the monitor display rate.

  For example, the imaging apparatus 100 detects a change from an averaged image obtained by averaging a plurality of frame images obtained by imaging temporally, or detects a person included in the averaged image. For example, the imaging apparatus 100 detects that there is a change in the moving image when the area of a region where a change is detected between temporally averaged images is equal to or greater than a predetermined threshold. When a person or change is detected from the moving image, the imaging apparatus 100 generates a frame image having resolution at the time of imaging in at least a partial region where the person or change is detected, and the moving image including the generated frame image is stored in the server. To 170. In addition, when detecting the movement of a person, the imaging apparatus 100 generates a frame image having a resolution captured at least in a partial region set so that the moving direction side of the person is widened, and the generated frame image is The moving image including this is transmitted to the server 170.

  In addition, the imaging apparatus 100 may transmit, to the server 170, a moving image having a person or a partial area in which a change is detected as a frame image. At this time, the imaging apparatus 100 holds a partial image of a region other than the partial region in which a person or a change is detected. As described above, the image capturing apparatus 100 transmits a frame image with reduced image quality to the server 170 when no person or change is detected. Therefore, the transmission path 140 transmits during the period in which no person or change is detected. Data volume is reduced. Therefore, the imaging apparatus 100 may transmit the retained partial image to the server 170 during the period.

  Further, the server 170 gives a larger threshold value to the image capturing apparatus 100 when the difference between the data amount per time that the transmission path 140 can transmit and the data amount per time transmitted by the image capturing apparatus 100 is smaller. Let it be set. Thereby, it is possible to prevent the amount of data transmitted through the transmission path 140 from increasing and the arrival of moving image data from being delayed.

  The monitoring areas 150, 151, 152... May be spaces in different buildings, or may be different spaces in the same building. For example, the monitoring areas 150, 151, 152... May be passages between display shelves in the store. Needless to say, the monitoring areas 150, 151, and 152 are not limited to spaces in buildings, but may be open spaces that are not surrounded by buildings.

  FIG. 2 shows an example of a block configuration of the imaging apparatus 100. The imaging apparatus 100 includes an imaging unit 200, an averaged image generation unit 202, an imaging control unit 210, an object region specification unit 212, an image holding unit 214, a difference image generation unit 216, an image feature amount extraction unit 220, a conformity determination unit 230, A condition storage unit 240, a condition setting unit 242, an allowable data amount acquisition unit 250, an image quality selection unit 260, an image quality storage unit 262, an output control unit 270, an image generation unit 280, and an output unit 290 are provided. The conformity determination unit 230 includes a matching degree calculation unit 232. Further, the image generation unit 280 includes an output moving image generation unit 282. FIG. 3 shows an example of a block configuration of the image feature quantity extraction unit 220. The image feature amount extraction unit 220 includes a change amount calculation unit 221, a motion amount calculation unit 222, a motion direction specification unit 223, a specific color area calculation unit 224, and an object extraction unit 225.

  The imaging unit 200 captures an image of the monitoring area. Specifically, the imaging unit 200 captures a moving image in the monitoring area. The averaged image generation unit 202 generates an averaged image obtained by averaging a plurality of moving image constituent images included in the moving image captured by the imaging unit 200. For example, the averaged image generation unit 202 generates an averaged image by averaging a plurality of moving image constituent images for each pixel. Note that the condition storage unit 240 stores a condition to which an averaged image obtained by averaging a plurality of moving image constituent images included in a moving image determined to be abnormal is to be matched.

  Then, the suitability determining unit 230 determines whether or not the averaged image generated by the averaged image generating unit 202 meets the conditions. Then, when the matching determination unit 230 determines that the averaged image does not match the condition, the output moving image generation unit 282 determines that the matching determination unit 230 calculates the average from the moving image constituent images included in the moving image captured by the imaging unit 200. An output moving image including a moving image constituent image with a lower image quality is generated than when it is determined that the converted image meets the conditions. Then, the output unit 290 outputs the output moving image generated by the output moving image generating unit 282. For example, the output unit 290 outputs the output moving image generated by the output moving image generation unit 282 to the transmission path 140 that transmits the moving image of the monitoring area captured by the plurality of imaging units 200. Note that the output unit 290 may output a moving image of the monitoring area captured by the imaging unit 200. For example, the output unit 290 may output a moving image captured by the image capturing unit 200 when the conformity determining unit 230 determines that the averaged image meets the conditions.

  Specifically, when the suitability determining unit 230 determines that the averaged image does not conform to the condition, the output moving image generating unit 282 determines that the averaged image conforms to the condition. An output moving image including a moving image constituent image having a lower resolution is generated. In addition, the output moving image generation unit 282, when the conformity determination unit 230 determines that the averaged image does not conform to the condition, has fewer floors than when the conformity determination unit 230 determines that the averaged image conforms to the condition. An output moving image including a moving image constituent image of the logarithm may be generated. Further, the output moving image generation unit 282 determines that the averaged image meets the condition from the moving image captured by the imaging unit 200 when the matching determination unit 230 determines that the averaged image does not match the condition. An output moving image with a lower display rate than that determined by the unit 230 may be generated.

  Note that the output moving image generation unit 282 generates an output moving image including the averaged image generated by the averaged image generation unit 202 when the conformity determination unit 230 determines that the averaged image does not conform to the condition. The moving image captured by the image capturing unit 200 when the conformity determining unit 230 determines that the converted image matches the condition may be used as the output moving image.

  The difference image generation unit 216 includes a first averaged image generated by the averaged image generation unit 202 and a moving image constituent image captured after any moving image constituent image used to generate the first averaged image. Is used to generate a difference image from the second averaged image generated by the averaged image generation unit 202. Then, the output moving image generation unit 282 generates an output moving image including the difference image generated by the difference image generation unit 216 when the matching determination unit 230 determines that the averaged image does not match the condition, and the averaged image The moving image captured by the imaging unit 200 when the conformity determining unit 230 determines that the image matches the condition may be used as the output moving image.

  The allowable data amount acquisition unit 250 acquires the data amount per unit time permitted to be output from the output unit 290. For example, the allowable data amount acquisition unit 250 may acquire the amount of data that the transmission path 140 can transmit per unit time and the amount of data that the output control device 172 can process per unit time. The output moving image generation unit 282 further determines that the data amount acquired by the allowable data amount acquisition unit 250 is smaller than a predetermined value when the conformity determination unit 230 determines that the averaged image does not conform to the conditions. As a condition, an output moving image including the difference image generated by the difference image generation unit 216 is generated.

  Note that the suitability determination unit 230 may determine whether each of the plurality of partial regions in the averaged image meets the condition. Then, the output moving image generation unit 282 may generate an output moving image including a moving image constituent image having a lower image quality than the matching region in a region other than the matching region, which is a region where the matching determination unit 230 determines that the condition is met.

  The object extraction unit 225 extracts an object that meets a predetermined condition from the moving image captured by the imaging unit 200. Specifically, the object extraction unit 225 extracts an object that meets the conditions stored in the condition storage unit 240 from the moving image configuration image included in the moving image captured by the imaging unit 200. Then, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the moving image captured by the imaging unit 200 into a lower quality moving image. Then, the output unit 290 outputs the moving image obtained by the conversion by the image generation unit 280. In this case, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 may convert the moving image captured by the imaging unit 200 into a lower resolution moving image.

  In addition, the motion amount calculation unit 222 calculates the amount of motion of the object extracted by the object extraction unit 225 among a plurality of moving image constituent images included in the moving image captured by the imaging unit 200. The condition storage unit 240 stores a lower limit value of the amount of movement of the object that the object to be extracted should have. For example, the condition storage unit 240 stores a lower limit value of the amount of motion of the object between consecutive frames that the object to be extracted should have. Then, the object extraction unit 225 includes an object whose motion amount calculated by the motion amount calculation unit 222 is equal to or larger than the lower limit value of the motion amount stored in the condition storage unit 240 in the moving image captured by the imaging unit 200. Extracted from a plurality of moving image constituent images. Then, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the moving image captured by the imaging unit 200 into a lower resolution moving image. Specifically, the image generation unit 280 converts the moving image captured by the imaging unit 200 into a moving image having a lower display rate when the movement amount of the object calculated by the movement amount calculation unit 222 is larger.

  The image quality storage unit 262 stores a combination of a moving image display rate and a moving image constituent image included in the moving image in association with the size of the object and the amount of movement of the object. The image quality selection unit 260 then associates the image size and display rate stored in the image quality storage unit 262 with the object size extracted by the object extraction unit 225 and the object motion amount calculated by the motion amount calculation unit 222. Select a combination. Then, the image generation unit 280 converts the moving image captured by the imaging unit 200 into a moving image in which the moving image constituent image having the image quality selected by the image quality selecting unit 260 is displayed at the display rate selected by the image quality selecting unit 260.

  Note that the movement direction identification unit 223 identifies the movement direction of the object extracted by the object extraction unit 225 based on the image content of the moving image captured by the imaging unit 200. Then, the image generation unit 280 generates, by trimming, a moving image constituent image that includes the object and whose moving image width is larger than the vertical image width from the moving image captured by the imaging unit 200. To do. And the output part 290 outputs the moving image containing the moving image structure image which the image generation part 280 produced | generated. Then, the motion amount calculation unit 222 is based on the plurality of moving image constituent images included in the moving image captured by the imaging unit 200, and the object amount between the plurality of moving image constituent images in the direction specified by the motion direction specifying unit 223. Calculate the amount of movement. Then, in the image generation unit 280, when the motion amount calculated by the motion amount calculation unit 222 is larger, the imaging unit 200 captures a moving image constituent image having a larger image width in the motion direction specified by the motion direction specification unit 223. It is generated by trimming from the moving image constituent image included in the moving image. For this reason, the imaging apparatus 100 can provide a monitoring image that can appropriately monitor the area of the suspicious person's destination while preventing an unnecessary increase in the amount of data transmitted by the transmission path 140. .

  The condition storage unit 240 stores the lower limit value of the change amount from the reference image to be detected in the moving image constituent image included in the moving image that is determined to be abnormal. Then, the change amount calculation unit 221 calculates a change amount from a predetermined reference image in the moving image captured by the imaging unit 200. For example, the change amount calculation unit 221 calculates the change amount from the second moving image constituent image captured before the first moving image constituent image in the first moving image constituent image included in the moving image captured by the imaging unit 200. The change amount calculation unit 221 calculates the change amount from the reference image of the averaged image generated by the averaged image generation unit 202. The reference image may be an image of a monitoring area prepared in advance, a moving image constituent image captured by the imaging unit 200 at a previous timing, or an averaged image generated at a previous timing. The conformity determination unit 230 determines that the averaged image conforms to the condition when the change amount calculated by the change amount calculation unit 221 is equal to or greater than the lower limit value of the change amount stored in the condition storage unit 240. To do.

  The output control unit 270 calculates the moving image captured by the imaging unit 200 when the variation calculated by the variation calculation unit 221 is smaller than a predetermined lower limit of the variation. The change amount is converted to a moving image with a smaller data amount than when the change amount is equal to or greater than the lower limit value, and output to the output unit 290. Specifically, when the amount of change from the reference image is smaller than the lower limit value, the output control unit 270 displays a moving image captured by the imaging unit 200 at a lower resolution than when the amount of change from the reference image is greater than or equal to the lower limit value. And the output unit 290 outputs it. Further, the output control unit 270 displays a moving image captured by the imaging unit 200 when the amount of change from the reference image is smaller than the lower limit value, with a smaller number of gradations than when the amount of change from the reference image is greater than or equal to the lower limit value. It may be converted into a moving image and output to the output unit 290. In addition, when the change amount from the reference image is smaller than the lower limit value, the output control unit 270 displays a moving image captured by the imaging unit 200 at a lower display rate than when the change amount from the reference image is equal to or higher than the lower limit value. And the output unit 290 outputs it. The condition setting unit 242 further increases the lower limit value stored in the condition storage unit 240 when the data amount acquired by the allowable data amount acquisition unit 250 is smaller.

  Note that the change amount calculation unit 221 may calculate a motion amount of an object indicating the same subject between the first moving image constituent image and the second moving image constituent image included in the moving image captured by the imaging unit 200. Then, when the amount of movement of the object calculated by the change amount calculation unit 221 is smaller than the lower limit value of the predetermined amount of movement, the output control unit 270 uses the change amount calculation unit 221 to capture the moving image captured by the imaging unit 200. The calculated amount of motion is converted to a moving image with a smaller amount of data than when the amount of motion is equal to or greater than the lower limit value of the amount of motion, and output to the output unit 290. Note that the condition setting unit 242 may further increase the lower limit value of the motion amount when the data amount acquired by the allowable data amount acquisition unit 250 is smaller.

  The condition storage unit 240 is configured to detect an object included in the averaged image and a predetermined object to be detected in the averaged image obtained by averaging a plurality of moving image constituent images included in the moving image determined to be abnormal. Stores the lower limit of the degree of coincidence between and. Then, the object extraction unit 225 extracts an object from the averaged image generated by the averaged image generation unit 202. Then, when the degree of coincidence between the object extracted by the object extraction unit 225 and the predetermined object is equal to or higher than the lower limit value stored in the condition storage unit 240, the conformity determination unit 230 Is determined to meet the conditions. Specifically, the degree of coincidence calculation unit 232 calculates the degree of coincidence of the shape between the shape of the object included in the moving image captured by the image capturing unit 200 and the predetermined shape of the reference object. The conformity determination unit 230 determines that the averaged image conforms to the condition when the coincidence degree calculated by the coincidence degree calculation unit 232 is equal to or greater than the lower limit value stored in the condition storage unit 240.

  The output control unit 270 calculates the moving image captured by the imaging unit 200 when the matching level calculated by the matching level calculation unit 232 is smaller than a predetermined lower limit value of the matching level. It may be converted into a moving image with a smaller data amount than when the degree of coincidence is equal to or higher than the lower limit value, and output to the output unit 290. Specifically, the output control unit 270 calculates the degree of coincidence of the moving image captured by the imaging unit 200 when the degree of coincidence calculated by the coincidence degree calculating unit 232 is smaller than the lower limit value of the degree of coincidence of a predetermined shape. The degree of coincidence calculated by the unit 232 is converted to a moving image with a smaller data amount than when the degree of coincidence of the shape is equal to or greater than the lower limit value of the shape, and is output to the output unit 290. Note that the condition setting unit 242 may increase the lower limit value of the shape matching degree when the data amount acquired by the allowable data amount acquisition unit 250 is smaller.

  The condition storage unit 240 is an area occupied by a color included in a predetermined color range that should be detected in an averaged image obtained by averaging a plurality of moving image constituent images included in a moving image that is determined to be abnormal. Stores the lower limit value of. For example, the condition storage unit 240 may store the lower limit value of the area occupied by the color included in the color range including the color characteristic of the person. Then, the specific color area calculation unit 224 calculates an area occupied by colors included in a predetermined color range in the averaged image generated by the averaged image generation unit 202. The conformity determination unit 230 determines that the averaged image conforms to the condition when the area calculated by the specific color area calculation unit 224 is equal to or greater than the lower limit value of the area stored in the condition storage unit 240. . Specifically, the coincidence degree calculation unit 232 calculates the degree of color coincidence between the color included in the object included in the moving image captured by the imaging unit 200 and the color included in the predetermined reference object. The conformity determination unit 230 determines that the averaged image conforms to the condition when the coincidence degree calculated by the coincidence degree calculation unit 232 is equal to or greater than the lower limit value stored in the condition storage unit 240.

  The condition storage unit 240 captures the imaging unit 200 from the position of the subject included in the averaged image that should be detected in the averaged image obtained by averaging a plurality of video constituent images included in the video determined to be abnormal. The lower limit value of the degree of coincidence between the direction to the object and the moving direction of the subject is stored. Then, the movement direction identification unit 223 identifies the movement direction of the subject in the monitoring area based on the image contents of the plurality of averaged images generated by the averaged image generation unit 202. Then, when the matching degree between the moving direction of the subject and the direction from the subject position toward the imaging unit 200 is equal to or more than the lower limit value of the matching degree stored in the condition storage unit 240, the matching determination unit 230 Then, it is determined that the averaged image meets the conditions.

  The object area specifying unit 212 specifies an object area that includes an object that meets the condition when the matching determination unit 230 determines that an object that meets the condition exists. The output unit 290 outputs an image of the object area when the matching determination unit 230 determines that there is an object that meets the conditions. The image holding unit 214 holds an image of a region other than the object region when the matching determination unit 230 determines that there is an object that meets the conditions. Then, the output control unit 270 determines that there is no object that satisfies the condition in the moving image of the monitoring area after the image holding unit 214 holds the image of the area other than the object area. Then, the output unit 290 outputs an image of an area other than the object area held by the image holding unit 214.

  Note that the output unit 290, when the conformity determination unit 230 determines that there is an object that meets the condition, the higher the data amount acquired by the allowable data amount acquisition unit 250, the higher the image quality of the object region. May be output. Further, when the conformity determining unit 230 determines that there is an object that meets the condition, the object area specifying unit 212 selects an object that conforms to the condition as the data amount acquired by the allowable data amount acquiring unit 250 is larger. Larger object regions may be identified that contain it.

  Also, the output control unit 270 determines that the matching determination unit 230 determines that there is no object that meets the conditions in the moving image in the monitoring area after the image holding unit 214 holds the image of the area other than the object area. On the condition that the data amount acquired by the allowable data amount acquisition unit 250 is larger than a predetermined value, the output unit 290 outputs an image of an area other than the object area held by the image holding unit 214.

  Also, the output control unit 270 determines that the matching determination unit 230 determines that there is no object that meets the conditions in the moving image in the monitoring area after the image holding unit 214 holds the image of the area other than the object area. The image of the area other than the object area held by the image holding unit 214 may be output to the output unit 290 with an image quality corresponding to the data amount acquired by the allowable data amount acquisition unit 250.

  The object area specifying unit 212 includes an object in which the amount of motion of the object over a plurality of moving image constituent images included in the moving image captured by the imaging unit 200 is equal to or greater than the lower limit value of the moving amount stored in the condition storage unit 240. May be specified as the object region.

  The condition storage unit 240 may store a lower limit value of the degree of coincidence with a predetermined object that the object to be extracted from the moving image should have. Then, the object area specifying unit 212 may extract, as an object area, an area including an object that matches with a matching degree equal to or higher than the lower limit value of the matching degree stored in the condition storage unit 240. In addition, the condition storage unit 240 may store the lower limit value of the area occupied by the color included in the predetermined color range that the object to be extracted from the moving image should have. Then, the object region specifying unit 212 extracts a region including an object in which the area occupied by the color included in the predetermined color range is equal to or larger than the lower limit value of the area stored in the condition storage unit 240 as the object region. .

  Note that the change amount calculation unit 221 and the condition setting unit 242 are not provided in each of the imaging devices 100, and the monitoring system 110 may include one change amount calculation unit 221 and one condition setting unit 242. Then, the change amount calculation unit 221 may calculate a change amount from a predetermined reference image in each moving image captured by the plurality of imaging units 200 for each moving image captured by the plurality of imaging units 200. . When the change amount calculated by the change amount calculation unit 221 is smaller than the lower limit value of the predetermined change amount, the output control unit 270 determines that the change amount calculated by the change amount calculation unit 221 is greater than or equal to the lower limit value. It may be converted into a moving image having a smaller data amount and output to the transmission path 140. The condition setting unit 242 sets the condition when the difference between the data amount per unit time that can be transmitted by the transmission path 140 and the data amount per unit time output by each of the plurality of imaging units 200 is smaller. The lower limit value stored in the storage unit 240 may be further increased. In addition, the degree-of-match calculation unit 232 captures the degree of coincidence between an object included in each moving image captured by the plurality of imaging units 200 and a predetermined reference object by each moving image captured by the plurality of imaging units 200. It may be calculated every time. When the matching degree calculated by the matching degree calculation unit 232 is smaller than the lower limit value of the matching degree, the output control unit 270 determines that the matching degree calculated by the matching degree calculation unit 232 is equal to or higher than the lower limit value. It is converted into a moving image having a smaller data amount and output to the transmission path 140. The condition setting unit 242 sets the lower limit when the difference between the data amount per unit time that can be transmitted by the transmission path 140 and the data amount per unit time output by each of the plurality of imaging units 200 is smaller. Increase the value more.

  Note that the imaging control unit 210 sets an imaging range of the imaging unit 200 so that the imaging unit 200 captures a moving image including an object and including a moving image constituent image in which the image width in the movement direction is larger than the image width in the direction perpendicular to the movement direction. Then, the imaging unit 200 is caused to image the monitoring area. Then, the output unit 290 outputs the moving image captured by the imaging unit 200 in a state where the imaging range is set by the imaging control unit 210. At this time, the imaging control unit 210 includes the object, and the imaging unit 200 applies the subject included in the imaging range in which the moving image constituent image is captured in which the image width in the movement direction is larger than the image width in the direction perpendicular to the movement direction. Imaging conditions may be adjusted. The output unit 290 may output a moving image captured by the image capturing unit 200 in a state where the image capturing condition is adjusted by the image capturing control unit 210.

  In addition, the imaging control unit 210 includes the object, and causes the imaging unit 200 to capture a moving image configuration image in which the region on the moving direction side with respect to the object is wider than the region on the side opposite to the moving direction with respect to the object. The imaging range of the imaging unit 200 may be set so that the imaging unit 200 captures an image. In addition, the imaging control unit 210 includes an object, and is included in an imaging range in which a moving image constituent image is captured in which a region on the moving direction side with respect to the object is wider than a region on the side opposite to the moving direction with respect to the object The imaging conditions of the imaging unit 200 may be adjusted for the subject to be captured.

  Note that the imaging rate of the moving image captured by the imaging unit 200 may be higher than the monitor display rate, and the amount of data per time required to transmit the moving images captured by all the imaging apparatuses 100 is the time required for the transmission path 140. It may be larger than the amount of data that can be transmitted per hit. Note that the frame image in the present embodiment is an example of a moving image constituent image, and the moving image constituent image includes a field image. Further, the imaging unit 200 may capture an image of the entire monitoring area through the fisheye lens.

  In the above description, the form in which the imaging apparatus 100 captures an image and transmits a moving image to the server 170 has been described. However, in other forms, the server 170 may have the function of the imaging apparatus 100. For example, the image capturing apparatus 100 outputs the captured moving image of the monitoring area to the transmission path 140 as it is, and the server 170 controls the image quality of the moving image to be recorded or the image quality of the moving image displayed by the display devices 180, 181, and 182. You may control. In this case, the server 170 includes an object area specifying unit 212, an image holding unit 214, a difference image generating unit 216, an image feature amount extracting unit 220, a conformity determining unit 230, a condition storing unit 240, a condition setting unit 242, and an allowable data amount acquisition. A unit 250, an image quality selection unit 260, an image quality storage unit 262, an output control unit 270, an image generation unit 280, and an output unit 290 may be provided. In this case, the output unit 290 may record the moving image generated by the output moving image generation unit 282 on a recording medium or display the moving images on the display devices 180, 181, and 182.

  FIG. 4 shows an example of the operation flow of the imaging apparatus 100. The imaging unit 200 captures a moving image in the monitoring area by continuously capturing frame images having a resolution higher than the monitor resolution of the display devices 180 to 182 at a frame rate higher than the monitor display rate of the display devices 180 to 182. (S400). The averaged image generating unit 202 increments the averaged counter every time the image capturing unit 200 captures a frame image. Then, the averaged image generating unit 202 determines whether or not the imaging unit 200 has captured a predetermined number of frame images based on the value of the averaging counter (S401). If it is determined in S401 that a predetermined number of frame images have been captured, the averaged image generating unit 202 averages the pixels for each pixel over the predetermined number of frame images captured by the imaging unit 200. (S402), and the averaging counter is set to 0.

  Then, the matching determination unit 230 determines whether or not an object matching the person has been detected (S404). Specifically, the object extraction unit 225 extracts the outline of the object from the averaged image by edge enhancement or the like. Then, the degree-of-match calculation unit 232 compares the outline of the object extracted by the object extraction unit 225 with a predetermined person pattern to determine the outline of the object extracted by the object extraction unit 225. The degree of coincidence of the shape with the person pattern is calculated. For example, the degree-of-match calculation unit 232 calculates a value obtained by dividing the area of the portion where the contour of the object matches the pattern of the person having the same area as the object by the area of the contour of the object as the degree of matching of the shape You can do it. Then, when the matching degree of the shape calculated by the matching degree calculation unit 232 is equal to or higher than the lower limit value of the matching degree of the shape stored in the condition storage unit 240, the matching determination unit 230 determines that the object that matches the person is Judge that it was detected.

  Note that the motion amount calculation unit 222 calculates the movement speed of the object extracted by the object extraction unit 225. When the suitability determining unit 230 determines that an object that matches the person has been detected in S404, the image quality selecting unit 260 acquires the moving speed of the object that matches the person calculated by the motion amount calculating unit 222. (S406).

  Then, the imaging apparatus 100 determines the display rate of the output moving image output to the transmission path 140 and the resolution of the frame image (S408). Specifically, the image quality selection unit 260 selects the resolution and display rate stored in the image quality storage unit 262 in association with the area of the object that matches the person and the speed of movement of the object that matches the person. . For example, in S <b> 408, the image quality selection unit 260 selects a higher resolution (however, a resolution equal to or lower than the resolution of the frame image captured by the imaging unit 200) as the size of the object is smaller, and as the movement speed of the object increases. A high display rate (however, a display rate equal to or lower than the imaging rate of the frame image captured by the imaging unit 200) is determined.

  Then, the output moving image generation unit 282 determines whether to generate an output moving image including an output frame image generated from the frame image captured by the imaging unit 200 according to the display rate determined in S408 (S410). For example, the output moving image generation unit 282 holds a counter that is incremented each time the imaging unit 200 captures a frame image and is initialized to 0 each time a moving image is generated from the captured frame image. Output frame image when the product of the counter value and the imaging interval of the frame image captured by the imaging unit 200 is equal to or larger than the frame interval of the output frame image included in the output moving image indicated by the display rate determined in S408. To generate an output video including

  In S410, when the output moving image generation unit 282 determines that the output moving image is generated, the allowable data amount acquisition unit 250 detects the amount of data transmitted per unit time in the transmission path 140 (S412). Then, the allowable data amount acquisition unit 250 calculates an allowable data amount indicating a difference between the data amount that the transmission path 140 can transmit per unit time and the data amount that the transmission path 140 transmits per unit time. calculate. The allowable data amount acquisition unit 250 may acquire the allowable data amount from the server 170.

  Then, the output moving image generating unit 282 determines whether or not the moving image having the image quality determined in S408 can be generated (S414). Specifically, the output moving image generation unit 282 determines that the allowable data amount is equal to or larger than the data amount to be transmitted per unit time necessary to transmit the moving image data having the resolution and display rate determined in S408. Then, it is determined that the moving image having the image quality determined in S408 can be generated.

  If it is determined in S414 that the moving image having the image quality determined in S408 can be generated, the output moving image generating unit 282 thins out the pixels from the frame image captured by the image capturing unit 200, thereby obtaining the frame image. An output frame image converted to the resolution determined in S408 is generated. Then, the output moving image generation unit 282 generates a moving image including the generated output frame image and supplies the generated moving image to the output unit 290 (S416). Then, the imaging apparatus 100 determines whether an imaging end instruction has been received (S418). When the imaging end instruction is not received in S418, the imaging apparatus 100 proceeds to S400, and when the imaging end instruction is received in S418, the process is ended.

  If it is determined in S401 that the predetermined number of frame images have not been captured after the processing shifts to S400 after the shooting end determination in S418, the output moving image generation unit 282 includes the output frame image. It is determined whether to generate an output moving image (S440). In S440, as in S410, the output moving image generation unit 282 determines whether to generate an output moving image including an output frame image according to the display rate that has already been determined. If it is determined in S440 that an output moving image including an output frame image is to be generated, the imaging apparatus 100 proceeds to S412 and determines that an output moving image including an output frame image is not to be generated. In S400, the process proceeds to S400.

  In S414, when the output moving image generating unit 282 determines that the moving image having the image quality determined in S408 cannot be generated, the output moving image generating unit 282 acquires the moving direction of the object suitable for the person (S420). ). Specifically, the movement direction identified by the movement direction identification unit 223 for the object that matches the person is acquired as the movement direction of the object.

  Then, the output moving image generation unit 282 determines a trimming range for the frame image captured by the imaging unit 200 (S422). Specifically, the output moving image generation unit 282 determines a trimming range in which a trimmed image including an object suitable for a person and having an image width in the moving direction of the object larger than an image width in a direction perpendicular to the moving direction is obtained. . Hereinafter, the area of the trimming range is referred to as a person area. Then, the output moving image generating unit 282 generates a trimmed image of the person region by trimming the frame image within the trimming range determined in S422 (S424). Further, the image holding unit 214 stores an image of the trimmed area (an image of an area other than the person area) (S426). Then, the output moving image generation unit 282 generates a moving image including the trimmed image obtained in S424 and supplies the generated moving image to the output unit 290 (S428). And the imaging device 100 transfers a process to S418.

  In S404, if the matching determination unit 230 has not detected an object that matches the person, the output moving image generation unit 282 generates a moving image from the averaged image and supplies the generated moving image to the output unit 290 (S430). At this time, the output moving image generation unit 282 may generate a moving image including an output frame image with a reduced data amount by thinning out the pixels of the averaged image as appropriate, and supply the generated moving image to the output unit 290. A moving image may be generated from an output frame image with a reduced data amount by thinning out the pixels of the frame image as appropriate and supplied to the output unit 290.

  Then, the output control unit 270 supplies a moving image including an image of an area other than the person area held by the image holding unit 214 in S426 to the output unit 290 (S432). Even when it is determined in S410 that the frame image is not generated, the imaging apparatus 100 proceeds to S432, and the output control unit 270 displays an image of an area other than the person area held by the image holding unit 214 in S426. The moving image including the image is supplied to the output unit 290. Note that in S432, the output control unit 270 does not generate a moving image from an image in an area other than the person area and supplies it to the output unit 290, but outputs the image itself in an area other than the person area to the output unit 290. You may let them.

  As described above, when detecting the movement of a person, the imaging apparatus 100 transmits a moving image having a higher resolution and a higher display rate to the server 170 than when no movement of the person is detected. At this time, when the load on the transmission path 140 is high, the imaging apparatus 100 transmits to the server 170 a moving image including a frame image obtained by trimming other regions with a high resolution only in the region in which the movement of the person is detected, Thereafter, when the movement of the person is not detected, an image other than the trimmed person area is transmitted. Therefore, according to the imaging apparatus 100, even when the load on the transmission path 140 is large, the time required for moving image data to arrive at the server 170 can be reduced.

  FIG. 5 shows an example of image quality information stored in the image quality storage unit 262 in a table format. The image quality storage unit 262 stores the resolution PR of the output frame image included in the output moving image and the display rate FR of the moving image to be output in association with the area S of the person and the speed of movement V. For example, when the area S of the person is S1 or more and less than S2 and the speed of movement V is less than V1, the image quality storage unit 262 uses PR3 as the resolution of the output frame image and FR1 as the display rate of the moving image to be output. Is stored.

  Note that the height of the resolution PR is PR4> PR3> PR2> PR1, and the height of the display rate FR is FR4> FR3> FR2> FR1. In this way, the image quality storage unit 262 stores a higher display rate FR in association with a larger speed of movement, and stores a larger resolution PR in association with a smaller person area. For this reason, the imaging apparatus 100 can prevent the data amount of the moving image to be transmitted from becoming unnecessarily large by lowering the resolution of the frame image in which the person is captured larger. In addition, since the imaging apparatus 100 increases the display rate when a person who moves faster is detected, it is possible to provide a moving image that allows the monitor to easily determine what the person is doing. it can.

  In the above description, the image quality storage unit 262 stores the resolution PR of the output frame image and the display rate FR of the moving image to be output in association with the area S and the movement speed V of the person. The storage unit 262 may store the resolution PR and the number of gradations of the output frame image and the display rate FR of the moving image to be output in association with the area S of the person and the speed of movement V. For example, the image quality storage unit 262 may store a smaller number of gradations in association with the area of a larger person. Then, the output moving image generation unit 282 may generate an output moving image from an output frame image having a smaller number of gradations when the area of the person is larger.

  As described above, the condition storage unit 240 stores the condition of the object to be extracted from the image captured by the imaging unit 200. Then, the object extraction unit 225 extracts an object that meets the conditions from the image captured by the imaging unit 200. Then, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the image captured by the imaging unit 200 into a lower quality image. Then, the output unit 290 outputs the image obtained by the conversion by the image generation unit 280.

  For example, the condition storage unit 240 stores a lower limit value of the degree of coincidence between an object to be extracted and a predetermined object. Then, the object extraction unit 225 extracts, from the moving image captured by the imaging unit 200, an object that matches a predetermined object with a higher matching degree than the lower limit value stored in the condition storage unit 240. Then, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the image captured by the imaging unit 200 into a lower quality image.

  In addition, the condition storage unit 240 stores a lower limit value of an area occupied by a color included in a predetermined color range that an object to be extracted should have. The object extraction unit 225 then captures an object in which the area occupied by the color included in the predetermined color range is equal to or larger than the lower limit value of the area stored in the condition storage unit 240 from the moving image captured by the imaging unit 200. Extract. Then, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the image captured by the imaging unit 200 into a lower quality image.

  Specifically, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the image captured by the imaging unit 200 into a lower resolution image. In addition, when the size of the object extracted by the object extraction unit 225 is larger, the image generation unit 280 converts the image captured by the imaging unit 200 into an image having a smaller number of gradations.

  FIG. 6 shows an example of a trimmed image generated by the output moving image generation unit 282. The output moving image generation unit 282 generates a trimmed image A to be included in the moving image output from the output unit 290 from the image 600. Note that the image 600 may be a frame image of a single frame of a moving image captured by the imaging unit 200, or an averaged image generated by the averaged image generation unit 202. The movement direction identification unit 223 and the movement amount calculation unit 222 determine the movement direction 660 of the person 650 and the movement of the person 650 in the image 600 from the change in the position of the same person 650 extracted by the object extraction unit 225 in a plurality of consecutive images. The speed V is calculated.

  Then, the output moving image generation unit 282 determines the trimming frame 610 that includes the person 650 and whose image width x in the motion direction identified by the motion direction identification unit 223 is larger than the image width y in the direction perpendicular to the motion direction (see FIG. 4 S422). In the example of this figure, the output moving image generation unit 282 determines a trimming frame 610 in which the side of the movement direction specified by the movement direction specification unit 223 is wider than the side opposite to the movement direction.

  Then, the output moving image generation unit 282 generates a moving image that uses the trimmed image A in the trimming frame 610 as an output frame image at the timing when the image 600 is captured, and supplies the generated moving image to the output unit 290 (S428 in FIG. 4). Then, the image holding unit 214 stores the region image B outside the trimming frame 610 (S426 in FIG. 4). Then, the output unit 290 transmits the region image B stored in the image holding unit 214 at a timing when the allowable data amount is larger than the transmission data amount of the moving image data output from the output unit 290 (S432 in FIG. 4).

  As described above, the image generation unit 280 includes the object, and the imaging unit 200 captures a moving image configuration image in which the region on the moving direction side with respect to the object is wider than the region on the side opposite to the moving direction with respect to the object. It is generated by trimming from a moving image constituent image included in a moving image. Therefore, the imaging apparatus 100 can transmit not only the person 650 but also the trimmed image including the image area to which the person 650 is moved to the server 170. As a result, the imaging apparatus 100 can provide a moving image in which a monitoring target subject desirable for the supervisor is captured while reducing the amount of data to be transmitted compared to the case of transmitting the entire captured image. For this reason, the imaging apparatus 100 has a content that allows the supervisor to sufficiently monitor the person 650 even when the transmission path 140 is congested and there is no room to transmit the moving images of all the images. A moving image can be promptly provided to the server 170.

  FIG. 7 shows another example of a trimmed image generated by the output moving image generation unit 282. In the example of this figure, the motion amount calculation unit 222 calculates a speed of motion greater than that of FIG. At this time, the output moving image generating unit 282 sets the trimming frame 710 so that a trimmed image A in which the image width in the direction 760 specified by the motion direction specifying unit 223 is larger is obtained. Therefore, the imaging apparatus 100 can provide the server 170 with a monitoring image that allows the monitoring person to accurately determine the action intention of the person even when the movement of the person is fast.

  FIG. 8 shows still another example of the trimmed image generated by the output moving image generating unit 282. In the example of this figure, the output moving image generation unit 282 determines the trimming frame 810 where the person 850 is located substantially at the center. As described above, the image generation unit 280 includes the object extracted by the object extraction unit 225, and a moving image configuration in which the region on the moving direction side with respect to the object is wider than the region on the side opposite to the moving direction with respect to the object. An image is generated by trimming from a moving image constituent image included in a moving image captured by the imaging unit 200. In other words, the output moving image generation unit 282 determines a trimming frame 810 that can obtain a trimmed image A in which the area of the person 850 in the direction of movement and the area in the direction opposite to the direction of movement are substantially the same. . In this way, the imaging apparatus 100 can provide the server 170 with an image that allows the monitor to appropriately monitor the area of the person 850 in the front-rear direction.

  In the description of FIGS. 6 to 8, the example of trimming the frame image or the averaged image captured by the imaging apparatus 100 has been described. However, instead of trimming with the trimming frames 610, 710, and 810, imaging control is performed. The unit 210 may cause the imaging unit 200 to capture the image capturing conditions of the subjects in the trimming frames 610, 710, and 810 together. For example, the imaging control unit 210 may control the imaging direction and zoom value of the imaging unit 200 so that the range of the trimming frames 610, 710, and 810 becomes the imaging range of the imaging unit 200.

  FIG. 9 shows an example of a frame image included in the moving image output by the output unit 290 in time series. The averaged image generation unit 202 averages four frame images continuously captured by the imaging unit 200, thereby obtaining averaged images 910, 920, 930, 940,..., 980, 990. Generate. When there is no change between the continuous averaged images, the output moving image generation unit 282 displays the output frame image at a display interval that is a predetermined number of times (for example, 4 times) the imaging interval of the imaging unit 200. The moving image is supplied to the output unit 290. For example, the output moving image generation unit 282 supplies the output unit 290 with a moving image in which an averaged image (for example, 910, 920, 930) obtained by averaging a predetermined number of consecutive frame images is an output frame image. Note that the output moving image generation unit 282 may supply the output unit 290 with a moving image whose output frame image is an image obtained by appropriately thinning out the pixels of the averaged image, or the difference image generation unit 216 generates from the continuous averaged image. A moving image including the difference image may be supplied to the output unit 290.

  Then, for example, at times t12 and t16, a change is detected between successive averaged images (for example, averaged images 920 and 930, averaged image 930 and averaged image 940), and the conformity determining unit 230 calculates the average. When it is determined that there is an object that matches the movement of the person in the digitized image (for example, the averaged images 930 and 940), the output moving image generation unit 282 outputs a moving image having a frame image captured by the imaging unit 200 after time t12. Part 290.

  At this time, as described in S420 to S428 in FIG. 4, the output moving image generation unit 282 generates a moving image in which the trimming image 941 trimmed with the trimming frame described in relation to FIGS. You may supply to the output part 290. FIG. Then, the image holding unit 214 holds an image 945 of the trimmed part. Then, the output moving image generation unit 282 generates a moving image having an output frame image of the imaging interval captured by the imaging unit 200 until time t80 when no human motion is detected, and supplies the generated moving image to the output unit 290. Although not shown for the sake of drawing, it is needless to say that the image holding unit 214 may hold the trimmed portion of the image from time t14 to time t80.

  When no change is detected between successive averaged images, such as the averaged images 980 and 990, the output moving image generation unit 282 again outputs a moving image in which the averaged image is an output frame image of one frame. Part 290. At this time, the output control unit 270 causes the output unit 290 to output the image 945 held by the image holding unit 214. The output control unit 270 divides the image 945 into a plurality of regions so that the data amount per unit time output from the output unit 290 is equal to or less than the allowable data amount acquired by the allowable data amount acquisition unit 250. You may make the output part 290 output the image of the divided | segmented several area | region sequentially.

  The image holding unit 214 holds the entire frame image captured by the imaging unit 200 from time t13 to t80, and the frame held by the image holding unit 214 after time t81 when no change is detected. You may make the output part 290 output the moving image which makes an image the output frame image of 1 flame | frame. At this time, the output control unit 270 causes the output unit 290 to transmit the image data to be transmitted so that the total amount of data per unit time output by the output unit 290 is equal to or less than the allowable data amount acquired by the allowable data amount acquisition unit 250. The size, resolution, or number of gradations may be determined. Note that the output control unit 270 causes the output unit 290 to output the frame image (or the image 945) held by the image holding unit 214, including timing information indicating at which timing the image is captured. .

  As described above, the averaged image generating unit 202 averages a plurality of moving image constituent images included in the moving image captured by the imaging unit 200 during a predetermined time width, and generates an averaged image for each predetermined time width. To do. Then, the output moving image generation unit 282 averages a plurality of moving image constituent images included in the moving image captured by the imaging unit 200 in the first period, and the first averaged image generated by the averaged image generation unit 202 is a condition. When the conformity determining unit 230 determines that the images do not conform, the first averaged image is used as a moving image constituent image of the output moving image in the first period, and the conformity determining unit 230 determines that the first averaged image meets the conditions. When it is determined, the moving image captured by the imaging unit 200 in the first period is set as the output moving image in the first period.

  Further, the averaged image generating unit 202 averages a plurality of moving image constituent images included in the moving image captured by the imaging unit 200 during a predetermined time width, and generates an averaged image for each predetermined time width. Good. Then, the output moving image generation unit 282 averages a plurality of moving image constituent images included in the moving image captured by the imaging unit 200 in the first period, and the first averaged image generated by the averaged image generation unit 202 is a condition. Averaging generated by the averaging generation unit by averaging a plurality of moving image constituent images captured by the image capturing unit 200 in the second period following the first period when the conformity determining unit 230 determines that the images do not conform. The moving image captured by the image capturing unit 200 in the second period when the conformity determining unit 230 determines that the image is the moving image constituent image of the output moving image in the second period and the first averaged image meets the conditions. It is good also as an output animation of the 2nd period.

  Note that the averaged image generating unit 202 is configured such that the display rate of the moving image represented by the plurality of averaged images is lower than the display rate of the moving image that can be transmitted with the data amount acquired by the allowable data amount acquiring unit 250. A time width in which a plurality of moving image constituent images used for generating one averaged image is captured is determined, and a plurality of moving image constituent images included in the moving images captured by the imaging unit 200 during the time width are averaged. Thus, an averaged image may be generated for each time width.

  FIG. 10 shows an example of an output frame image generated by the output moving image generation unit 282. This figure shows another example of the output frame image generated by the output moving image generation unit 282 from the frame image captured by the imaging unit 200 at time t13 in FIG. In the example of FIG. 9, the output moving image generation unit 282 generates a moving image in which a trimming image including an area including a person is an output frame image among the frame images captured by the imaging unit 200 and causes the output unit 290 to output the generated moving image. However, in the example of this figure, the output moving image generation unit 282 generates a moving image including the output frame image 1010 in which the resolution of the region including the person is higher than the resolution of the region other than the region including the person, and outputs the generated moving image to the output unit 290. Let

  The output moving image generation unit 282 generates the output frame image 1010 by thinning out more pixels from the region other than the region including the person in the frame image captured by the imaging unit 200 from the region including the person. Note that the output moving image generation unit 282 may cause the output unit 290 to output the resolution information indicating the resolution of each of the plurality of regions in the output frame image 1010. Further, the image holding unit 214 may hold an image represented by the pixels thinned out by the output moving image generation unit 282, and the output control unit 270 may store the image held by the image holding unit 214 after time t81. You may make it output to the output part 290. FIG.

  As described above, the imaging unit 200 captures a moving image having a larger data amount than the moving image data having the number of pixels, the number of gradations, and the display rate that can be displayed by the display devices 180 to 182. In addition, the imaging unit 200 captures a moving image having a data amount larger than the data amount per unit of the imaging apparatus 100 that can be transmitted by the transmission path 140 per unit time. The output moving image generation unit 282 and the output control unit 270 control the image quality of the moving image to be output to the output unit 290, for example, the resolution, the number of gradations, and the display rate, so that the output unit 290 outputs data per time. Reduce the amount.

  FIG. 11 shows an example of the time evolution of the amount of data that the output unit 290 should output to the transmission path 140. The allowable data amount acquisition unit 250 is a permissible amount of data per unit time that the transmission path 140 can allow the data amount per unit of the imaging apparatus 100 that the transmission path 140 can transmit per unit time. Get as data volume. As described with reference to FIGS. 1 to 10, the output moving image generation unit 282 and the output control unit 270 control the resolution, the number of gradations, and the display rate of the moving image to be output to the output unit 290 so that the output unit 290 Control the amount of data output per hour so that it does not exceed the allowable amount of data.

  For example, if the output moving image generating unit 282 attempts to transmit a moving image with a high display rate or resolution captured by the image capturing unit 200 by detecting the movement of a person, the output moving image generating unit 282 outputs, for example, during a period from time t1102 to t1103. The amount of data per unit time output by the unit 290 exceeds the allowable data amount. In such a case, the output moving image generation unit 282 trims the frame image captured by the imaging unit 200 to reduce the amount of data output by the output unit 290 per unit time to an allowable data amount. A moving image having a low data amount is generated by generating a moving image or by appropriately decimating frame images according to the movement speed of a person. Then, the output control unit 270 outputs a trimmed image from time 1102 to t1103 or an image represented by thinned pixels during a period in which the data amount output per unit time is smaller than the allowable data amount (for example, During the period from time t1103 to time t1104). With such control, the imaging apparatus 100 can transmit a moving image having a data amount substantially the same as the allowable data amount to the server 170. For this reason, according to the monitoring system 110, the bandwidth of the transmission path 140 can be used effectively.

  FIG. 12 shows an example of conditions stored in the condition storage unit 240. The condition storage unit 240 stores the area of the person, the speed of movement of the object, the area of the change area, the area of the specific color, the degree of coincidence of the shape with the reference object, and the degree of coincidence of the movement direction with the reference direction. For each, a lower limit value (S1, V1, Sα, Sβ, sγ, md) is stored. Then, in the averaged image generated by the averaged image generation unit 202, the conformity determination unit 230 includes the area of the person equal to or higher than the lower limit value stored in the condition storage unit 240, the moving speed of the object, the area of the change region, When an object having a specific color area, a shape coincidence with a reference object, or a movement direction coincidence with a reference direction is detected, the average image is stored in the condition storage unit 240. It is judged that it meets the conditions. At this time, as described with reference to FIGS. 1 to 11, the output moving image generation unit 282 has higher image quality than the case where the conformity determination unit 230 determines that the conditions stored in the condition storage unit 240 do not conform. A moving image is generated from the moving image captured by the imaging unit 200.

  The condition storage unit 240 is a pixel having a pixel value that has changed by a predetermined value or more between a plurality of frame images captured by the imaging unit 200 or a plurality of averaged images generated by the averaged image generation unit 202. May be stored as the lower limit value of the area of the change region. In addition, the condition storage unit 240 sets a lower limit value of the ratio of the number of pixels having a pixel value changed by a predetermined value or more to the total number of pixels of the plurality of frame images or the plurality of averaged images as the area of the change region. You may store as a lower limit. Note that the pixel value may be a luminance value.

  In addition, the condition storage unit 240 uses the lower limit value of the number of pixels having colors included in a predetermined color range included in a plurality of frame images or a plurality of averaged images as a lower limit value of the area of the specific color. May be stored. In addition, the condition storage unit 240 sets the lower limit value of the ratio of the number of pixels having a color included in a predetermined color range to the total number of pixels of the frame image or the averaged image as the lower limit value of the area of the specific color. It may be stored.

  In addition, the condition storage unit 240 sets the lower limit value of the area where the outline of the object included in the frame image or the averaged image overlaps with a predetermined reference object having the same area, and matches the shape with the reference object. It may be stored as the lower limit of the degree. Further, the condition storage unit 240 sets the lower limit value of the ratio of the area of the portion overlapping the predetermined reference object having the same area as the contour of the object included in the frame image or the averaged image to the area of the object. May be stored as the lower limit value of the degree of coincidence of the shape between and.

  The condition storage unit 240 also sets a lower limit value of the index value that is inversely proportional to the angle formed between the movement direction of the object included in the frame image or the averaged image and a predetermined reference direction, in the reference direction and the movement direction. It may be stored as the lower limit value of the matching degree. The reference direction may be a predetermined direction on the frame image or the averaged image, or may be a predetermined direction in the real space. Note that the condition storage unit 240 is a lower limit value of the index value that is inversely proportional to the angle formed between the moving direction of the subject indicated by the object included in the frame image or the averaged image and the direction from the subject position toward the imaging unit 200. May be stored as the lower limit value of the degree of coincidence between the reference direction and the moving direction.

  FIG. 13 shows an example of frame images 1310, 1320, and 1330 in which a subject that faces the imaging unit 200 is captured. The movement direction identification unit 223 calculates the barycentric positions 1311, 1321, and 1331 of the objects 1315, 1325, and 1335 extracted by the object extraction unit 225 from the frame images 1310, 1320, and 1330 captured by the imaging unit 200, respectively. . In addition, the movement direction identification unit 223 calculates the object lengths l1312, l1322, and l1332 extracted by the object extraction unit 225 from the frame images 1310, 1320, and 1330, respectively.

  Then, the movement direction identification unit 223 calculates an increase rate of the object length and a change rate of the center of gravity position of the object over the frame images 1310, 1320, and 1330, and the calculated increase rate of the object length is determined in advance. If it is equal to or greater than the determined reference value and the rate of change in the center of gravity of the object is smaller than a predetermined reference value, it is determined that the subject indicated by the object is facing the imaging unit 200.

  The condition storage unit 240 may store a condition indicating the direction in which the center of gravity of the object is directed toward the center of the image. Then, the suitability determining unit 230 determines that the condition stored in the condition storage unit 240 is satisfied when the moving direction of the gravity center position indicates a direction toward the center of the image. The condition storage unit 240 may store a condition indicating a change in the size of the object in addition to a condition indicating the direction in which the center of gravity of the object is directed toward the center of the image. For example, the condition storage unit 240 may indicate that the increase speed of the object length is larger than a predetermined increase speed over a plurality of moving image constituent images or averaged images, and that the center of gravity of the object is directed toward the center in the image or the object A condition indicating that the center of gravity is near the center of the image may be stored.

  As described above, the imaging apparatus 100 can improve the image quality of the moving image that is output when the subject that is facing the imaging unit 200 is detected. For this reason, by providing the imaging unit 200 on an object to be protected from theft, it is possible to appropriately monitor a person approaching the object. In addition, the imaging apparatus 100 can appropriately monitor a person who is trying to perform an obstruction such as covering the imaging unit 200 with a cloth.

  FIG. 14 shows an example of the time evolution of the lower limit value of the movement speed set by the condition setting unit 242. The transmission path 140 transmits a moving image having a substantially constant data amount during the period from time t1400 to t1401, time t1402 to t1403, and time t1404 to t1405. During these periods, none of the image capturing apparatuses 100 detects the movement of a person, and all the image capturing apparatuses 100 convert the captured moving image into a low-quality moving image and output the total amount of data. R0 video is being output.

  On the other hand, during the period from time t1401 to t1402, time t1403 to t1404, and time t1405 to t1406, one of the imaging devices 100 detects the movement of a person, and the captured moving image is not converted to a low-quality moving image. By outputting to the transmission path 140 as it is, the data transmitted by the transmission path 140 per time increases. At this time, the allowable data amount acquisition unit 250 calculates the difference between the maximum data amount Rmax that the transmission path 140 can transmit per unit time and the data amount that the transmission path 140 transmits per unit time. Acquired as the allowable amount of data allowed per hour. The allowable data amount acquisition unit 250 calculates the difference between the maximum data amount Rmax that the transmission path 140 can transmit per unit time and the data amount that the transmission path 140 transmits per unit time. Alternatively, a value divided by the number of imaging devices 100 that output a moving image may be acquired as the allowable data amount.

  Then, the condition setting unit 242 causes the condition storage unit 240 to store a lower limit value of the motion speed that is inversely proportional to the allowable data amount acquired by the allowable data amount acquisition unit 250. As a result, the condition storage unit 240 stores a lower limit value of the movement speed that is larger as the allowable data amount is smaller.

  Note that the priority order of the imaging apparatus 100 may be determined in advance. The condition setting unit 242 may store the lower limit value of the lower motion speed in the condition storage unit 240 when a higher priority is set in the imaging apparatus 100. In addition, the condition setting unit 242 may cause the condition storage unit 240 to store a lower limit value of the movement speed corresponding to the allowable data amount for each predetermined period in a predetermined order.

  In the above description, the case where the condition setting unit 242 sets the lower limit value of the movement speed stored in the condition storage unit 240 according to the allowable data amount has been described. The lower limit value of the area of the person stored in the condition storage unit 240, the lower limit value of the area of the change area, the lower limit value of the area of the specific color, the lower limit value of the degree of coincidence with the reference object, and the reference direction It goes without saying that the lower limit value of the degree of coincidence in the movement direction between the two can be set according to the allowable data amount.

  FIG. 15 shows an exemplary hardware configuration of a computer 1500 related to the monitoring system 110. The computer 1500 includes a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and a communication interface 1530 connected to the host controller 1582 by an input / output controller 1584. An input / output unit having a hard disk drive 1540 and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the computer 1500. The communication interface 1530 communicates with the image capturing apparatus 100 via a network, and provides programs and data to the image capturing apparatus 100. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the computer 1500 is started up, a program depending on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program provided to the communication interface 1530 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program is read from the recording medium, provided to the communication interface 1530 via the RAM 1520, and transmitted to the imaging apparatus 100 via the network. The program transmitted to the imaging apparatus 100 is installed and executed in the imaging apparatus 100.

  The program that is installed and executed in the imaging device 100 includes the imaging device 100, the averaged image generation unit 202, the imaging control unit 210, and the object region specifying unit 212 described with reference to FIGS. , Image holding unit 214, difference image generating unit 216, change amount calculating unit 221, motion amount calculating unit 222, motion direction specifying unit 223, specific color area calculating unit 224, object extracting unit 225, conformity determining unit 230, matching degree Calculation unit 232, condition storage unit 240, condition setting unit 242, allowable data amount acquisition unit 250, image quality selection unit 260, image quality storage unit 262, output control unit 270, image generation unit 280, output video generation unit 282, and output unit Function as 290.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1500 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

2 is a diagram illustrating an example of a usage environment of a monitoring system 110. FIG. 1 is a diagram illustrating an example of a block configuration of an imaging apparatus 100. FIG. It is a figure which shows an example of the block configuration of the image feature-value extraction part 220. 3 is a diagram illustrating an example of an operation flow of the imaging apparatus 100. FIG. It is a figure which shows an example of the image quality information which the image quality storage part 262 has stored. It is a figure which shows an example of the trimming image which the output moving image production | generation part 282 produces | generates. It is a figure which shows another example of a trimming image. It is a figure which shows another example of a trimming image. It is a figure which shows an example of the frame image which the output part 290 outputs in a time series. It is a figure which shows an example of the output frame image which the output moving image production | generation part 282 produces | generates. 6 is a diagram illustrating an example of time development of the amount of data output from an output unit 290 to a transmission path 140. FIG. It is a figure which shows an example of the conditions which the condition storage part 240 has stored. FIG. 6 is a diagram illustrating an example of a frame image in which a subject heading for an imaging unit 200 is captured. It is a figure which shows an example of the time development of the lower limit value of the moving speed which the condition setting part 242 sets. FIG. 25 is a diagram illustrating an example of a hardware configuration of a computer 1500 related to the imaging apparatus 100.

Explanation of symbols

100 Imaging device 110 Monitoring system 140 Transmission path 150 Monitoring region 151 Monitoring region 152 Monitoring region 160 Monitoring room 170 Monitoring room 170 Server 180 Display device 181 Display device 182 Display device 200 Imaging unit 202 Averaged image generating unit 210 Imaging control unit 212 Object region specifying unit 214 Image holding unit 216 Difference image generating unit 220 Image feature amount extracting unit 221 Change amount calculating unit 222 Motion amount calculating unit 223 Motion direction specifying unit 224 Specific color area calculating unit 225 Object extracting unit 230 Conformity determining unit 232 Matching degree calculating unit 240 Condition storage unit 242 Condition setting unit 250 Allowable data amount acquisition unit 260 Image quality selection unit 262 Image quality storage unit 270 Output control unit 280 Image generation unit 282 Output video generation unit 290 Output unit

Claims (16)

An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the image content of the moving image captured by the imaging unit;
An image generation unit that includes the object and generates a moving image constituent image having an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction from the moving image constituent image included in the moving image captured by the imaging unit; ,
A monitoring system comprising: an output unit that outputs a moving image including the moving image composing image generated by the image generating unit. Motion amount calculation for calculating the amount of motion of the object between the plurality of moving image constituent images in the direction specified by the movement direction specifying unit based on the plurality of moving image constituent images included in the moving image captured by the imaging unit. Further comprising
The image generating unit captures a moving image composed of a moving image having a larger image width in the moving direction specified by the moving direction specifying unit when the moving amount calculated by the moving amount calculating unit is larger. The monitoring system according to claim 1, wherein the monitoring system is generated by trimming from a moving image constituent image included in the image. The image generation unit includes the object, and the imaging unit captures a moving image configuration image in which a region on the movement direction side with respect to the object is wider than a region on the side opposite to the movement direction with respect to the object. The monitoring system according to claim 1, wherein the monitoring system is generated by trimming from a moving image constituent image included in the moving image. An imaging stage for capturing a video of the surveillance area;
An object extraction step of extracting an object from the video imaged in the imaging step;
A direction-of-motion specifying step for specifying a direction of movement of the object extracted in the object extracting step based on the image content of the moving image captured in the imaging step;
An image generation step of generating, by trimming, a moving image constituent image including the object and having an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction from the moving image constituent image included in the moving image captured in the imaging step When,
A monitoring method comprising: an output step of outputting a moving image including the moving image constituting image generated in the image generation step. A monitoring system program comprising:
An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the image content of the moving image captured by the imaging unit;
An image generation unit that includes the object and generates a moving image constituent image having an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction from a moving image constituent image included in the moving image captured by the imaging unit;
A program that functions as an output unit that outputs a moving image including a moving image constituent image generated by the image generation unit. An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the image content of the moving image captured by the imaging unit;
An imaging range of the imaging unit is set so that the imaging unit captures a moving image including a moving image including a moving image including the object and an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction. An imaging control unit that causes the monitoring area to image the monitoring area;
A monitoring system comprising: an output unit that outputs a moving image captured by the imaging unit in a state where an imaging range is set by the imaging control unit. The imaging control unit includes the object, and a subject included in an imaging range in which a moving image constituent image in which an image width in the motion direction is larger than an image width in a direction perpendicular to the motion direction is captured by the imaging unit Adjust the imaging conditions,
The monitoring system according to claim 6, wherein the output unit outputs a moving image captured by the imaging unit in a state where imaging conditions are adjusted by the imaging control unit. An object extraction stage for extracting an object that meets a predetermined condition from a moving image captured by an imaging unit that captures a moving image of the monitoring area;
A moving direction specifying step for specifying a moving direction of the object extracted in the object extracting step based on the image content of the moving image captured by the imaging unit;
An imaging range of the imaging unit is set so that the imaging unit captures a moving image including a moving image including a moving image including the object and an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction. An imaging control stage for causing the monitoring area to image the monitoring area;
A monitoring method comprising: an output step of outputting a moving image picked up by the image pickup unit in a state where an image pickup range is set in the image pickup control step. A monitoring system program comprising:
An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the image content of the moving image captured by the imaging unit;
An imaging range of the imaging unit is set so that the imaging unit captures a moving image including a moving image including a moving image including the object and an image width in the moving direction larger than an image width in a direction perpendicular to the moving direction. An imaging control unit that causes the monitoring area to image
A program that functions as an output unit that outputs a moving image captured by the imaging unit in a state where an imaging range is set by the imaging control unit. An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the moving image captured by the imaging unit;
The imaging unit includes an object extracted by the object extraction unit, and a moving image composing image in which a region on the moving direction side with respect to the object is wider than a region on the side opposite to the moving direction with respect to the object. An image generation unit that generates by trimming from a moving image constituent image included in a moving image captured by
A monitoring system comprising: an output unit that outputs a moving image including the moving image composing image generated by the image generating unit. An imaging stage for capturing a video of the surveillance area;
An object extraction step of extracting an object that meets a predetermined condition from the moving image captured in the imaging step;
A direction-of-motion specifying step of specifying a direction of movement of the object extracted in the object extraction step based on the moving image captured in the imaging step;
The moving image composing image including the object extracted in the object extraction step, wherein a region on the movement direction side with respect to the object is wider than a region on the side opposite to the movement direction with respect to the object. An image generation step of generating by trimming from a moving image constituent image included in the moving image captured in the stage;
A monitoring method comprising: an output step of outputting a moving image including the moving image constituting image generated in the image generation step. A monitoring system program comprising:
An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies a motion direction of the object extracted by the object extraction unit based on a moving image captured by the imaging unit;
The imaging unit includes an object extracted by the object extraction unit, and a moving image composing image in which a region on the moving direction side with respect to the object is wider than a region on the side opposite to the moving direction with respect to the object. An image generating unit that generates by trimming from a moving image constituent image included in a moving image captured by
A program that functions as an output unit that outputs a moving image including a moving image constituent image generated by the image generation unit. An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies the motion direction of the object extracted by the object extraction unit based on the moving image captured by the imaging unit;
The imaging unit includes the object, and causes the imaging unit to capture a moving image constituent image in which the area on the side of the movement direction with respect to the object is wider than the area on the side opposite to the movement direction with respect to the object. An imaging control unit that sets the imaging range of the image and causes the imaging unit to capture an image,
A monitoring system comprising: an output unit that outputs a moving image captured by the imaging unit in a state where an imaging range is set by the imaging control unit. The imaging control unit includes the object, and an imaging in which a moving image constituent image is captured in which a region on the moving direction side with respect to the object is wider than a region on the opposite side to the moving direction with respect to the object. Adjust the imaging conditions of the imaging unit for the subject included in the range,
The monitoring system according to claim 13, wherein the output unit outputs a moving image captured by the imaging unit in a state where imaging conditions are adjusted by the imaging control unit. An object extraction stage for extracting an object that meets a predetermined condition from a moving image captured by an imaging unit that captures a moving image of the monitoring area;
A moving direction specifying step of specifying a moving direction of the object extracted in the object extracting step based on a moving image captured by the imaging unit;
The imaging unit includes the object, and causes the imaging unit to capture a moving image constituent image in which the area on the side of the movement direction with respect to the object is wider than the area on the side opposite to the movement direction with respect to the object. An imaging control stage in which the imaging unit is configured to capture an image,
A monitoring method comprising: an output step of outputting a moving image picked up by the image pickup unit in a state where an image pickup range is set in the image pickup control step. A monitoring system program comprising:
An imaging unit that captures a moving image of the monitoring area;
An object extraction unit that extracts an object that meets a predetermined condition from the moving image captured by the imaging unit;
A motion direction identifying unit that identifies a motion direction of the object extracted by the object extraction unit based on a moving image captured by the imaging unit;
The imaging unit includes the object, and causes the imaging unit to capture a moving image constituent image in which the area on the side of the movement direction with respect to the object is wider than the area on the side opposite to the movement direction with respect to the object. An imaging control unit that sets the imaging range of the image and causes the imaging unit to capture an image,
A program that functions as an output unit that outputs a moving image captured by the imaging unit in a state where an imaging range is set by the imaging control unit.

Images