JP2007019845A - Monitor camera, monitor method, and monitor program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To not only pick up a still image of a person in a partial area and but also acquire a moving image obtained by imaging movement of the person, as a stream. <P>SOLUTION: A monitor camera includes an imaging part, a moving image pickup control part for causing the imaging part to pickup a moving image of a monitor area, a still image pickup control part for causing the imaging part to pickup still images of a partial area being a part of the monitor area with a period longer than a frame period of the moving image picked up by the imaging part, an image storage part for storing the moving image and still images picked up by the imaging part, and a correspondence information storage part for storing correspondence information being information associating frame images constituting the moving image stored in the image storage part, with still images. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a surveillance camera, a surveillance method, and a surveillance program. In particular, the present invention relates to a surveillance camera, a surveillance method, and a surveillance program for capturing an image of a surveillance area.

In recent years, monitoring devices using an imaging device are arranged in various places and used for detecting intruders and the like. Then, a reference image of the imaging region is captured in advance, and the change of the subject is detected by comparing the reference image with the captured image. When a change in the subject is detected by comparing the reference image and the captured image, a device is proposed that reduces the compression rate of the image to be captured, assuming that there is a change in the motion of the subject in the imaging area of the imaging device. (For example, refer to Patent Document 1).
JP 2002-335492 A

  The monitoring device is required to acquire a wide area image for the purpose of monitoring the behavior of the person detected in the imaging area. Furthermore, the monitoring device is also required to acquire an image having a sufficient image quality for specifying the person detected in the imaging region. Here, when a person detected in the imaging area is specified, if a moving image is continuously captured with a high-quality image sufficient to specify the person, the capacity of the storage device for storing the moving image is insufficient. There is a case. On the other hand, when a low-quality moving image is captured for the purpose of reducing communication traffic when the captured moving image is communicated with the outside of the imaging device via the Internet or the like, and saving the capacity of the storage device for storing the moving image. In some cases, the person detected in the imaging area cannot be identified.

  In the invention described in Patent Document 1, when there is a change in the movement of the subject in the imaging region, the compression rate of the image to be captured is set to be low regardless of what person the subject is. Then, while the subject is moving, imaging continues while the compression rate of the image to be captured is set low. However, in the invention described in Patent Document 1, regardless of who the subject is, and even after the subject person is authenticated, the compression rate of the captured image is set low while the subject is moving. Therefore, there is a problem that communication traffic is not reduced when a captured image is transmitted to an external device by communication. Furthermore, since the compression rate of the image remains set low, it may be difficult to efficiently reduce the data amount of the captured image.

  Therefore, an object of the present invention is to provide a surveillance camera, a surveillance method, and a surveillance program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, in the first embodiment of the present invention, a monitoring camera that captures an image of a monitoring region, an imaging unit, and a moving image capturing control unit that causes the imaging unit to capture a moving image of the monitoring region; A still image capturing control unit that causes the imaging unit to capture a still image of a partial area that is a part of the monitoring area at a period longer than the frame period of the moving image captured by the imaging unit, and a moving image and a still image captured by the imaging unit. An image storage unit for storing, and a correspondence information storage unit for storing correspondence information that is information for associating a frame image and a still image constituting a moving image stored in the image storage unit. In addition, the correspondence information storage unit associates the frame image constituting the moving image with the still image based on the timing at which the imaging unit images the frame image forming the moving image and the timing at which the imaging unit images the still image. Information may be stored.

  A moving image person extracting unit that extracts a person included in a frame image constituting the moving image stored in the image storage unit; and a still image person extraction that extracts a person included in the still image stored in the image storage unit. The correspondence information storage unit may store correspondence information indicating that the person extracted by the moving picture person extraction unit and the person extracted by the still image person extraction unit are the same person. In addition, for each person extracted by the moving image person extracting unit, the moving image dividing unit further includes a moving image dividing unit that divides the moving image stored in the image storing unit into a plurality of streams, and the correspondence information storing unit includes the stream divided by the moving image dividing unit Correspondence information for associating the still image stored in the image storage unit may be stored.

  In addition, in the monitoring area that is the imaging area of the imaging unit, a partial area position storage unit that stores in advance the position of a partial area that is a part of the monitoring area of the imaging unit, and a moving image of the monitoring area captured by the imaging unit And a person determination unit that analyzes and determines whether or not a person is present in a partial area that is a part of the monitoring area of the imaging unit. If the image is determined to exist, the imaging unit captures a still image of the partial area, and the correspondence information storage unit includes a frame image that forms a moving image that the person determination unit determines that a person exists in the partial region, and a person determination unit. When it is determined that there is a person in the partial area, correspondence information for associating the still image captured by the imaging unit may be stored.

  Furthermore, in the monitoring area that is the imaging area of the imaging unit, a partial area position storage unit that stores in advance the position of a partial area that is a part of the monitoring area of the imaging unit, and a moving image of the monitoring area captured by the imaging unit And a motion determination unit that analyzes and determines whether or not there is a motion in a partial region that is a part of the monitoring region of the imaging unit, and the still image capturing control unit includes a motion determination unit that moves in the partial region. If it is determined that there is a partial area still image in the imaging unit, the correspondence information storage unit includes a frame image that constitutes a moving image that the motion determination unit determines to have movement in the partial region, and a motion determination unit Correspondence information for associating a still image captured by the imaging unit when it is determined that there is a motion in the partial area may be stored.

  Further, in the second embodiment of the present invention, there is provided a monitoring method for capturing an image of a monitoring area, a moving image capturing control stage in which a moving image of the monitoring area is captured by an imaging unit, and a frame period of a moving image captured by the imaging unit A still image capturing control stage that causes the imaging unit to capture a still image of a partial area that is a part of the monitoring area at a longer period, an image storage stage that stores a moving image and a still image captured by the imaging section, and an image storage stage Includes a correspondence information storage stage for storing correspondence information, which is information for associating frame images and still images constituting the moving image stored in.

  According to the third aspect of the present invention, there is provided a monitoring program for a monitoring camera that captures an image of a monitoring area, and the moving image imaging control that causes the monitoring camera to capture an imaging unit and a moving image of the monitoring area to the imaging unit. A still image capturing control unit that causes the imaging unit to capture a still image of a partial area that is a part of the monitoring area at a period longer than a frame period of a moving image captured by the imaging unit, and a moving image and a still image captured by the imaging unit It functions as an image storage unit that stores images, and a correspondence information storage unit that stores correspondence information that is information that associates frame images and still images that constitute the moving images stored in the image storage unit.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, it is possible to capture a still image of a person in a partial area and acquire a moving image in which the action of the person is captured as a stream.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an overview of a surveillance camera 200 according to an embodiment of the present invention. The monitoring camera 200 captures a moving image of the monitoring region in the imaging device 12 and also captures a still image of a partial region included in the monitoring region with a period longer than the frame period of the moving image. The surveillance camera 200 according to the present embodiment aims to acquire a frame image in which an action of a person or the like is captured as a stream that is a set of a plurality of frame images, and to acquire a high-resolution image of a person or the like. And

  The monitoring camera 200 captures a moving image of a monitoring area, for example, an imaging area of the imaging apparatus 12 in the imaging apparatus 12. The imaging device 12 stores a moving image as a low-resolution frame image. In addition, the monitoring camera 200 captures a high-resolution still image of a partial area that is a part of the monitoring area in the imaging device 12 with a period longer than the frame period of the moving image. For example, when the person 900 is included in the partial area, the monitoring camera 200 captures a high-resolution still image 400 in the partial area in which the person 900 is included. Then, the monitoring camera 200 associates the frame image 312 to the frame image 312 constituting the moving image in which the action of the person 900 is imaged with the still image 400 based on the timing at which the still image 400 is imaged. Stored as information 600. In the monitoring camera 200, the correspondence information 600 is stored by associating the frame image 302 to the frame image 312 in which the person 900 is captured with a person identifier that can uniquely identify the person 900.

  In addition, when the person 910 is included in the partial area, the monitoring camera 200 captures a high-resolution still image 410 in the partial area in which the person 910 is included. Then, based on the timing at which the still image 410 is captured, the monitoring camera 200 correlates the frame image 352 to the frame image 358 that configure the moving image in which the action of the person 910 is captured, and Stored as information 650. In the monitoring camera 200, as in the correspondence information 600, the correspondence information 650 is stored by associating the frame image 358 from the frame image 352 in which the person 910 is captured with the person identifier that can uniquely identify the person 910.

  In the monitoring camera 200, the behavior of the person 900 can be grasped by acquiring the frame image 312 from the frame image 302 as a stream in which a plurality of frame images are collected based on the person identifier that can uniquely identify the person 900. Similarly, the monitoring camera 200 can grasp the behavior of the person 910 by acquiring the frame image 358 from the frame image 352 as a stream based on an identifier that can uniquely identify the person 910.

  According to the monitoring camera 200 according to the present embodiment, it is possible to capture a high-resolution still image of a person and grasp the action of the person from the stream. Accordingly, the monitoring camera 200 can capture a still image of a high-resolution person required by the person authentication device and the like, and can store a stream in which only the action of the person is captured. In addition, since the surveillance camera 200 can capture a high-resolution still image only when a person is included in the partial area, and can acquire only a stream in which the person is captured, Communication traffic when transmitting to a person authentication device or the like can be appropriately reduced. Furthermore, the monitoring camera 200 can efficiently reduce the capacity for storing images.

  FIG. 2 shows an example of a functional configuration of the monitoring camera 200 according to the present embodiment. The surveillance camera 200 includes an image capturing unit 10, a moving image capturing control unit 20, a still image capturing control unit 22, an image storage unit 30, a correspondence information storage unit 40, a still image person extracting unit 50, a moving image person extracting unit 55, and a moving image dividing unit 60. A partial region position storage unit 70, a person determination unit 80, a movement determination unit 85, an identical person determination unit 90, and an image output unit 100. The imaging unit 10 captures a moving image in the monitoring area based on the control of the moving image capturing control unit 20. Further, the imaging unit 10 captures a still image based on the control of the still image capturing control unit 22. Here, the imaging unit 10 may include a light receiving device such as a CCD sensor and a CMOS sensor. Furthermore, the light receiving device may include a plurality of light receiving elements. The imaging unit 10 supplies the captured moving image and the timing at which the moving image is captured to the image storage unit 30. In addition, the imaging unit 10 supplies the captured image and the timing at which the still image is captured to the image storage unit 30. Furthermore, the imaging unit 10 supplies the captured moving image and the timing at which the moving image is captured to the person determining unit 80 and the motion determining unit 85. The imaging device 12 is an example of the imaging unit 10.

  The moving image capturing control unit 20 causes the imaging unit 10 to capture a moving image in the monitoring area. Note that the monitoring area may be an imaging area of the imaging unit 10. The moving image capturing control unit 20 supplies the image capturing unit 10 with information indicating that a moving image is captured. Note that when the moving image capturing control unit 20 causes the image capturing unit 10 to capture a moving image, the moving image capturing control unit 20 may capture a low-resolution moving image by reading pixel data from a part of the plurality of light receiving elements. The still image capturing control unit 22 causes the image capturing unit 10 to capture a still image of a partial region that is a part of the monitoring region at a period longer than the frame period of the moving image captured by the image capturing unit 10. The still image capturing control unit 22 captures a still image of the partial area based on the control of the person determining unit 80 or the motion determining unit 85. Note that the partial area may be, for example, an area that particularly needs monitoring in the monitoring area. The still image capturing control unit 22 may control the number of pixels per unit area to be larger when the image capturing unit 10 captures a still image than when the image capturing unit 10 captures a moving image. The still image capturing control unit 22 supplies the image capturing unit 10 with information indicating that a partial region still image is captured.

  The image storage unit 30 stores a plurality of frame images and still images included in the moving image received from the imaging unit 10. The image storage unit 30 stores the frame image in association with the frame image identifier that can uniquely identify the frame image included in the moving image. The image storage unit 30 may store the timing at which the frame image is captured in association with the frame image identifier. Furthermore, the image storage unit 30 stores a still image in association with a still image identifier that can uniquely identify the still image. The image storage unit 30 may store the timing at which the still image is captured in association with the still image identifier.

  The image storage unit 30 supplies the stored moving image frame image, the frame image identifier corresponding to the frame image, and the timing at which the frame image is captured to the moving image person extraction unit 55. Further, the image storage unit 30 supplies the frame image and the frame image identifier corresponding to the frame image to the moving image dividing unit 60. Further, the image storage unit 30 supplies the still image, the still image identifier corresponding to the still image, and the timing at which the still image is captured to the still image person extraction unit 50. Then, the image storage unit 30 displays the frame image identifier, the timing when the frame image corresponding to the frame image identifier is captured, the still image identifier, and the timing when the still image corresponding to the still image identifier is captured as correspondence information. This is supplied to the storage unit 40. Further, the image storage unit 30 supplies the image output unit 100 with a still image, a still image identifier, a frame image, a frame image identifier, correspondence information received from the correspondence information storage unit 40 described later, and the like.

  The moving picture person extraction unit 55 extracts a person included in the frame image received from the image storage unit 30. The moving picture person extraction unit 55 may detect a subject having a motion with respect to the background included in the frame image by matching a plurality of frame images. Then, the moving picture person extraction unit 55 may determine whether or not the subject is a person by skin color extraction or the like. If the moving image person extraction unit 55 determines that a person is included in the frame image, the moving image person extraction unit 55 continuously captures a plurality of frames captured in the frame image including the subject determined to be the person. The image may be determined as a frame image including the same person. When the moving image person extracting unit 55 detects a person included in the frame image, the moving image person extracting unit 55 sends a plurality of frame image identifiers corresponding to the plurality of frame images including the person to the moving image dividing unit 60. Supply. In addition, the moving picture person extraction unit 55 supplies the same person determination unit 90 with a plurality of frame image identifiers corresponding to a plurality of frame images including the person and the timing at which the plurality of frame images are captured.

  The still image person extraction unit 50 extracts a person included in the still image received from the image storage unit 30. The still image person extraction unit 50 detects a subject included in the still image by image processing such as contour extraction processing and color distribution analysis processing. Then, the still image person extraction unit 50 may store a characteristic amount specific to the face of the person in advance. The characteristic amount specific to the face of a person may be, for example, the face outline, eyes, nose, mouth, eyebrows, and the distance between parts included in these faces. The still image person extraction unit 50 may detect a feature amount unique to a person's face from subjects included in the still image by matching or the like to determine whether the subject is a person. Still picture person extraction part 50 may judge whether the subject contained in a still picture is a person from the shape, color, etc. of a person's clothes and shoes. For example, the still image person extraction unit 50 may store in advance data such as clothes, shoes and other shapes and colors worn by a person. The still image person extraction unit 50 may determine whether or not the subject is a person by matching the subject included in the still image with the shape of clothes, shoes, or the like stored in advance. Furthermore, the still image person extraction unit 50 may determine whether or not the subject is a person by skin color extraction. When the still image person extraction unit 50 determines that a person is included in the still image, the still image identifier of the still image including the person and the still image corresponding to the still image identifier are captured. The determined timing is supplied to the same person determination unit 90.

  The same person determination unit 90 receives the frame image identifier received from the moving image person extraction unit 55, the timing when the frame image was captured, the still image identifier received from the still image person extraction unit 50, and the still image corresponding to the still image identifier. Whether the person extracted by the moving picture person extracting unit 55 and the person extracted by the still image person extracting unit 50 are the same person or not is determined based on the timing at which the image is captured. The same person determination unit 90 is the same among a frame image captured at a timing substantially the same as the timing at which a still image including a person is captured and a plurality of frame images captured continuously from the frame image. A plurality of frame images including the person is selected. Then, the same person determination unit 90 associates the person identifier that can uniquely identify the person with the frame image identifiers of the plurality of frame images determined to include the same person and the still image identifier of the still image. Good.

  For example, the same person determination unit 90 selects a frame image captured at substantially the same timing as when a still image was captured. Then, the same person determination unit 90 matches the frame image with a frame image captured continuously from the frame image, and detects the movement of the person included in the frame image. The same person determination unit 90 determines that the same person is included in the plurality of frame images while the movement of the person included in the plurality of frame images captured subsequent to the frame image is detected. May be. Then, the same person determination unit 90 includes information indicating that the person included in the plurality of frame images and the person included in the still image are the same person, the still image identifier of the still image including the person, and the person identifier. , And a plurality of frame image identifiers of a plurality of frame images including the person are supplied to the correspondence information storage unit 40.

  The moving image dividing unit 60 divides a plurality of frame images received from the image storage unit 30 into a plurality of streams for each person extracted by the moving image person extracting unit 55. Based on the frame image received from the image storage unit 30, the frame image identifier corresponding to the frame image, and the frame image identifier received from the moving image person extraction unit 55, the moving image dividing unit 60 generates a plurality of frame images. Split into multiple streams. When dividing the plurality of frame images into a plurality of streams, the moving image dividing unit 60 associates the frame image identifiers corresponding to the plurality of frame images with the stream identifiers that can uniquely identify each of the plurality of streams. Good. Then, the moving image dividing unit 60 stores the frame image identifier corresponding to the frame image captured at the earliest time among the stream identifier and the frame image included in the stream corresponding to the stream identifier in the correspondence information storage unit 40. Supply.

  The partial area position storage unit 70 stores in advance the position of a partial area that is a part of the monitoring area of the imaging unit 10 in the monitoring area that is the imaging area of the imaging unit 10. For example, the partial region position storage unit 70 may set a coordinate axis in the monitoring region and store the partial region position information based on the coordinate axis. The partial area may be an area that particularly needs monitoring in the monitoring area. The partial region position storage unit 70 supplies information regarding the position of the partial region to the person determination unit 80 and the movement determination unit 85.

  The person determination unit 80 analyzes the moving image picked up by the image pickup unit 10 and determines whether or not a person is present in a partial region that is a part of the monitoring region of the image pickup unit 10. The person determination unit 80 may detect a subject having a motion with respect to the background included in the frame image by matching a plurality of frame images. In addition, the person determination unit 80 may extract a subject by contour extraction, color distribution analysis processing, or the like. Further, the person determination unit 80 may determine whether or not the subject is a person by skin color extraction or the like. When the person determination unit 80 determines that a person exists in the partial area, the person determination unit 80 supplies information related to the timing at which the frame image including the partial area determined to have a person is captured to the correspondence information storage unit 40. The person determination unit 80 also supplies the still image capturing control unit 22 with information indicating that a partial region still image is captured.

  The motion determination unit 85 analyzes the moving image captured by the imaging unit 10 and determines whether or not there is a motion in a partial region that is a part of the monitoring region of the imaging unit 10. The motion determination unit 85 compares the frame image with a plurality of frame images captured in succession to the frame image, and determines a motion amount that is equal to or greater than a predetermined value for the motion of the subject included in the frame image. Judge whether to show. For example, the motion determination unit 85 compares a frame image including the subject with a frame image captured continuously from the frame image, and matches the subject. Subsequently, the motion determination unit 85 calculates the amount of deviation of the subject with respect to the background included in the frame image. Then, the motion determination unit 85 may determine whether or not the calculated shift amount of the subject included in the frame image with respect to the background is greater than or equal to a predetermined amount. When the motion determination unit 85 determines that the amount of deviation from the background included in the frame image of the subject is equal to or greater than a predetermined amount, the motion determination unit 85 captures a frame image with motion. Information relating to the corresponding timing is supplied to the correspondence information storage unit 40. In addition, the motion determination unit 85 supplies information indicating that a still image in the partial area is to be captured to the still image capturing control unit 22.

  The correspondence information storage unit 40 receives the frame image identifier, the still image identifier, the information related to the imaging timing of the frame image corresponding to the frame image identifier, and the information related to the imaging timing of the still image corresponding to the still image identifier from the image storage unit 30. Receive. Then, the correspondence information storage unit 40 is configured so that the frame image and the still image constituting the moving image are based on the timing when the frame image constituting the moving image is captured by the imaging unit 10 and the timing when the still image is captured by the imaging unit 10. Is stored.

  In addition, the correspondence information storage unit 40 includes information indicating that the person included in the plurality of frame images and the person included in the still image are the same person, a person identifier, and the still image identifier of the still image including the person , And the frame image identifier of the frame image including the person is received from the same person determination unit 90. Then, the correspondence information storage unit 40 uses a person identifier that can uniquely identify the person that the person extracted by the moving picture person extraction unit 55 and the person extracted by the still image person extraction unit 50 are the same person. Stores correspondence information associated with each other. For example, the correspondence information storage unit 40 includes a frame image captured at substantially the same timing as the still image including the person extracted by the still image person extraction unit 50, and a plurality of images captured continuously from the frame image. Among the frame images, a plurality of frame images determined by the same person determination unit 90 that the same person is included may be stored in association with a person identifier that can uniquely identify the person.

  Furthermore, the correspondence information storage unit 40 receives from the moving image dividing unit 60 the stream image and the frame image identifier corresponding to the frame image captured at the earliest time among the frame images included in the stream corresponding to the stream identifier. Then, the correspondence information storage unit 40 includes a frame image identifier corresponding to the frame image captured at the earliest time among the streams divided by the moving image dividing unit 60 and the frame images included in the stream corresponding to the stream identifier. The still image stored in the image storage unit 30 corresponding to is selected. Then, the correspondence information storage unit 40 stores correspondence information that associates a stream with a still image. The correspondence information storage unit 40 supplies the stored correspondence information to the image storage unit 30.

  The image output unit 100 receives correspondence information, a still image, a frame image, and the like from the image storage unit 30. Then, the image output unit 100 outputs a still image and a frame image to a monitor or the like based on the correspondence information. For example, the correspondence information received by the image output unit 100 from the image storage unit 30 indicates that the person extracted by the moving picture person extraction unit 55 and the person extracted by the still image person extraction unit 50 are the same person. In the case of correspondence information, the image output unit 100 outputs a still image of the person to a monitor or the like for each person extracted by the still image person extraction unit 50. The image output unit 100 may output a frame image including the person as a moving image to a monitor or the like.

  Further, when the correspondence information received from the image storage unit 30 is the correspondence information that associates the stream divided by the moving image division unit 60 with the still image stored in the image storage unit 30. Alternatively, the image output unit 100 may output a stream associated with a still image to a monitor or the like. In such a case, the image output unit 100 may output a still image and a stream associated with the person identifier to a monitor or the like based on the person identifier. That is, the monitoring camera 200 can select a still image and a stream in which a specific person is captured and output the selected still image and stream to a monitor or the like.

  Further, the image output unit 100, when the person determination unit 80 determines that a person is included in the partial area, and a still image captured by the imaging unit 10 when determining that the person is included in the partial area. When the correspondence information in which the person is associated is received, the still image of the person and the frame image including the person may be output to a monitor or the like as a moving image. Even when there is a frame image that is determined to have motion in the partial area in the motion determination unit 85, a still image that has been determined to have motion and a frame image that has been determined to have motion are converted into moving images. May be output to a monitor or the like. Then, the image output unit 100 may supply a high-resolution still image including a person captured in the partial area to the person authentication device or the like via a network such as the Internet, a memory, or the like.

  According to the monitoring camera 200 according to the present embodiment, when there is a person in the partial area, it is possible to capture a high-resolution still image of the person and acquire the action of the person as a stream. In addition, even when there is movement in the partial area, the monitoring camera 200 captures a still image of the partial area that is determined to have movement and a frame that forms a moving image that is determined to have movement in the partial area Images can be acquired. As a result, the monitoring camera 200 can acquire a still image sufficient to authenticate a person or the like in the partial area among the captured moving images, and can acquire only a moving image of a portion necessary for monitoring. Therefore, the monitoring camera 200 can appropriately reduce communication traffic when the captured high-quality image is transmitted to the person authentication device or the like. Furthermore, the monitoring camera 200 can efficiently reduce the capacity for storing images.

  FIG. 3 shows an example of the correspondence information storage unit 42. The correspondence information storage unit 40 stores correspondence information, which is information for associating frame images constituting a moving image with still images. In the correspondence information storage unit 42, a frame image identifier that can uniquely identify a frame image in association with an imaging time, and a still image, which is an example of a timing at which a frame image constituting a still image and a moving image is captured. A still image identifier that can be uniquely identified is stored as correspondence information. The correspondence information storage unit 42 associates a plurality of frame images with separation position information that is position information of the separation when the frame images are divided at predetermined intervals, and the order of the frame images from the divided positions. The frame image identifier and the still image identifier may be stored as correspondence information.

  The correspondence information storage unit 40 associates the person included in the frame image with the person identifier when the person included in the frame image and the person included in the still image are determined to be the same person by the same person determination unit 90. A frame image identifier and a still image identifier may be stored as correspondence information. That is, the correspondence information storage unit 40 stores the frame image identifiers of the plurality of frame images and the still image identifiers of the still images determined by the same person determination unit 90 as including the same person as the person included in the still image. The information may be stored as correspondence information in association with the person identifier of the person.

  FIG. 4 shows an example of a method for dividing a moving image into a plurality of streams in the moving image dividing unit 60. FIG. 5 shows an example of the correspondence information storage unit 44. First, the moving image dividing unit 60 divides a plurality of frame images included in a moving image stored in the image storage unit 30 into a plurality of streams for each person extracted by the moving image person extracting unit 55. For example, the moving image dividing unit 60 divides a plurality of frame images included in the moving image into stream # 800, stream # 820, and stream # 830 for each frame image including the same person. Then, the correspondence information storage unit 44 compares the timing at which a plurality of frame images included in each stream are captured with the timing at which a still image is captured. Subsequently, the correspondence information storage unit 44 associates a still image captured at a timing coincident with a timing at which a plurality of frame images included in the stream are captured, with the stream. For example, if the timing # 460 at which the still image 460 including the person # 930 is captured matches the timing at which the frame image included in the stream # 800 is captured, the correspondence information storage unit 44 determines that the stream # 800 Are stored in association with the stream identifier corresponding to, the still image identifier associated with the still image 460, and the person identifier of person # 930.

  When the timing # 480 at which the still image 480 including the person # 930 is captured matches the timing at which the frame image included in the stream # 830 is captured, the correspondence information storage unit 44 determines that the stream # 830 , The still image identifier associated with the still image 480, and the person identifier of person # 930 are stored in association with each other. Furthermore, when the timing # 470 at which the still image 470 including the person # 950 is captured matches the timing at which the frame image included in the stream # 820 is captured, the correspondence information storage unit 44 determines that the stream # 820 is stream # 820. Are stored in association with the stream identifier corresponding to, the still image identifier associated with the still image 470, and the person identifier of person # 950. As described above, the correspondence information storage unit 44 may store the stream identifier and the still image identifier as correspondence information in association with a person identifier that can uniquely identify a person.

  According to the monitoring camera 200 according to the present embodiment, it is possible to acquire a still image and a stream in which the person is captured only by selecting a person identifier that can uniquely identify the person.

  FIG. 6 shows an example of a hardware configuration of the monitoring camera 200 according to the present embodiment. The surveillance camera 200 according to this embodiment includes a CPU peripheral unit including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and an input / output controller 1584 to the host controller 1582. Input / output unit having communication interface 1530, hard disk drive 1540, and CD-ROM drive 1560 connected, and legacy input / output having ROM 1510, flexible disk drive 1550, and input / output chip 1570 connected to input / output controller 1584 A part.

  The host controller 1582 connects the RAM 1520 to the CPU 1505 and the graphic controller 1575 that access the RAM 1520 at a high transfer rate. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 to control each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 or the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the communication interface 1530, the hard disk drive 1540, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The communication interface 1530 communicates with other devices via a network such as the Internet and a memory. The hard disk drive 1540 stores programs and data used by the CPU 1505 in the monitoring camera 200. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the monitoring camera 200 is activated, a program depending on the hardware of the monitoring camera 200, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 such as a parallel port, a serial port, a keyboard port, and a mouse port.

  The monitoring program provided to the hard disk drive 1540 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The monitoring program is read from the recording medium, installed in the hard disk drive 1540 in the monitoring camera 200 via the RAM 1520, and executed by the CPU 1505. The monitoring program installed and executed in the monitoring camera 200 works on the CPU 1505 and the like, and the imaging unit 10, moving image imaging control unit 20, still image imaging control unit 22, image storage unit 30, correspondence information storage unit 40, still image The person extracting unit 50, the moving image person extracting unit 55, the moving image dividing unit 60, the partial region position storage unit 70, the person determining unit 80, the motion determining unit 85, the same person determining unit 90, and the image output unit 100 are illustrated in FIG. 5 is made to function as the surveillance camera 200 described above.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

2 is a conceptual diagram of a monitoring camera 200. FIG. 2 is a block diagram illustrating a functional configuration of a monitoring camera 200. FIG. It is a figure which shows the corresponding | compatible information storage part. It is a figure which shows the method in which the moving image division part 60 divides | segments a moving image into a some stream. It is a figure which shows the corresponding | compatible information storage part. 2 is a block diagram illustrating a hardware configuration of a monitoring camera 200. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image pick-up part 12 Image pick-up device 20 Movie image pick-up control part 22 Still image pick-up control part 30 Image storage part 40, 42, 44 Corresponding information storage part 50 Still picture person extraction part 55 Movie person extraction part 60 Movie division part 70 Partial area position storage Section 80 Person determination section 85 Motion determination section 90 Same person determination section 100 Image output section 200 Surveillance camera 302, 312, 352, 358 Frame image 400, 410 Still image 460, 470, 480 Still image 600, 650 Corresponding information 900, 910 Person 1505 CPU
1510 ROM
1520 RAM
1530 Communication interface 1540 Hard disk drive 1550 Flexible disk drive 1560 CD-ROM drive 1570 Input / output chip 1575 Graphic controller 1580 Display device 1582 Host controller 1584 Input / output controller 1590 Flexible disk 1595 CD-ROM

Claims (8)

A surveillance camera for capturing an image of a surveillance area,
An imaging unit;
A moving image capturing control unit that causes the imaging unit to capture a moving image of the monitoring area;
A still image capturing control unit that causes the image capturing unit to capture a still image of a partial region that is a part of a monitoring region with a period longer than a frame period of a moving image captured by the image capturing unit;
An image storage unit for storing moving images and still images captured by the imaging unit;
A surveillance camera comprising: a correspondence information storage unit that stores correspondence information that is information for associating a frame image and a still image constituting a moving image stored in the image storage unit. The correspondence information storage unit associates a frame image constituting a moving image and a still image based on the timing at which the imaging unit images a frame image forming the moving image and the timing at which the imaging unit images a still image. The surveillance camera according to claim 1, which stores correspondence information. A moving picture person extracting section for extracting a person included in a frame image constituting the moving picture stored in the image storing section;
A still image person extracting unit for extracting a person included in the still image stored in the image storage unit;
The monitoring camera according to claim 1, wherein the correspondence information storage unit stores correspondence information indicating that the person extracted by the moving picture person extraction unit and the person extracted by the still image person extraction unit are the same person. . For each person extracted by the moving image person extracting unit, the moving image dividing unit further divides the moving image stored in the image storage unit into a plurality of streams,
The monitoring camera according to claim 3, wherein the correspondence information storage unit stores correspondence information that associates the stream divided by the moving image division unit with the still image stored in the image storage unit. A partial region position storage unit that stores in advance a position of a partial region that is a part of the monitoring region of the imaging unit in the monitoring region that is the imaging region of the imaging unit;
A person determination unit that analyzes a moving image of the monitoring area captured by the imaging unit and determines whether a person is present in a partial area that is a part of the monitoring area of the imaging unit;
The still image capturing control unit causes the imaging unit to capture a still image of the partial region when the person determining unit determines that a person is present in the partial region,
The correspondence information storage unit captures a frame image that forms a moving image determined by the person determination unit to determine that a person is present in the partial area, and the image pickup unit performs imaging when the person determination unit determines that a person is present in the partial area. The surveillance camera according to claim 1, wherein correspondence information for associating with a still image is stored. A partial region position storage unit that stores in advance a position of a partial region that is a part of the monitoring region of the imaging unit in the monitoring region that is the imaging region of the imaging unit;
A motion determination unit that analyzes a moving image of the monitoring region captured by the imaging unit and determines whether or not there is a motion in a partial region that is a part of the monitoring region of the imaging unit;
The still image capturing control unit causes the image capturing unit to capture a still image of the partial region when the motion determining unit determines that the partial region has movement,
The correspondence information storage unit captures a frame image constituting a moving image that the motion determination unit has determined to have a motion in the partial area, and the imaging unit captures an image when the motion determination unit determines that the partial region has a motion. The surveillance camera according to claim 1, wherein correspondence information for associating with a still image is stored. A monitoring method for capturing an image of a monitoring area,
A moving image capturing control stage for causing the imaging unit to capture a moving image of the monitoring area;
A still image capturing control step for causing the imaging unit to capture a still image of a partial region that is a part of a monitoring region with a period longer than a frame period of a moving image captured by the imaging unit;
An image storage stage for storing moving images and still images captured by the imaging unit;
A monitoring method comprising: a correspondence information storage step for storing correspondence information, which is information for associating a frame image constituting a moving image stored in the image storage step with a still image. A surveillance program for a surveillance camera that captures an image of a surveillance area, the surveillance camera comprising:
An imaging unit;
A moving image capturing control unit that causes the imaging unit to capture a moving image of the monitoring area;
A still image capturing control unit that causes the imaging unit to capture a still image of a partial region that is a part of a monitoring region with a period longer than a frame period of a moving image captured by the imaging unit;
An image storage unit for storing moving images and still images captured by the imaging unit;
A monitoring program that functions as a correspondence information storage unit that stores correspondence information that is information for associating a frame image and a still image constituting a moving image stored in the image storage unit.

Images