JP2009302659A - Monitoring system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system capable of reducing time and effort required for validation works of a photographed image group transmitted from an image device to the monitoring system and capable of shortening the processing time at the image device. <P>SOLUTION: The monitoring system includes an image device 1 and a master unit 2. The image device 1 includes a subject detection means 13a for carrying out image processing for a photographed image from an image pick-up portion 10 and detecting a subject, an image data processor 11 and a transmission portion 14 for transmitting a photographed image group to the master unit 2 at the time of detecting the subject, and a feature image selecting means 13b for selecting a feature image from the photographed image group. The master unit 2 includes an image display portion 21 and image processing portion 22. The image processing portion 22 displays an image to be selected on image display portion 21, for selecting of the photographed image group to be displayed on the image display portion 21 from a plurality of transmitted photographed image groups. As for the image to be selected, a feature image is used as an image for displaying the photographed image group. The feature image selecting means 13b selects the feature image using the result of the image processing performed by the subject detection means 13a. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a monitoring system using image processing.

  In recent years, with the improvement of crime prevention awareness, convenience such as the ability to check the visitor's (foreigner's) face and the ability to record the visitor's face when absent is evaluated. ) Has become widespread. As such an intercom system, there has been proposed a system incorporating an imaging device for detecting and alerting the human body to alert the surroundings of the house and to prevent intrusion into the house (for example, a patent) Reference 1). Such an intercom system is also called a security intercom system.

The device disclosed in Patent Document 1 includes an imaging device (camera device) having an imaging unit and a monitoring device (monitor device) having an image display unit. The imaging apparatus includes image processing type human body detection means that performs image processing on a captured image captured by the imaging unit to determine whether or not a person exists within the imaging range of the imaging unit. When a person is detected by the human body detection unit, the imaging device transmits a captured image group captured by the imaging unit to the monitoring device. On the other hand, the monitoring device records the captured image group transmitted from the imaging device. The group of captured images recorded by the monitoring device can be displayed on the image display unit by the playback unit provided in the monitoring device, thereby confirming whether or not an intruder really exists with the eyes of the user. It can be carried out.
JP 2007-194863 A

  By the way, in what is shown in the said patent document 1, whenever a person is detected by a human body detection means, a captured image group is transmitted from an imaging device to a monitoring device. Therefore, if the number of times a person is detected increases, the number of captured image groups (number of recorded images) recorded by the recording unit of the monitoring apparatus also increases. However, in the technique disclosed in Patent Document 1, in order to perform a confirmation operation of a captured image group, the captured image group must be reproduced one by one by a reproduction unit and actually displayed on the image display unit. Therefore, in the above-mentioned Patent Document 1, there is a problem that as the number of recorded images in the captured image group increases, much time and labor are required for the confirmation work.

  The present invention has been made in view of the above points, and the object thereof is to reduce the time and labor required for checking the captured image group transmitted from the imaging apparatus to the monitoring apparatus, and in the imaging apparatus. An object of the present invention is to provide a monitoring system capable of shortening the processing time.

  In order to solve the above-described problem, the invention of claim 1 includes one or more imaging devices including an imaging unit that images a predetermined region, and a monitoring device including an image display unit. An object detection unit that detects an object by performing image processing on a captured image captured by the unit, and whether or not the object exists in the predetermined region using a detection result of the object detection unit Presence / absence determination means for determining whether or not the object is present by the presence / absence determination means, and image transmission for transmitting the captured image group captured by the imaging unit within a predetermined time including the detection time of the object to the monitoring device And a feature image selection means for selecting a feature image in which the feature of the captured image group appears from the captured image group transmitted from the image transmission means to the monitoring device. The transmitted captured image group is A stored image storage unit, a first display unit for displaying captured images included in the captured image group stored in the image storage unit on the image display unit in time series, and a plurality of imaging units stored in the image storage unit A second display unit that generates a selection image used when selecting a captured image group to be displayed on the image display unit by the first display unit from the image group, and displays the selection image on the image display unit; In creating the selection image, the second display unit uses a feature image corresponding to the captured image group as an image for displaying the captured image group, and the feature image selection unit is executed by the object detection unit. A feature image is selected by using a result of image processing.

  According to the first aspect of the present invention, in the selection image used when selecting the captured image group to be displayed on the image display unit by the first display means, the captured image is displayed as an image for displaying the captured image group. Since the feature image selected as the captured image in which the feature of the captured image group appears from the group is used, it is possible to roughly know the content of the captured image group corresponding to the feature image by viewing the feature image Therefore, it is not necessary to display the captured image group on the image display unit by the first display means one by one, and it is not necessary to confirm the contents, and it is possible to reduce the time and labor required for confirming the captured image group. The feature image selection means selects the feature image using the result of the image processing performed by the object detection means, so the load on the process of selecting the feature image can be reduced. From, it is possible to shorten the processing time in the image pickup apparatus.

  According to a second aspect of the present invention, in the first aspect of the present invention, the object is a moving object, and the object detecting means is a moving object based on at least a captured image captured by the imaging unit as the image processing. A moving object detecting process for detecting the moving object, a feature value calculating process for calculating a feature value of the moving object detected by the moving object detecting process, and a feature value calculated by the feature value calculating process. An object value determination process for determining whether or not the object is an object, and the feature image selection unit calculates an evaluation value for selecting a feature image from the feature value calculated by the feature value calculation process. And a selection process for selecting the feature image based on the evaluation value calculated in the evaluation value calculation process.

  According to the second aspect of the present invention, since the feature quantity used for detecting the object is used for selecting the feature image, the processing time in the imaging apparatus can be shortened.

  According to a third aspect of the present invention, in the first or second aspect of the invention, the selection image is an image formed by arranging thumbnail images obtained by reducing the characteristic images in a predetermined order.

  According to the invention of claim 3, since it is possible to see thumbnail images of a plurality of captured image groups in the selection image, it is possible to further reduce the time and labor required for checking the captured image group.

  According to a fourth aspect of the present invention, in the third aspect of the present invention, the predetermined order is characterized in that the date and time when the captured image group is received by the monitoring apparatus is the newest order.

  According to the fourth aspect of the present invention, the order in which the captured image group is received in the monitoring device can be grasped by the order of the thumbnail images, and whether the captured image group is new or old can be seen at a glance. The time and labor required for work can be further reduced.

  According to a fifth aspect of the present invention, in the third or fourth aspect of the present invention, a plurality of the imaging devices are provided, and the second display means stores a plurality of images stored in the image storage means when creating the selection image. Of these captured image groups, only the captured image group captured by the predetermined imaging device is used.

  According to the fifth aspect of the present invention, since the selection image can be displayed for each imaging device, it is possible to further reduce the time and labor required for confirming the captured image group.

  In the invention of claim 6, in the invention of claim 3 or 4, when the second display means creates the selection image, the second display means is a predetermined one of a plurality of captured image groups stored in the image storage means. Only the captured image group received by the monitoring device during the time period is used.

  According to the sixth aspect of the present invention, since the monitoring device can display the selection image for each time zone when the captured image group is received from the imaging device, the time and labor required for the confirmation operation of the captured image group are further reduced. be able to.

  According to a seventh aspect of the present invention, in the third or fourth aspect of the present invention, a plurality of the imaging devices are provided, and the second display means stores a plurality of images stored in the image storage means when creating the selection image. A first picked-up image group made up of picked-up images picked up by a predetermined image pick-up device and a plurality of picked-up image groups stored in the image storage means in a predetermined time zone. Either one of the second captured image group consisting of the captured image group received by the apparatus is used, and the monitoring device uses the second display unit to obtain the first captured image group and the second captured image group. Selection input means used for selecting which one to use is provided.

  According to the seventh aspect of the present invention, the selection image can be displayed for each imaging device or for each time zone when the monitoring device receives the captured image group from the imaging device. Since it is possible to select whether to collect the captured image group from the imaging device according to the time period, it is possible to further reduce the time and labor required for confirming the captured image group.

  According to an eighth aspect of the invention, in the invention according to any one of the third to seventh aspects, the second display means displays related information of the thumbnail image together with the thumbnail image.

  According to the eighth aspect of the present invention, since the thumbnail image and the related information of the thumbnail image can be viewed by viewing the selection image, the time and labor required for checking the captured image group can be further reduced. it can.

  According to a ninth aspect of the present invention, in the invention according to any one of the third to eighth aspects, the monitoring device includes size input means used for inputting a size of the thumbnail image, and the second display means. The size change processing for changing the size of the thumbnail image used for the selection image according to the size input by the size input means, and once on the image display section according to the size input by the size input means And a display number changing process for changing the number of thumbnail images to be displayed.

  According to the invention of claim 9, since the balance between the visibility of thumbnail images and the number of thumbnail images that can be confirmed at a time can be changed according to the user's preference, the usability is improved and the captured image is also improved. The time and labor required for the group confirmation work can be further reduced.

  According to a tenth aspect of the present invention, in the invention according to any one of the first to ninth aspects, the feature image selecting means selects the feature image from a part of the captured image group.

  According to the tenth aspect of the present invention, it is possible to further reduce the load required for the process of selecting the feature image, so that it is possible to further shorten the processing time in the imaging apparatus.

  Since the present invention can roughly know the contents of the captured image group simply by looking at the selection image, it can reduce the time and labor required for confirming the captured image group, and the feature image can be selected. Since the load on the processing to be performed can be reduced, the processing time in the imaging device can be shortened.

  Hereinafter, the monitoring system of the present invention will be described based on an embodiment applied to a security intercom system (hereinafter abbreviated as an intercom system).

  As shown in FIG. 2, the intercom system according to the present embodiment includes two imaging devices 1 installed at the eaves of a house H (hereinafter, distinguished by 1A and 1B as necessary), and inside the house H (indoor). It is comprised with the main | base station (interphone main | base station) 2 which has the function as a monitoring apparatus which comprises the monitoring system with the imaging device 1 installed in the terminal, and the subunit | mobile_unit (interphone subunit | mobile_unit) 3 installed outside the house H (outdoor) Has been. In addition, each imaging device 1 and the subunit | mobile_unit 3 are connected to the main | base station 2 with the transmission line. Moreover, since the subunit | mobile_unit 3 can employ | adopt a conventionally well-known thing, description of the subunit | mobile_unit 3 is abbreviate | omitted in this embodiment.

  As illustrated in FIG. 1, the imaging apparatus 1 includes an imaging unit 10 that captures an image of a predetermined imaging area. The image pickup unit 10 controls an image pickup element (not shown) made of a solid-state image pickup element such as a CCD image sensor or a CMOS image sensor, and a DSP (Digital Signal Processor) that functions as a camera together with the image pickup element. A device (not shown) is provided as a main component. The control device captures the output (charge) of the image sensor at a predetermined frame rate (for example, 15 FPS), and image data (digital data in a predetermined format (for example, YUV format) based on the captured output of the image sensor (for example, YUV format). (Hereinafter referred to as “captured image”). In addition, the control device has an automatic control function for the gain of the image sensor, a color control function for converting an image into a grayscale image, and the like. When a CMOS image sensor is used as the image pickup device, a one-chip camera in which the image pickup device and the control device are integrally configured using a system-on-chip (SoC) technology or the like may be used as the image pickup unit 10. it can.

  The imaging device 1 includes an image data processing unit 11 that receives a captured image from the imaging unit 10, and a storage unit 12 that is a rewritable storage device (storage device) such as a flash memory that is used to store (store) the captured image. And an image processing unit 13 that performs image processing on the captured image, a transmission unit 14 that transmits the captured image to the parent device 2, a heat ray sensor 15, and a control that performs overall control processing of the imaging device 1. Part 16.

  The image data processing unit 11 is configured by, for example, an FPGA (Field Programmable Gate Array). The image data processing unit 11 executes a process (storage process) of adding a management identification code (for example, a frame number) to the captured image and writing it in the storage unit 12. In addition, the image data processing unit 11 executes processing (sending processing) for sending a captured image to the image processing unit 13.

  Further, the image data processing unit 11 executes a process (image data transmission process) for transmitting the captured image to the transmission unit 14. The image data transmission process is divided into a past image transmission process and a current image transmission process. In the past image transmission process, when a transmission start signal to be described later is received from the control unit 16, the imaging time of the group of captured images stored in the storage unit 12 is before the detection time (the time when the person who is the object is detected). From the captured image, the imaging time should be the same time as the current time (a range that can be considered to be the same time, not the same time in a strict sense). This is a process of acquiring a group of captured images up to (good) captured images and outputting them to the transmission unit 14 in order of imaging time (in order of imaging time). The current image transmission process is a process of transmitting the captured image being captured by the imaging unit 10 to the transmission unit 14 after the past image transmission process is completed. Note that the current image transmission process ends when the image data processing unit 11 receives a transmission end signal described later from the control unit 16.

  The transmission unit 14 executes a process of encoding (transmission path encoding) the captured image received from the image data processing unit 11 and sending it to the parent device 2. Here, the transmission timing of the image data from the transmission unit 14 to the parent device 2 is synchronized with the frame rate of the imaging unit 10 (15 FPS in the present embodiment). The transmission unit 14 executes a process (YUV / NTSC conversion process) for converting a captured image in YUV format into a captured image in NTSC format before encoding the captured image on a transmission path. However, if the base unit 1 can reproduce the captured image in the YUV format as it is, it is not necessary to execute the YUV / NTSC conversion process. In addition, the transmission unit 14 performs a process of compressing the captured image and a process of enhancing the outline of the captured image as necessary.

  Therefore, in the present embodiment, the monitoring device captures a group of captured images captured by the imaging unit 10 within a predetermined time including the detection time of the person who is the object by the image data processing unit 11 and the transmission unit 14 of the imaging device 1. An image transmission means for transmitting to a certain parent device 2 is configured.

  The image processing unit 13 includes an object detection unit 13a and a feature image selection unit 13b. Such an image processing unit 13 is, for example, a microcomputer (microcontroller, abbreviated as a microcomputer, also referred to as a CPU in a broad sense), and an object detection unit 13a is executed by executing a program stored in a memory with the CPU. And the feature image selection means 13b is implement | achieved. In addition to the microcomputer, a dedicated ASIC (Application Specific Integrated Circuit) or DSP can be used for the image processing unit 13.

  The target object detection means 13a detects a target object (a person in this embodiment) by performing image processing on the captured image captured by the imaging unit 10. The object detection means 13a executes a reduction process, a moving object detection process, a feature amount calculation process, and an object determination process as image processing.

  The reduction process is a process of creating a reduced image by reducing the captured image (reducing the size of the captured image). In the reduction processing, for example, each pixel value of a plurality of pixels included in a rectangular region having a predetermined size in a pixel group constituting a captured image is sequentially replaced with an average value of pixel values of the plurality of pixels. As a result, a reduced image is created. Thus, noise can be reduced by reducing the captured image. Further, by detecting the object using the reduced image, it is possible to reduce the time required for the image processing as compared with the case where the captured image is used as it is. The reduction process is not limited to the above example, and various conventionally known processes can be employed. Further, the reduction process is not necessarily a necessary process and can be omitted.

  The moving object detection process is a process for detecting a moving object from the reduced image obtained by the reduction process, and includes, for example, a contour extraction process, a moving contour extraction process, and a moving region extraction process. In the contour extraction process, for example, a contour (edge) is extracted from the reduced image by performing differentiation processing (calculating a differential value of each pixel) on the reduced image using a generally known SOBEL filter or the like. This is a process of creating a contour image indicating the contour of the reduced image. In the moving contour extraction process, for example, logical synthesis is performed using time-series contour images stored in the storage unit 12 to create a composite image in which only the contour of the moving body (hereinafter referred to as “moving contour”) is extracted. It is processing. The moving area extraction process is a process for extracting an area corresponding to the moving body (hereinafter referred to as “moving area”) based on the outline of the moving body extracted by the moving outline extraction process, for example. In the moving area extraction process, for example, a moving area corresponding to a moving body is created by labeling a composite image. Here, the moving area is composed of, for example, a rectangular (quadrangle) area (moving frame) circumscribing the moving outline.

  The feature amount calculation process is a process of calculating the feature amount of the moving object detected by the moving object detection process. The feature amount calculation process in the present embodiment is a process for calculating the length (number of pixels) in the vertical direction (vertical direction) of the moving area from the moving area obtained by the moving body detection process. That is, in the present embodiment, the length in the vertical direction of the moving area corresponding to the moving body is used as the feature amount of the moving body.

  The object determination process is a process for determining whether or not the moving object is an object (a person in the present embodiment) using the feature amount calculated by the feature amount calculation process, and includes a detection process and a confirmation process. Is done.

  The detection process determines that the moving body is a person if the feature amount of the moving body (that is, the length in the vertical direction of the moving area) is not less than the lower limit for human body determination and not more than the upper limit for human body determination, Otherwise (less than the lower limit value for human body determination or exceeding the upper limit value for human body determination), a process for determining that the mobile body is not a person is performed (removing the mobile body that is a malfunction source of the imaging apparatus 1 is removed). It can also be called processing.) Here, the lower limit value and the upper limit value for human body determination are the number and size of pixels of the image pickup device of the image pickup unit 10, the installation position of the image pickup unit 10, and the vertical direction of the moving region corresponding to the person actually captured in the captured image. It is determined to be a suitable value from various viewpoints such as the length and the length of the assumed moving region in the vertical direction.

  The confirmation process is a process for determining whether or not the moving body is a person based on the continuity of the moving body (detected moving body) determined to be a person by the detection process. For example, in the determination process, whether or not the number of times (or time) that the detected moving body is continuously captured in the time-sequential captured image (reduced image) exceeds the number of times of continuity determination (or continuity determination time). Thus, it is determined whether or not the detected moving body is a person. As an example, when the number of times of continuity determination is two, when the detected moving body is captured twice in the captured image in time series order, it is determined that the detected moving body is a person. When the body appears only once in the chronological order of captured images, it is not determined that the detected moving body is a person. Here, if the continuity determination number is 1, the determination result in the detection process is directly used as the determination result in the determination process.

  The above-mentioned continuity determination number is set to a suitable number according to the situation of the installation location of the imaging device 1. For example, when the installation location of the imaging apparatus 1 is a relatively good view, there is a high possibility that the object will be continuously captured in the captured image. Therefore, erroneous detection is performed by relatively increasing the number of continuity determinations. Can be suppressed. On the other hand, when the installation location of the imaging device 1 is a relatively unsightly place, there is a high possibility that the object is hidden behind the object and does not appear continuously. It is possible to suppress the detection of an object from being missed.

  Then, the object detection unit 13a outputs a human body detection signal to the control unit 16 when it is determined that the moving body is a person by the object determination process.

  The feature image selection unit 13b selects a feature image in which the feature of the captured image group appears from the captured image group transmitted from the image transmission unit to the master unit 2. The feature image selection unit 13b executes an evaluation value calculation process and a selection process.

The evaluation value calculation process is a process for calculating an evaluation value for feature image selection from the feature value calculated by the feature value calculation process in the object detection unit 13a. In the evaluation value calculation process in the present embodiment, when the feature value is V _S , the evaluation value V _E is obtained by V _E = | V _R −V _S | + α. Here, V _R is a reference value indicating the vertical length of the optimal movement area as feature image, for example, the vertical length of the value of an ideal moving region human systemic objects appear in appropriate size Set to α is a correction value, and is determined by how close the shape of the moving region (for example, the aspect ratio of the moving region) is to the shape of the ideal moving region (in this embodiment, the shape of the moving region is the ideal value). The closer the shape is to the shape of a typical moving area, the smaller the value). The evaluation value calculated in the evaluation value calculation process is stored in the storage unit 12 in association with the identification code of the captured image.

The selection process is a process of selecting a feature image from the captured image group based on the evaluation value calculated in the evaluation value calculation process. In selection process in this embodiment selects the readout from the storage unit 12 the evaluation value V _E of the captured images included in the captured image group, the smallest captured image evaluation value V _E as characteristic images.

  As described above, the feature image selection unit 13b selects a feature image using the result of the image processing (the result of the feature calculation process) executed in the object detection unit 13a. Then, the feature image selection unit 13b sends information related to the feature image corresponding to the captured image group (for example, the identification code of the captured image selected as the feature image) to the transmission unit 14, and the transmission unit 14 sends a parent that is a monitoring device. Transmit to machine 2.

  The heat ray sensor 15 includes, for example, a lens (not shown) constituting an optical system that collects heat rays from a predetermined area, a pyroelectric element (not shown) that converts a change in the collected heat rays into an electrical signal, A hot-wire human body detector comprising an amplifier circuit (not shown) for amplifying a signal, and a comparator (not shown) for detecting the presence of a person in a predetermined region by comparing the level of the amplified signal with a threshold value is there. The heat ray sensor 15 outputs a human body detection signal to the control unit 16 when detecting a human body.

  The control part 16 is comprised by the microcomputer etc. which implement | achieve various functions, for example by running the program memorize | stored in memory with CPU. An image processing unit 13 and a heat ray sensor 15 are connected to the control unit 16. The control unit 16 outputs the above-described transmission start signal to the image data processing unit 11 when receiving the human body detection signal from the image processing unit 13 or the heat ray sensor 15 (that is, when detecting the presence of a person). (Transmission start processing) is executed. That is, in this embodiment, the control part 16 comprises the presence determination means which determines whether a target exists in a predetermined area | region using the detection result of the target detection means 13a. In this embodiment, the detection results of the image processing unit 13 and the heat ray sensor 15 are used. However, the heat ray sensor 15 is not necessarily provided, and the presence / absence determination is performed using only the detection result of the image processing unit 13. You may go. Further, instead of the heat ray sensor 15, a sensor based on a different operation principle may be adopted, or such a sensor may be used in combination with the heat ray sensor 15.

  Moreover, the control part 16 performs the process which outputs a notification start signal to the alerting | reporting part (not shown) provided in the imaging device 1 in the said transmission start process. Here, the notification unit is for intimidating notification to an intruder, and includes a light used for visual threats and an electroacoustic transducer (buzzer or Speaker). The notification unit performs a threatening operation of turning on the light or outputting sound from the electroacoustic transducer until receiving a notification end signal described later after receiving the notification start signal from the control unit 16.

  The control unit 16 outputs the above-described transmission end signal to the image data processing unit 11 after a predetermined time has elapsed after receiving the human body detection signal (for example, after 30 seconds have elapsed from the detection time). Furthermore, the control unit 16 outputs the above-described notification end signal to the notification unit after a predetermined time has elapsed after receiving the human body detection signal (for example, after 3 seconds have elapsed from the detection time). The timing for outputting the transmission end signal and the notification end signal is not limited to the above example. The timing for outputting the transmission end signal and the notification end signal may be set freely by the user.

  As shown in FIG. 1, the master unit 2 includes a transmission unit 20 connected to the transmission unit 14 of the imaging apparatus 1 via a communication line, and an image display unit 21 that is an image display device such as a liquid crystal display (LCD) or a CRT display. An image processing unit 22 that creates a display image for the image display unit 21, a storage unit 23 that is a rewritable storage device such as a flash memory used for storing (storing) a captured image, and a setting image A setting image creation unit 24 that creates a setting image, a display image synthesis unit 25 that synthesizes the setting image with a display image, an input unit 26 that is a user interface for the user to operate the parent device 2, and the entire parent device 2 And a control unit 27 that performs a typical control process.

  In addition to the above configuration, base unit 2 includes a call device (not shown) for making a call with handset 3. The call device includes a communication unit that transmits and receives voice data to and from the handset 3, a microphone for voice input, a speaker for voice output, and the like. If the handset 3 is equipped with a camera, an image captured by the handset 3 camera may be displayed on the image display unit 21 when the handset 3 operates. As such a communication device, a conventionally well-known device can be adopted, and detailed description thereof is omitted.

  The transmission unit 20 executes a process of decoding (transmission path decoding) a signal indicating the captured image and feature image information received from the transmission unit 14 of the imaging apparatus 1 and outputting the decoded signal to the image processing unit 22. In addition, when the process of compressing the captured image is performed in the transmission unit 14 of the imaging device 1, the transmission unit 20 executes the process of expanding the compressed captured image.

  The image display unit 21 is an image captured by the imaging unit 10 of the imaging device 1 (see FIG. 3C) or a selection image created by the image processing unit 22 (see FIGS. 3A and 3B). ) And setting images (see FIGS. 4A to 4G).

  The image processing unit 22, the setting image creation unit 24, and the display image synthesis unit 25 described above are configured by, for example, a microcomputer, and execute various processes described later by executing a program stored in the memory by the CPU. In addition to the microcomputer, a dedicated ASIC or DSP can be used.

  The input unit 26 includes, for example, a plurality (four in the illustrated example) of operation buttons (push buttons) disposed in the vicinity of the image display unit 21 (lower in the illustrated example) of the parent device 2 as illustrated in FIGS. It has SW (it distinguishes with SW1-SW4 as needed). The input unit 26 includes a response button (not shown) corresponding to a call from the handset 3, and the call device is activated by operating the response button.

  The control unit 27 includes, for example, a microcomputer (microcontroller, abbreviated as a microcomputer, also referred to as a CPU in a broad sense) that realizes various functions by executing a program stored in a memory with a CPU. The control unit 27 changes the operation mode of the parent device 2 by outputting a control signal to the image processing unit 22 and the setting image creation unit 24. Master device 2 in this embodiment has a standby mode, a display mode, a playback mode, a setting mode, a selection mode, and a response mode as operation modes. Note that the response mode is an operation mode that enables a call with the slave unit 3 by the above-described call device, and a description thereof will be omitted.

  The standby mode is an operation mode that waits for an operation of the input unit 26 by the user, transmission of a captured image group from the imaging device 1, calling from the slave unit 3, and the like. In this standby mode, when the captured image group is received by the transmission unit 20, the control unit 27 sets the operation mode to the display mode. Further, when a predetermined operation button SW is operated in the standby mode, the control unit 27 sets the operation mode to the selection mode or the setting mode.

  The display mode is an operation mode in which an image being picked up by the image pickup apparatus 1 is mainly displayed on the master unit 2. In this display mode, the image processing unit 22 executes processing (display processing) for displaying the captured image group received from the transmission unit 20 on the image display unit 21 in time series.

  By the way, when the captured image group is received by the transmission unit 20, the image processing unit 22 executes a process (recording process) for storing the received captured image group in the storage unit 23. Therefore, in the present embodiment, the storage unit 23 is used as an image storage unit that stores a captured image group transmitted from the image transmission unit (the image data processing unit 11 and the transmission unit 14).

  In the recording process, the image processing unit 22 performs format conversion, compression / decompression, and the like on each captured image included in the captured image group transmitted from the image transmission unit, and converts the captured image group into a moving image (captured moving image). ) In the storage unit 23. As the identification information, the date and time (imaging date and time) received by the transmission unit 20, the information related to the imaging device 1 that captured the captured image that is the basis of the captured video (imaging device identification information), and the captured video are included in the captured video. Various information such as an identification number for identification is added. Note that the image processing unit 22 performs various processes such as image size conversion, noise reduction, brightness adjustment, color adjustment, and contour enhancement on the captured image as necessary during the execution of display processing and recording processing. The process (image processing process) is performed.

  As described above, when the captured image group is transmitted from the imaging device 1 to the parent device 2, the transmitted captured image groups are displayed in time series on the image display unit 21 of the parent device 2, and the transmitted imaging is performed. The image group is stored (recorded) in the storage unit 23.

  The captured moving image recorded in the storage unit 23 is used in the playback mode. The playback mode is an operation mode in which the parent device 2 plays back the captured moving image stored in the storage unit 23. In this reproduction mode, the image processing unit 22 displays the captured images included in the captured moving image stored in the storage unit 23 serving as an image storage unit on the image display unit 21 in time-series order (reproduces the captured moving image) ( Playback process). In the reproduction process, the image processing unit 22 displays the message M together with the captured moving image as shown in FIG. The message M displays the identification number of the captured moving image being reproduced, the imaging device identification information, and the imaging date and time. As described above, in the present embodiment, the image processing unit 22 configures a first display unit that causes the image display unit 21 to display captured images included in the captured image group stored in the image storage unit in time series order.

  The selection mode is an operation mode in which a selection screen for selecting a captured moving image to be reproduced is displayed on the parent device 2. In this selection mode, the image processing unit 22 creates a selection image used when selecting a captured moving image to be displayed on the image display unit 21 by the reproduction process and displays the selection image on the image display unit 21 (selection image). Display process). As described above, in the present embodiment, when the image processing unit 22 selects a captured image group to be displayed on the image display unit 21 by the first display unit from among a plurality of captured image groups stored in the image storage unit. A second display means for creating a selection image to be used and displaying it on the image display unit 21 is configured.

  In creating a selection image in the selection image display process, the image processing unit 22 uses a feature image corresponding to the captured image group as an image for displaying the captured image group. In particular, the image processing unit 22 in the present embodiment creates a thumbnail image S obtained by reducing the feature image to a predetermined size, and uses the thumbnail image S instead of the feature image. For example, as shown in FIG. 3A, the image processing unit 22 converts the thumbnail images S (differentiated by reference numerals S1 to S12 as necessary) into a matrix form (three rows and four in the illustrated example). An image arranged in a matrix of columns is created. One or more images for selection are prepared according to the number of captured moving images. That is, in the example shown in FIG. 3A, since the number of thumbnail images S displayed on one screen is 12, if the number of captured moving images is 12 or less, a selection image is created for one page. When the number of images exceeds 12, images for selection are created for a plurality of pages according to the number of captured moving images.

  In such a selection image, related information of the thumbnail image S together with the thumbnail image S, for example, information such as the above imaging date and time, the above imaging device identification information, and the above identification number may be displayed. Good. In this way, by viewing the selection image, it is possible to see the thumbnail image S and the related information of the thumbnail image S, so that it is possible to reduce the time and labor required for the confirmation operation of the captured image group.

  By the way, a function is assigned to the operation button SW of the input unit 26 according to the current operation mode of the base unit 2 (the control content executed by the control unit 27 differs depending on the operation of the operation button SW). Therefore, the image processing unit 22 displays a frame F for displaying the function of the operation button SW (differentiated by F1 to F4 as necessary) on the image display unit 21. Here, each of the frames F1 to F4 corresponds to each of the operation buttons SW1 to SW4.

  In the selection mode, different functions are assigned to the operation buttons SW when the page of the selection image is switched (see FIG. 3A) and when the captured moving image is selected (see FIG. 3B). When switching the page of the selection image, the operation button SW1 ends the selection mode and shifts to the standby mode, the operation button SW4 displays the next selection image, and the operation button SW2 selects the previous selection. The page return function for displaying the image for use and the function for shifting from the page switching of the image for selection to the selection of the captured moving image are assigned to the operation button SW3. On the other hand, when selecting a captured moving image, a selection frame C for selecting a captured moving image is displayed. Then, the operation button SW1 starts the reproduction of the captured moving image (that is, the selected captured moving image) surrounded by the selection frame C with the function of shifting from the selection of the captured moving image to the selection of the selection image, and the operation button SW3 (that is, the selected captured moving image). A function for shifting to the playback mode), a feed function for moving the selection frame C to the next captured moving image to the operation button SW4, and a return function for moving the selection frame C to the previous captured moving image for the operation button SW2. It has been. Therefore, in each of FIGS. 3A and 3B, the image displayed in each of the frames F1 to F4 displays the function of the corresponding operation button SW1 to SW4.

  In the setting mode, the base unit 2 displays a setting screen for setting the order and type of captured moving images to be displayed as selection images and the size of the thumbnail images S (the number of thumbnail images S to be displayed at one time). It is an operation mode. In this setting mode, the setting image created by the setting image creation unit 24 is displayed on the image display unit 21 by the display image composition 25.

  As shown in FIG. 4A, the setting image creating unit 24 displays setting items, for example, four items of “display order”, “display time zone”, “display device”, and “size”. Create a (basic setting image). In the setting mode, when the frames F1 to F4 are displayed and the setting image shown in FIG. 4A is displayed, the operation button SW3 has a function to end the setting mode and shift to the standby mode. A function for determining an item, an item sending function for the operation button SW4, and an item return function for the operation button SW2 are assigned. For selection of items, a selection frame C as shown in FIG. 3B may be displayed, or the character color representing the item being selected may be different from the others.

  Here, the “display order” is an item that determines the order of the captured moving images to be displayed in the selection image. In this embodiment, the date and time when the captured moving images are received by the parent device 2 is 2 in the order of newest and oldest. It's kind. Therefore, when “display order” is selected, the setting image creation unit 24, as shown in FIG. 4B, “display order setting” indicating the currently set item, and “ A setting image (display order setting image) for displaying “new order” and “old order” is created. In this case as well, frames F1 to F4 are displayed, a function for ending the display order setting on the operation button SW1 (a function for returning to display of the basic setting image), a function for determining setting items on the operation button SW3, and a setting on the operation button SW4. An item sending function and a setting item returning function are assigned to the operation button SW2.

  Then, when “new order” is selected, in the selection image display process executed by the image processing unit 22, a selection image in which the thumbnail images S are arranged in the order of the latest imaging date and time is created. For example, as shown in FIG. 3A, the image capturing date and time of the thumbnail image S1 is the newest, and thereafter the thumbnail images S2, S3, S4, S5, S6, S7, S8, S9, S10, S11, and S12 are imaged in this order. An image for selection whose date and time are old is created. On the other hand, when “oldest order” is selected, in the selection image display process, a selection image in which the thumbnail images S are arranged in chronological order is created. For example, as shown in FIG. 3A, the image pickup date and time of the thumbnail image S1 is the oldest, and thereafter the thumbnail images S2, S3, S4, S5, S6, S7, S8, S9, S10, S11, and S12 are taken in this order. A selection image with a new date and time is created.

  “Display time zone” and “display device” are items for determining the type of captured moving image to be displayed as the selection image. That is, in accordance with this item, a captured moving image that is a target for displaying the thumbnail image S as a selection image among the captured moving images stored in the storage unit 23 is determined.

  In the present embodiment, the “display time zone” is roughly divided into “all display” for displaying all captured moving images as selection images, and an imaged moving image in which the imaging date and time are included in a predetermined time zone. There are two types of “time zone display” to be displayed in the image for use. The “time zone display” is divided into “date specification” for designating up to the date and time of the imaging date and “time specification” for designating only the time of the imaging date and time. For this reason, when “display time zone” is selected, the setting image creating unit 24 sets “display time zone setting” indicating the currently set item and the setting item as shown in FIG. A setting image (display time zone setting image) for displaying “all display” and “time zone display” shown, and “date and time designation” and “time designation” included in the time zone display is created. Also in this case, frames F1 to F4 are displayed, a function for ending the setting of the display time zone on the operation button SW1 (a function for returning to display of the basic setting image), a function for determining setting items on the operation button SW3, and a button for the operation button SW4. A setting item sending function and a setting item returning function are assigned to the operation button SW2.

  When “all display” is selected, in the image display process for selection executed by the image processing unit 22, all captured moving images are set as display targets in the image for selection.

  On the other hand, when “specify date and time” is selected, the setting image creation unit 24, as shown in FIG. 4D, “date and time designation for time zone display” indicating the content currently being set, and date and time designation. Create a setting image (date setting image) that displays the start date and time and end date and time. In this case as well, the frames F1 to F4 are displayed, and the operation button SW1 is set to end the date and time designation setting (function to return to display of the display time zone setting image), and the operation button SW3 is shifted to input of the start date and time and the end date and time. Function and function for determining the input of each date, operation button SW4 is a feed function for input selection of start date and end date and time, and a numeric feed function for each date and time, operation button SW2 is a return for input selection of start date and time and end date and time A function and a numeric return function for each date and time are assigned.

  Then, when the start date and time and the end date and time are input, in the selection image display process executed by the image processing unit 22, the imaging time is stored in the storage unit 23 from the start date to the end date and time. Of the plurality of captured image groups, only the second captured image group consisting of captured image groups received by the base unit 2 in a predetermined time zone is set as a display target in the selection image.

  When “time specification” is selected, the setting image creation unit 24, as shown in FIG. 4E, “time specification for time zone display” indicating the content currently set, and time specification. A setting image (time setting image) for displaying the start time and the end time of is created. Also in this case, the frames F1 to F4 are displayed, and the operation button SW1 is set to end the time designation setting (function to return to the display of the display time zone setting image), and the operation button SW3 is shifted to input of the start time and end time. Function and function for determining the input of each time, operation button SW4 for a feed function for input selection of start time and end time, and a function for feeding numbers for each time, return to operation button SW2 for input selection of start time and end time A function and a numeric return function for each time are assigned.

  Then, when the start time and the end time are input, in the selection image display processing executed by the image processing unit 22, the imaging time is stored in the storage unit 23 from the start time to the end time. Of the plurality of captured image groups, only the second captured image group consisting of captured image groups received by the base unit 2 in a predetermined time zone is set as a display target in the selection image.

  As described above, in the base unit 2 of the present embodiment, the input unit 26 and the control unit 27 are used to select which of the first captured image group and the second captured image group is used in the image processing unit 22. Selection input means is configured.

  In this embodiment, there are two types of “display device”: “sensor camera A” indicating the imaging device 1A and “sensor camera B” indicating the imaging device 1B. Therefore, when “display device” is selected, the setting image creation unit 24 indicates “display device band setting” indicating the item currently being set and the display device, as shown in FIG. “Sensor Camera A” and “Sensor Camera B”, and a setting image (display device setting image) that displays “ON” or “OFF” indicating whether or not the captured moving image captured by each display device is to be displayed. ). Also in this case, the frames F1 to F4 are displayed, a function for ending the setting of the display device on the operation button SW1 (a function for returning to display of the basic setting image), a function for switching “ON” and “OFF” for the operation button SW3, and an operation A function of switching between the sensor cameras A and B is assigned to the buttons SW2 and SW4, respectively.

  Here, when “ON” is selected for “sensor camera A”, in the selection image display process executed by the image processing unit 22, the captured image group captured by the imaging device 1 A is set as a display target in the selection image. When it is set and “OFF” is selected, it is excluded from the display target. In addition, when “ON” is selected for “sensor camera B”, in the selection image display process executed by the image processing unit 22, the captured image group captured by the imaging device 1 B is set as a display target in the selection image. When it is set and “OFF” is selected, it is excluded from the display target.

  Accordingly, the type of captured image group to be displayed in the selection image is set by the combination of “on” and “off” for “sensor camera A” and “sensor camera B”. Specifically, if both “sensor camera A” and “sensor camera B” are “on”, a group of captured images captured by both of the imaging devices 1a and 1b is set as a display target, and “sensor camera A” If only “on” is “on”, only a group of captured images captured by the imaging device 1a is a display target. If only “sensor camera B” is “on”, the captured image captured by the imaging device 1b is displayed. Only groups are displayed.

  By appropriately setting such “display time zone” and “display device”, for example, in the selection image, only the captured moving image captured by the imaging device 1A is captured from the captured moving image stored in the storage unit 23. The selection date and time can be limited by the date and time, and only the thumbnail images related to the captured moving image that the user thinks necessary are displayed in the selection image.

  “Size” is an item for determining the size of the thumbnail image S to be displayed as the selection image. In the present embodiment, the size of the thumbnail image can be selected from various sizes such as “80 × 60”, “100 × 75”, “120 × 90”, “140 × 105”, and the like. Therefore, when “size” is selected, the setting image creating unit 24, as shown in FIG. 4G, “size setting” indicating the currently set item and “80 × 60” indicating the size. ”,“ 100 × 75 ”,“ 120 × 90 ”,“ 140 × 105 ”, and the like are created. Also in this case, the frames F1 to F4 are displayed, the function for ending the size setting on the operation button SW1 (function for returning to display of the basic setting image), the function for determining the size on the operation button SW3, and the size selected for the operation button SW4 , And a function for returning the selected size are assigned to the operation button SW2. Therefore, in the monitoring system of the present embodiment, the input unit 26 and the control unit 27 of the parent device 2 constitute a size input unit used for inputting the size of the thumbnail image S.

  When any size is selected by the size input unit, the image processing unit 22 executes a size change process for changing the size of the thumbnail image S used for the selection image according to the size input by the size input unit. To do. In addition, the image processing unit 22 executes a display number changing process for changing the number of thumbnail images S to be displayed on the image display unit 21 at a time according to the size input by the size input unit. In the display number changing process in the present embodiment, the larger the thumbnail image S size, the smaller the number of thumbnail images S displayed on the image display unit 21 at a time, and the smaller the thumbnail image S size, the image display unit. The number of thumbnail images S to be displayed on 21 at a time is increased.

  For example, as shown in FIG. 3A, it is assumed that the number of thumbnail images S displayed at a time on the image display unit 21 is 12, and the size of the thumbnail images S at this time is “120 × 90”. In this state, when “100 × 75” is selected by the size input means, the image processing unit 22 executes the size changing process and the display number changing process, thereby setting the size of the thumbnail image S to “120 × 90”. The number of thumbnail images S displayed on the image display unit 21 is increased from 12 to 20. As a result, as shown in FIG. 5A, the image processing unit 22 displays the thumbnail image S (S1 to S20 in the illustrated example) having a size of “100 × 75” on the image display unit 21 once (one screen). A setting image to be displayed is created.

  On the other hand, when “140 × 105” is selected by the size input means, the image processing unit 22 changes the size of the thumbnail image S from “120 × 90” to “140 × 105” and the image display unit 21 The number of thumbnail images S to be displayed is reduced from 12 to 6. As a result, as shown in FIG. 5B, the image processing unit 22 displays the thumbnail image S (S1 to S6 in the illustrated example) having a size of “140 × 105” on the image display unit 21 once (one screen). Create a setting image to display six sheets.

  As described above, in the setting mode, various settings of the selection image displayed in the selection mode can be performed.

  As described above, in the intercom system shown in FIG. 1, the monitoring system is configured by the two imaging devices 1 and the parent device 2.

  And the imaging device 1 which comprises a monitoring system is the detection result of the target detection means 13a which detects a target object by performing image processing with respect to the image imaged by the imaging part 10, and the detection result of the target object detection means 13a. Presence / absence determination means (control unit 16) for determining whether or not an object exists in the predetermined area using the above, and a predetermined time including the detection time of the object when the presence / absence determination means determines that the object exists. Among the image transmission means (data processing section 11 and transmission section 14) for transmitting the image group captured by the imaging section 10 to the master unit 2 in time, and among the captured image group transmitted to the master unit 2 from the image transmission means. And a feature image selection means 13b for selecting a feature image in which the feature of the captured image group appears.

  On the other hand, the base unit 2 stores the captured image group transmitted from the image transmission unit (storage unit 23) and the captured images included in the captured image group stored in the image storage unit in chronological order. A captured image to be displayed on the image display unit 21 by the first display unit from the first display unit (image processing unit 22) displayed on the image display unit 21 and a plurality of captured image groups stored in the image storage unit. A second display unit (image processing unit 22) for generating an image for selection used when selecting a group and displaying the image on the image display unit 21; the second display unit generates an image for selection; In this case, a feature image corresponding to the captured image group is used as an image for displaying the captured image group.

  Then, the feature image selection unit 13b of the imaging device 1 selects a feature image using the result of the image processing executed by the object detection unit 13a.

  According to such a monitoring system, the captured image group is displayed in the selection image used when the captured image group to be displayed on the image display unit 21 is selected by the first display unit (image processing unit 22). As the image to be used, a feature image selected as a captured image in which the feature of the captured image group appears from the captured image group is used. Therefore, by viewing the feature image, it is possible to roughly know the contents of the captured image group corresponding to the feature image. Therefore, it is not necessary to display the captured image group on the image display unit 21 by the first display means (image processing unit 22) one by one. As a result, it is possible to reduce the time and labor required for confirming the captured image group.

  In addition, the object in the monitoring system is a person who is a moving object, and the object detection unit 13a executes the moving object detection process, the feature amount calculation process, and the object determination process as image processing. To do. On the other hand, the feature image selection unit 13b executes the evaluation value calculation process and the selection process. Here, the evaluation value calculation process is a process of calculating an evaluation value for feature image selection from the feature quantity calculated by the feature quantity calculation process.

  That is, the feature image selection unit 13b selects a feature image using the result of image processing performed by the object detection unit 12a. Therefore, it is possible to reduce the load on the process of selecting the feature image. Therefore, the processing time in the imaging apparatus 1 can be shortened.

  Further, the selection image created by the image processing unit 22 is an image in which thumbnail images S formed by reducing feature images are arranged in a predetermined order (see FIGS. 3 and 5). Since the thumbnail images S of the captured image group can be viewed, it is possible to further reduce the time and labor required for the confirmation operation of the captured image group.

  In addition, since the predetermined order is the order of the imaging date and time, the order in which the captured image group is received in the parent device 2 can be grasped based on the order of the thumbnail images S, and whether the captured image group is new or old is at a glance. Therefore, it is possible to further reduce the time and labor required for confirming the captured image group. In particular, by arranging the thumbnail images S in order from the most recent imaging date and time, the updated contents can be immediately known.

  Further, when the second display means (image processing unit 22) creates the selection image, the second display means (image processing unit 22) picks up an image with a predetermined image pickup device 1 out of a plurality of picked-up image groups stored in the image storage means (storage unit 23). By using only the captured image group (first captured image group), it is possible to display the selection image for each imaging device 1, and therefore further reduce the time and labor required for confirming the captured image group. Can do. The second display unit (image processing unit 22), when creating the selection image, sets the master unit in a predetermined time zone among a plurality of captured image groups stored in the image storage unit (storage unit 23). By using only the captured image group (second captured image group) received by 2, the base unit 2 can display the selection image according to the time period when the captured image group is received from the imaging device 1. It is possible to further reduce the time and labor required for checking the image group. Further, the second display means (the image processing unit 22), when creating the selection image, includes a captured image group that is included in both the first captured image group and the second captured image group. By using only the three captured image groups, the selection image can be displayed for each imaging device 1 and for each time zone when the parent device 2 receives the captured image group from the imaging device 1. Time and labor can be further reduced.

  In addition, since the parent device 2 can select which of the first captured image group, the second captured image group, and the third captured image group is used, it takes a confirmation operation of the captured image group. Time and labor can be further reduced.

  In addition, the image processing unit 22 changes the size of the thumbnail image S used for the selection image according to the input size, and displays it on the image display unit 21 at once according to the input size. Since the display number changing process for changing the number of thumbnail images S is executed, the balance between the visibility of the thumbnail images S and the number of thumbnail images S that can be confirmed at a time can be changed according to the user's preference. Therefore, the usability is improved, and the time and labor required for confirming the captured image group can be further reduced.

  By the way, the processing performed by the object detection unit 13a and the feature image selection unit 13b of the image processing unit 13 is not limited to the above example, and may be as follows, for example.

  That is, the feature amount calculation processing in the object detection unit 13a may calculate the height of the lowermost end of the moving region with respect to the lower end edge of the captured image from the moving region obtained by the moving body detection processing. In this example, the height of the lowermost end of the moving area with respect to the lower end edge of the captured image (in other words, the position of the moving area) is used as the feature amount. However, a moving area in which the height of the lowermost end of the moving area with respect to the lower end edge of the captured image is 0 (the lower end edge of the captured image is the same as the lowermost end of the moving area) is excluded from the next detection processing target.

  The detection process determines that the moving body is a person if the feature amount of the moving body (that is, the position of the moving area) is not less than the lower limit value for human body determination and not more than the upper limit value for human body determination. If it is less than the lower limit for human body determination or exceeds the upper limit for human body determination, a process for determining that the mobile body is not a person is performed. Here, the lower limit value and the upper limit value for human body determination are the number and size of pixels of the imaging element of the imaging unit 10, the installation position of the imaging unit 10, the position of the moving region corresponding to the person actually captured in the captured image, and the assumption. It is determined to be a suitable value from various viewpoints such as the position of the moving area to be moved.

  In the evaluation value calculation process of the feature image selection unit 13b, the feature amount is used as an evaluation value as it is. The evaluation value calculated in the evaluation value calculation process is stored in the storage unit 12 in association with the identification code of the captured image. In the selection process, the evaluation value of the captured image included in the captured image group is read from the storage unit 12, and the captured image having the smallest evaluation value is selected as the feature image.

  That is, in this example, the feature image selection unit 13b selects, as a feature image, a captured image in which a person is closest to the imaging device with the position of the person as a selection criterion.

  As another example, the feature image selection unit 13b may similarly select a captured image in which a person is located within a predetermined range as a feature image using the position of the person as a selection reference.

  Also, brightness can be selected as a selection criterion. In this case, it is conceivable that the brightness of the entire person (the whole body such as the back and clothes) or the brightness of the face of the person is used as the selection criterion. Here, the reason why a person's whole body and face are distinguished from each other is that the reflectance may differ greatly between the person's whole body (for example, clothes worn) and the person's face. For example, when the reflectance of clothes is higher than that of a person's face, if the brightness of the whole person is used as a selection criterion, the face becomes dark and the characteristics may be difficult to understand. On the other hand, if the brightness of a person's face is used as a selection criterion, clothes may be overexposed and the overall characteristics may be difficult to understand.

  Therefore, when it is desired to see the characteristics of the entire person, a captured image that is captured with appropriate brightness can be selected as the feature image using the brightness of the entire person as a selection criterion. On the other hand, when it is desired to see the characteristics of a person's face, a picked-up image that is captured with appropriate brightness can be selected as a feature image using the brightness of the person's face as a selection criterion.

  Thus, the feature image selection means 13b can employ various selection criteria as feature image selection criteria. For example, in addition to the above, the feature image selection unit 13b may select, as a feature image, a captured image having a large number of people who are captured using the number of people captured in the captured image as a selection criterion. A picked-up image in which a person's face is large can be selected as a feature image using the size of the face as a selection criterion, or the person's face is facing the front using the angle of the person's face as a selection criterion A captured image may be selected as a feature image. The feature image selection criterion is not limited to the above example, and may be appropriately selected according to the user's preference. Further, the feature image selection means 13b may select feature images using a plurality of selection criteria. In this case, a priority order is set for each selection criteria and feature images are selected. do it.

  In the present embodiment, the feature image selection unit 13b, for example, as shown in FIG. 6A, the captured image from the group of captured images (captured images P1 to P28) transmitted from the image transmission unit to the master unit 2. A feature image in which the feature of the group appears is selected.

  However, the feature image selection unit 13b may select a feature image from a part of the captured image group transmitted to the master unit 2 from the image transmission unit. For example, the feature image selection means 13b compresses the captured image group (captured images P1 to P28), which is 15 FPS in this embodiment, with respect to the time axis as shown in FIG. A feature image may be selected from the group of captured images (captured images P2, P5, P8, P11, P14, P17, P20, P23, and P26).

  In this case, it is necessary to execute the evaluation value calculation process on 28 captured images P1 to P28 before compression, but after compression, 9 captured images P2, P5, P8, P11, P14, P17, P20. , P23, and P26 need only be executed. That is, the number of executions of the evaluation value calculation process can be reduced according to the compression rate (in the above example, since the frame rate is compressed three times, the number of executions can be reduced to about 1/3). .

  In this way, if the feature image is selected from a part of the captured image group transmitted from the image transmission means to the master unit 2, the number of times of executing the evaluation value calculation process can be reduced, so the feature image is selected. The load on the processing to be performed can be further reduced. Therefore, the processing time in the imaging apparatus 1 can be further shortened.

  Note that the compression rate when the captured image group is compressed with respect to the time axis in the feature image selection unit 13b is not limited to the above value, and may be set to a suitable value. Further, it is not always necessary to select a feature image from a group of captured images transmitted from the image transmission means to the base unit 2 that are uniformly compressed with respect to the time axis. For example, compression is performed as time elapses from the detection time. The rate may be increased step by step. In short, a feature image may be selected from a part of a group of captured images transmitted from the image transmission means to the master unit 2.

  The configuration of the monitoring system of the present embodiment described above is merely an embodiment of the present invention, and is not intended to limit the technical scope of the present invention to the above example, but is changed to the extent that does not depart from the spirit of the present invention. be able to. For example, the number of the imaging devices 1 is not limited to the above example, and each imaging device 1 does not necessarily have the heat ray sensor 15. Further, the image processing method for human body detection performed by the image processing unit 13 of the imaging apparatus 1 is not limited to the above example, and a conventionally known method such as a method using silhouette matching, background difference, or edge direction code is adopted. be able to. Furthermore, in this embodiment, although the example which applied the monitoring system to the intercom system was shown, of course, it can be used as a monitoring system single-piece | unit, and can also be applied to an intercom system and other systems.

It is a block diagram of the intercom system to which the monitoring system of one embodiment of the present invention is applied. It is a schematic explanatory drawing which shows the example of installation of the intercom system same as the above. It is operation | movement explanatory drawing of the main | base station in the same as the above. It is operation | movement explanatory drawing of the main | base station in the same. It is operation | movement explanatory drawing of the main | base station in the same as the above. It is operation | movement explanatory drawing of the feature image selection means of the other example same as the above.

Explanation of symbols

1 Imaging device 2 Master unit (monitoring device)
DESCRIPTION OF SYMBOLS 10 Image pick-up part 11 Image data processing part 13a Object detection means 13b Feature image selection means 14 Transmission part 16 Control part (existence determination means)
21 Image display unit 22 Image processing unit (first display means, second display means)
23 storage unit (image storage means)
26 Input section

Claims (10)

Having one or more imaging devices including an imaging unit that images a predetermined area, and a monitoring device including an image display unit;
The imaging apparatus includes: an object detection unit that detects an object by performing image processing on a captured image captured by the imaging unit; and an object in the predetermined area using a detection result of the object detection unit. A presence / absence determination unit that determines whether or not an object exists, and a monitoring device that monitors a group of captured images captured by the imaging unit within a predetermined time including a detection time of the object when the presence / absence determination unit determines that the object is present An image transmission means for transmitting to the image data, and a feature image selection means for selecting a feature image in which the characteristics of the captured image group appear from the captured image group transmitted from the image transmission means to the monitoring device,
The monitoring apparatus stores an image storage unit that stores a group of captured images transmitted from the image transmission unit, and a first image display unit that displays captured images included in the captured image group stored in the image storage unit in time series. A selection image used when selecting a captured image group to be displayed on the image display unit by the first display unit from among the plurality of captured image groups stored in the display unit and the image storage unit Second display means for displaying on the image display unit,
In creating the selection image, the second display means uses a feature image corresponding to the captured image group as an image for displaying the captured image group,
The feature image selection means selects a feature image using a result of image processing executed by the object detection means. The object is a moving object,
The object detection means includes, as the image processing, at least a moving body detection process for detecting a moving body from a captured image captured by the imaging unit, and a feature amount of the moving body detected by the moving body detection process. Performing a feature amount calculation process to be calculated, and an object determination process for determining whether or not the moving object is an object using the feature amount calculated by the feature amount calculation process,
The feature image selection means is based on an evaluation value calculation process for calculating an evaluation value for selecting a feature image from a feature quantity calculated by the feature quantity calculation process, and on the evaluation value calculated by the evaluation value calculation process. The monitoring system according to claim 1, wherein selection processing for selecting an image is executed.   3. The monitoring system according to claim 1, wherein the selection image is an image in which thumbnail images obtained by reducing the feature image are arranged in a predetermined order.   4. The monitoring system according to claim 3, wherein the predetermined order is the order in which the date and time when the captured image group is received by the monitoring apparatus is new. A plurality of the imaging devices are provided,
The second display means uses only the captured image group captured by the predetermined imaging device among the plurality of captured image groups stored in the image storage means when creating the selection image. The monitoring system according to claim 3 or 4, characterized in that   The second display means uses only the picked-up image group received by the monitoring device in a predetermined time zone among the plurality of picked-up image groups stored in the image storage means when creating the selection image. The monitoring system according to claim 3 or 4, characterized by the above. A plurality of the imaging devices are provided,
In creating the selection image, the second display unit includes a first captured image group captured by a predetermined imaging device among a plurality of captured image groups stored in the image storage unit. Either one of a captured image group and a second captured image group composed of a captured image group received by the monitoring device in a predetermined time zone among a plurality of captured image groups stored in the image storage unit,
The monitoring apparatus includes a selection input unit used to select which of the first captured image group and the second captured image group is used in the second display unit. Item 5. The monitoring system according to item 3 or 4.   The monitoring system according to claim 3, wherein the second display unit displays related information of the thumbnail image together with the thumbnail image. The monitoring device includes size input means used for inputting the size of the thumbnail image,
The second display means includes a size changing process for changing the size of the thumbnail image used for the selection image according to the size input by the size input means, and a size input by the size input means. The monitoring system according to any one of claims 3 to 8, wherein a display number changing process for changing the number of thumbnail images to be displayed at a time on the image display unit is executed.   The monitoring system according to claim 1, wherein the feature image selection unit selects the feature image from a part of the captured image group.

Images