JP4438344B2 - Monitoring system and method, information processing apparatus and method, recording medium, and program - Google Patents

Description

  The present invention relates to a monitoring system and method, an information processing apparatus and method, a recording medium, and a program, and in particular, a monitoring system that can detect and notify an event easily and reliably and suppress power consumption of a camera or the like. And a method, an information processing apparatus and method, a recording medium, and a program.

  Conventionally, as a home security system, a method of knowing sensor information by viewing a monitor TV (Television) that displays a monitoring image transmitted from an imaging device has been proposed (see, for example, Patent Document 1).

  In addition, a method has been proposed in which a monitoring device in which an infrared sensor and an image sensor are combined detects a human body that has entered a monitoring area by determining the presence or absence of a human body and the presence or absence of a plan (for example, Patent Document 2). reference).

  Furthermore, a technique has been proposed in which a surveillance camera system having a plurality of intelligent cameras detects an abnormality in a surveillance area and records or reproduces the detected video and audio (for example, see Patent Document 3).

  In the inventions described in these Patent Documents 1 to 3, a specific place or a specific abnormality (event) is mainly detected.

Japanese Patent Laid-Open No. 8-124078 JP 2000-339554 A JP-A-7-2127748

  However, in the inventions described in these Patent Documents 1 to 3, not only the adjustment when installing the sensor (imaging device, monitoring device, or a plurality of intelligent cameras) is troublesome, but it is also necessary to install it once. As a result, there is a problem that it is difficult to move to another location.

  Moreover, since the wireless camera used conventionally always transmits an image, an audio | voice, etc., there existed a subject that it was difficult to apply to the system using a battery.

  The present invention has been made in view of such a situation, and it is intended to detect and notify an event easily and reliably and to suppress power consumption of a camera or the like.

In the monitoring system of the present invention, the acquisition means for acquiring sensor data from a plurality of sensors arranged in a predetermined direction, the sensor data acquired by the acquisition means and the data at the time of steady state are compared, and the sensor starts to react. Or a detecting means for detecting the state of the sensor by detecting a point at which the reaction of the sensor has ended, a point detected by the detecting means at which the sensor has started a reaction, and a next sensor adjacent to the sensor reacting. A state number defined based on the starting point, or a state number defined based on the point at which the sensor response has ended and the point at which the next sensor adjacent to the sensor has ended. a state data describing means for describing the status data, when it is determined to notify the event to turn on the power of the imaging means, and imaging control means for taking a notification image, Comparing the status data and the determination table is described by state data describing means, determination means for determining whether or not to notify the event, if it is determined to notify the event by determination means, a notification for notifying the event It comprises a construction means for constructing presentation data including an image , and a presentation means for performing presentation based on the presentation data constructed by the construction means.

  Based on the presentation by the presenting means, the input acquisition means for acquiring the judgment input from the user, the judgment input from the user acquired by the input acquisition means, and the status data described by the status data description means Based on this, it is possible to further provide creation means for creating the determination table.

  The plurality of sensors may be photosensors.

The monitoring method of the present invention , the program recorded on the first recording medium, or the first program is acquired by an acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction, and processing of the acquisition step The detected sensor data is compared with the steady-state data, and the detection step detects the sensor state by detecting the point at which the sensor started to react or the point at which the sensor reaction ended, and the detection step detects The state number defined based on the point at which the sensor started to react and the point at which the next sensor adjacent to the sensor started to respond, or the point at which the sensor reaction ended and the next sensor adjacent to the sensor reaction of include state number defined on the basis of the point ended, the state data describing the steps describing the state data relating to the state of the sensors, the state Comparing the status data and the determination table is described by treatment over data description step, a determining step of determining whether or not to notify the event, if it is determined that notifies an event, turns on the power of the imaging means, Build a presentation data including a notification image for notifying an event when it is determined to notify the event by a shooting control step that causes the shooting means to take a notification image of a region monitored by a plurality of sensors and processing of the determination step And a presenting step for presenting based on the present data constructed by the process of the constructing step.

The information processing apparatus of the present invention is acquired by an acquisition unit that acquires sensor data from a plurality of sensors arranged in a predetermined direction, an imaging unit that captures a notification image of an area monitored by the plurality of sensors, and an acquisition unit. The sensor data is compared with normal data, and the detection means detects the sensor state by detecting the point at which the sensor has started to react or the point at which the sensor reaction has ended, and is detected by the detection means . The state number defined based on the point at which the sensor started reacting and the point at which the next sensor adjacent to the sensor started reacting, or the response of the next sensor adjacent to the sensor at the point where the sensor reaction ended. includes state number defined on the basis of the point ended, the state data describing means for describing the status data relating to the state of the sensor, described by the state data describing means Comparing the status data and the determination table, determining means for whether to notify an event, if it is determined that notifies an event, it turns on the power of the imaging means, and imaging control means for taking a notification image, determination When it is determined that the event is notified by the means, the apparatus includes a transmission means for transmitting the event and a notification image for notifying the event to another device.

  A determination table holding means for acquiring and holding the determination table supplied from the other device may be further provided.

  The transmission means may transmit the state data described by the state data description means to another device.

  The plurality of sensors may be photosensors.

An information processing method, a program recorded on a second recording medium, or a second program according to the present invention includes an acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction, and processing of the acquisition step. By comparing the acquired sensor data with the steady-state data and detecting the point at which the sensor started to react or the point at which the sensor's reaction ended to detect the sensor state, and the detection step process The detected state number based on the point at which the sensor started reacting and the point at which the next sensor adjacent to the sensor started reacting, or the point at which the sensor reaction ended and the next adjacent to the sensor the reaction of the sensor include a state number which is defined on the basis of the point ended, the state data describing the steps describing the state data relating to the state of the sensor, Comparing the status data and the determination table is described by the process of the state data description step, a determination step of determining whether to notify an event, if it is determined that notifies an event, turns on the power of the imaging means, a plurality A shooting control step that causes the shooting means to take a notification image of the area monitored by the sensor , and if it is determined to notify the event by the processing of the determination step, the event and the notification image for notifying the event And a transmission step of transmitting to the apparatus.

In the first aspect of the present invention, sensor data is acquired from a plurality of sensors arranged in a predetermined direction, and the acquired sensor data is compared with data at normal time , or the sensor starts to react, or the sensor response The state of the sensor is detected by detecting the point at which ending, and the state defined based on the detected point at which the sensor started to react and the point at which the next sensor adjacent to the sensor started to react State that describes and describes state data related to the state of the sensor, including a number or state number that is defined based on the point at which the reaction of the sensor has ended and the point at which the next sensor adjacent to the sensor has ended. data and decision table is compared is determined whether to notify the event, if it is determined that notifies an event, the power of the imaging means is turned on, a plurality of sensors Notification image of the region to be viewed is photographed, if it is determined that notifies the event, presentation data including a notification image for notifying the event is presented is built.

In the second aspect of the present invention, sensor data is acquired from a plurality of sensors arranged in a predetermined direction, and the acquired sensor data is compared with data at the time of steady state , or the sensor response is started, or the sensor response The state of the sensor is detected by detecting the point at which ending, and the state defined based on the detected point at which the sensor started to react and the point at which the next sensor adjacent to the sensor started to react State that describes and describes state data related to the state of the sensor, including a number or state number that is defined based on the point at which the reaction of the sensor has ended and the point at which the next sensor adjacent to the sensor has ended. whether the data and the determination table in events being compared is determined, if it is determined that notifies an event, the power of the imaging means is turned on, audit by a plurality of sensors Notification image of the area is captured by the imaging means, when it is determined that notifies an event, an event, a notification image for notifying the event is transmitted to the other device.

  According to the first aspect of the present invention, a detected event can be notified. In particular, it is possible to easily and reliably detect and notify an event based on a user's judgment input. Moreover, useless power consumption can be suppressed.

  According to the second aspect of the present invention, a detected event can be notified. In particular, it is possible to notify other devices of the detected event and to reduce wasteful power consumption.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a configuration example of a monitoring system 10 to which the present invention is applied. In this configuration example, the multi-sensor camera 1 is provided on the left monitoring area side in the figure, and the processing box 2, the presentation unit 3, and the processing box 2 are remotely operated on the notification / presentation side on the right side in the figure. A remote controller 4 is provided. The multi-sensor camera 1 and the processing box 2 perform wireless communication with each other via the wireless antenna 1A and the wireless antenna 2A. The processing box 2 and the remote controller 4 perform wireless communication or infrared communication with each other. The processing box 2 and the presentation unit 3 are connected by a wired or wireless connection such as a bus. The multi-sensor camera 1 and the processing box 2 are not limited to wireless communication, and may be wired communication.

  The multi-sensor camera 1 is installed in an area (necessary place) where an event is to be monitored. For example, as shown in FIG. 2, the multi-sensor camera 1 is provided with a CCD (Charge Coupled Device) camera 21 and photo sensors 22-1 to 22-3. Each sensor is operated by a battery (not shown). Driven.

  The CCD camera 21 captures the situation in the monitoring area (viewing angle) as needed. Although the details will be described later, the multi-sensor camera 1 determines whether or not to notify the event data based on the event detected by the photosensors 22-1 to 22-3, and determines to notify the event data. In this case, image data (event data) captured by the CCD camera 21 is transmitted to the processing box 2.

  As shown in FIG. 3, each of the photosensors 22-1 to 22-3 outputs, as a detection signal, the average luminance in the areas 31-1 to 31-3 that can be monitored by the photosensors 22-1 to 22-3. The output changes in response to a person, animal, or other monitoring target (represented by a person in the following) entering or leaving the area 31-1 to 31-3. Hereinafter, the areas 31-1 to 31-3 that can be monitored by the photosensors 22-1 to 22-3 are simply referred to as monitoring areas 31-1 to 31-3. Note that the photosensors 22-1 to 22-3 are arranged so that the adjacent monitoring areas 31-1 to 31-3 overlap each other. In the present embodiment, the case where the three photosensors 22-1 to 22-3 are mounted on the multi-sensor camera 1 will be described as an example, but the number is not limited to three.

  Returning to the description of FIG. When the multi-sensor camera 1 determines to notify the event, the multi-sensor camera 1 transmits data necessary for event presentation to the processing box 2 via the wireless antenna 1A.

  The processing box 2 receives data necessary for event presentation transmitted from the multi-sensor camera 1 via the wireless antenna 2A, constructs a presentation image and sound based on the received data, and presents the presentation unit 3 and the remote Supplied or transmitted to the controller 4 to present an event.

  The presentation unit 3 is, for example, a general television receiver, and when an event has not occurred (normal case), a general viewing signal (video based on a broadcast signal) is displayed, and when an event has occurred, A picture-in-picture image in which an event image is inserted into a part of a general viewing signal is displayed. The presenting unit 3 is not limited to a television receiver, and may be a dedicated monitor. The displayed image may be an image of the entire screen, not a picture-in-picture image.

  The user can make a determination on the event presented on the presentation unit 3 and can input various commands from the remote controller 4 based on the result of the determination. For example, if you want to continue to notify the event that has occurred, operate the OK button (not shown), and if you do not need to notify the event that has just occurred, indicate that An instruction can be input by operating a button (not shown). Since a notification determination table (described later) created in the processing box 2 and used to determine whether or not to notify an event changes with time based on the determination input from the user, the user can monitor the system. Each time 10 is used, only the event intended by the user is detected and notified.

  In addition, the CCD camera 21 mounted on the multi-sensor camera 1 operates only when it is determined to notify the event, so that useless power consumption can be suppressed.

  FIG. 4 is a block diagram illustrating a functional configuration example of the monitoring system 10 illustrated in FIG. 1.

  The CCD camera 21 of the multi-sensor camera 1 captures the situation in the monitoring area as needed, and supplies the image signal as notification image data to the transmission unit 49 via the switch 47.

  The photosensors 22-1 to 22-3 supply the average luminance in the monitoring areas 31-1 to 31-3 (FIG. 3) to the A / D (Analog to Digital) conversion unit 41 as photosensor values, respectively.

  Here, with reference to FIG. 5, the relationship between the change in the output level of the detection signal output from the photosensors 22-1 to 22-3 and the action of the person (monitoring target) will be described. In the figure, the vertical axis represents the output level of the detection signal output from the photosensors 22-1 to 22-3, and the horizontal axis represents time. The detection signal 81-1 represents a detection signal output from the photosensor 22-1, and the detection signal 81-2 represents a detection signal output from the photosensor 22-2. The output level of a detection signal (not shown) output from the photosensor 22-3 is 0.

  In the case of this example, after the output level of the detection signal 81-1 changes, reactions such that the output level of the detection signal 81-2 changes alternately. Therefore, by detecting this reaction, it is possible to distinguish whether a person is moving from left to right or from right to left.

  Returning to the description of FIG. The sensor reaction detection unit 42 compares the photosensor data A / D converted by the A / D conversion unit 41 with the steady-state sensor value held by the steady sensor reaction holding unit 43, and based on the comparison result. The sensor response is detected, and the detection result is supplied to the state determination unit 44.

  For example, as illustrated in FIG. 6, the sensor reaction detection unit 42 has a predetermined state in which the output level of the detection signal 81-1 output from the photosensor 22-1 does not change (a state in which no person is present in the monitoring area). When it continues for more than the time, the photosensor value (steady value L) at the steady state is calculated in advance, and is held in the steady sensor reaction holding unit 43. Then, the current input value and the steady value L held in the sensor reaction holding unit 43 are compared, and when the difference exceeds the steady range, the sensor reaction is started, and then the difference is within the steady range. Time is the end of the sensor reaction.

  Similarly, when a state in which there is no change in the output level of the detection signal 81-2 output from the photosensor 22-2 and the detection signal (not shown) output from the photosensor 22-3 continues for a predetermined time or longer, The sensor reaction detection unit 42 calculates the steady value L, compares the steady value L with the current input value, and sets the start of the sensor reaction when the difference exceeds the steady range. Thereafter, the difference is within the steady range. When the value falls within the range, the sensor reaction ends.

  Based on the sensor reaction result supplied from the sensor reaction detection unit 42 and the state value held in the state value holding unit 45, the state determination unit 44 is a state of a series of actions (sensor reaction) of a person in the monitoring area. Is described, and is output to the state output unit 48.

  Here, with reference to FIG. 7 and FIG. 8, an example of the state description data described according to the action of the person (according to the reaction of the photosensor) will be described.

  FIG. 7 shows an example in which the state number is defined based on the reaction of the photosensors 22-1 to 22-3. For example, when only the photosensor 22-1 reacts, the state number is “1”, and when only the photosensor 22-2 reacts, the state number is “2”, and the photosensors 22-1 and 22-2 are When it reacts, the state number is set to “3”, and when only the photosensor 22-3 reacts, the state number is set to “4”, and when the photosensors 22-2 and 22-3 react, the state number is set to “6”. When the photosensors 22-1 to 22-3 have reacted, the state number is set to “7”.

  The state value holding unit 45 holds the state number defined in this way as a state value. Based on the sensor reaction result supplied from the sensor reaction detection unit 42 and the state value held in the state value holding unit 45, the state determination unit 44, for example, state description data 91-1 as shown in FIG. , 91-2, 91-3,... (Hereinafter, the state description data 91-1, 91-2, 91-3,. )

  Specifically, for example, the photosensor 22-1 reacts according to the action of the person, then the photosensors 22-1 and 22-2 react, and then the photosensors 22-2 and 22-. 3, the state description data 91-1 describes a state number “1” and its reaction duration, and the state description data 91-2 contains a state number “2” and its reaction duration. Is described, and the state description data 91-3 describes the state number "3" and its reaction duration.

  Then, the state determination unit 44 outputs the state description data 91-1, 91-2 and 91-3 continuously arranged in the time axis direction to the state output unit 48.

  As described above, by describing the state description data 91 including the state number and the duration according to the reaction of the photosensors 22-1 to 22-3, it is possible to roughly estimate the action of the person in the monitoring area. . In the state numbers defined in FIGS. 7 and 8, the horizontal direction and the depth direction can be detected.

  Further, the state determination unit 44 compares the described state description data 91 (FIG. 8) with the notification determination table (described later) received from the processing box 2 held in the processing parameter holding unit 46, and as a result of the comparison, matches. If there is nothing to do (for example, if the state numbers do not match, or if the state numbers match but the reaction duration is not within the table range), it is determined as a notification event and notified to the processing box 2 In addition to supplying the event to the transmission unit 49, the power supply control signal is supplied to the CCD camera 21 to turn on the power, the transmission control signal is supplied to the switch 47 to turn on, and the output of the state output unit 48 is controlled. Thus, the notification image data output from the CCD camera 21 is supplied to the transmission unit 49 via the switch 47, and the state description data 91 (FIG. 8) is supplied from the state output unit 48 to the transmission unit 49.

  Note that in the initial state of the multi-sensor camera 1, the notification determination table is not transmitted from the processing box 2, and the notification determination table is not stored in the processing parameter storage unit 46. When a sensor reaction result is supplied from the sensor reaction detector 42, it is immediately determined as a notification event. That is, all events are notified in the initial state. Thereby, it is prevented that a required event is not notified to a user.

  The transmission unit 49 transmits the notification event supplied from the state determination unit 44 to the processing box 2, and the notification image data supplied from the CCD camera 21 and the state description data 91 supplied from the state output unit 48. Send. The receiving unit 50 receives the notification determination table transmitted from the processing box 2, supplies it to the processing parameter holding unit 46, and accumulates it there.

  The reception unit 61 of the processing box 2 supplies the notification image data and the notification event transmitted from the multi-sensor camera 1 to the presentation image construction unit 62. The receiving unit 61 supplies the state description data 91 transmitted from the multi-sensor camera 1 to the state description data storage unit 63 and stores it therein.

  The presentation image construction unit 62 constructs (creates) notification data in which notification image data is inserted into a part of a general viewing signal (television broadcast signal) when an event is notified from the multi-sensor camera 1 via the reception unit 61. And supplying it to the presentation unit 3 to present it. In addition, the presentation image construction unit 62 constructs notification data for the remote controller 4 (not including the general viewing signal) configured by the notification image data, and supplies the notification data to the transmission unit 66. When the event is not notified (normal case), the presentation image construction unit 62 supplies a general viewing signal (video based on the broadcast signal) to the presentation unit 3 for presentation.

  Since the notification data for the presenting unit 3 is configured by inserting the notification image data into a part of a general viewing signal, the presenting unit 3 is presented with a picture-in-picture display. Further, since the notification data for the remote controller 4 is composed of notification image data, only the display representing the event (for example, the image of the place being monitored) is presented on the presentation unit 72 of the remote controller 4. The

  When the notification determination table updating unit 64 receives a signal related to user feedback (FB) (hereinafter referred to as a user FB signal as appropriate) from the remote controller 4 via the receiving unit 67, the user feedback is sent to the state description data storage unit. Is supplied to 63 and stored there. The notification determination table update unit 64 reads the state description data 91 stored in the state description data storage unit 63 and the corresponding user feedback, compares them with the notification determination table, and creates a table based on the comparison result. Update. Then, the notification determination table update unit 64 supplies a new notification determination table to the transmission unit 65 when different from the notification determination table previously transmitted to the multi-sensor camera 1.

  Here, the user feedback means a user's determination input that is input using the input unit 73 of the remote controller 4 when the user makes a determination on the presented event. For example, the user operates the OK button (not shown) of the input unit 73 when the user wants to keep informed of the event, and the NG button (not shown) when it is not necessary to detect the event as an event in the future. Can be input as user feedback. Alternatively, feedback may be performed only when it is not necessary to detect the event.

  When the state description data 91 is supplied from the receiving unit 61 and the user feedback is supplied from the notification determination table updating unit 64, the state description data storage unit 63 stores the state description data 91 and the user feedback in association with each other. If only one of the state description data 91 and the user feedback is supplied, it is stored as new state description data or new user feedback.

  The transmission unit 65 transmits the notification determination table supplied from the notification determination table update unit 64 to the multi-sensor camera 1. The transmission unit 66 transmits the notification data supplied from the presentation image construction unit 62 to the remote controller 4. The receiving unit 67 receives the user FB signal transmitted from the remote controller 4 and supplies it to the notification determination table updating unit 64.

  The receiving unit 71 of the remote controller 4 receives the notification data transmitted from the processing box 2 and causes the presenting unit 72 to present it. The input unit 73 receives an input based on a judgment from the user with respect to the presented event, and supplies a signal related to the input (user feedback) to the transmission unit 74. The transmission unit 74 transmits the user FB signal supplied from the input unit 73 to the processing box 2.

  Here, as described above, the user feedback indicates, for example, a determination input by the user such as “an event that I want to be notified in the future” or “an event that should not be notified in the future”. The multi-sensor camera 1 and the processing box 2 change processing based on this user feedback.

  FIG. 9 is a block diagram illustrating a detailed configuration example of the notification determination table update unit 64 of the processing box 2 of FIG.

  The user feedback (FB) determination unit 101 reads the state description data 91 (FIG. 8) stored in the state description data storage unit 63 and the user feedback corresponding thereto, and whether the user feedback is data indicating “OK”. Or the data indicating “NG”, and the determination result is supplied to the state description pattern comparison unit 102 together with the state description data 91.

  When the determination result indicating “NG (may not be detected as an event in the future)” is supplied from the user feedback determination unit 101, the state description pattern comparison unit 102 supplies the state description data 91 supplied together with the determination result. Are compared with the patterns in the temporary notification determination table stored in the temporary notification determination table storage unit 105. If there is a match between the state description data 91 and the temporary notification determination table as a result of the comparison, the state description pattern comparison unit 102 sends the state description data 91 and the matching pattern to the existing pattern update unit 104. If there is no match, the state description data 91 is supplied to the new pattern creation unit 103.

  The new pattern creation unit 103 temporarily sets the state number included in the state description data 91 supplied from the state description pattern comparison unit 102 and the corresponding duration as the minimum value and maximum value of the duration of the new notification determination table. The information is added to the notification determination table storage unit 105 and stored therein.

  The existing pattern update unit 104 supplies the duration included in the current state description data 91 supplied from the state description pattern comparison unit 102, and the minimum and maximum values of the duration corresponding to the pattern matching the state description data 91 Compare If the existing pattern update unit 104 determines that the duration of the current state description data 91 is shorter than the minimum value of the duration corresponding to the matching pattern as a result of the comparison, the minimum value of the duration of the matching pattern Is replaced (updated) with the duration of the current data, and if it is determined that the duration of the current state description data 91 is longer than the maximum duration corresponding to the matching pattern, the duration of the matching pattern Replace (update) the maximum value of with the duration of the current data. Then, the existing pattern update unit 104 causes the temporary notification determination table storage unit 105 to store the replaced data as an update notification determination table.

  The temporary notification determination table storage unit 105 is a temporary notification determination table added by the new pattern creation unit 103, and stores the notification determination table updated by the existing pattern update unit 104 as necessary.

  The table comparison unit 106 compares the temporary notification determination table stored in the temporary notification determination table storage unit 105 with the past notification determination table stored in the past notification determination table storage unit 107, and is the same. If it is determined, the provisional notification determination table stored in the provisional notification determination table storage unit 105 is supplied to the past notification determination table storage unit 107 and stored as an update notification determination table. On the other hand, when it is determined that the temporary notification determination table and the past knowledge determination table are not the same, the table comparison unit 106 transmits the temporary notification determination table stored in the temporary notification determination table storage unit 105. After transmitting to the multi-sensor camera 1 via the unit 65, the provisional notification determination table is supplied to the past notification determination table storage unit 107 and stored as an update notification determination table.

  The past notification determination table storage unit 107 stores the notification determination table updated by the table comparison unit 106 as a past notification determination table.

  FIG. 10 is a diagram illustrating an example of a notification determination table stored in the past notification determination table storage unit 107.

  As shown in the figure, the state number defined based on the reaction of the photosensors 22-1 to 22-3, and the minimum and maximum values of the reaction duration of the state number are included in one state description data. It is prescribed. The behavior of a person composed of the state description data 121-1 to 121-m is defined in one notification determination table. Then, the notification determination table group including the notification determination tables 111-1 to 111-n is stored in the past notification determination table storage unit 107.

  Hereinafter, when it is not necessary to individually distinguish the state description data 121-1 to 121-m, they are simply referred to as state description data 121, and when the notification determination tables 111-1 to 111-n need not be individually distinguished, This is simply referred to as notification determination table 111.

  Next, processing in the multi-sensor camera 1 will be described with reference to the flowchart of FIG. This process is started when the user gives an instruction to start monitoring in the monitoring area.

  In step S1, the sensor reaction detection unit 42 performs a photosensor reaction determination process. The details of the photosensor reaction determination process will be described later with reference to the flowchart of FIG. 13, and it is determined by this process whether or not the photosensors 22-1 to 22-3 are responding.

  In step S <b> 2, the sensor reaction detection unit 42 stores a reaction result (reaction flag and photosensor value described later) by the process in step S <b> 1. In step S3, the sensor reaction detection unit 42 determines whether or not the reaction determination process has been performed for all the photosensors 22-1 to 22-3, and determines that there is a photosensor that has not yet been processed. In this case, the process returns to step S1, and the above-described process is repeatedly executed.

  If it is determined in step S3 that the process has been executed for all the photosensors, the process proceeds to step S4, and the state determination unit 44 determines the person in the monitoring area based on the reaction result stored in the process of step S2. Describe state description data for a series of actions. That is, as shown in FIG. 8, the state determination unit 44 describes the state description data 91 including the state number and the reaction duration defined according to the reactions of the photosensors 22-1 to 22-3. Is output to the state output unit 48.

  In step S <b> 5, the state determination unit 44 compares the state description data 91 described in the process of step S <b> 4 with the notification determination table held in the processing parameter holding unit 46. Specifically, in the process of step S4, for example, as shown in FIG. 12, state description data 91-1 consisting of state number 1 and duration T1, and state description data consisting of state number 2 and duration T2 When 91-2 is described, the state determination unit 44 determines the state number included in the pattern in the order of state number 1 and state number 2, and the state description data 121 of the held notification determination table 111 (FIG. 10). If there is no match, it is determined that a notification event has occurred.

  On the other hand, when there is a notification determination table 111 that matches the pattern in the order of state number 1 and state number 2, the state determination unit 44, as shown in FIG. 12, the duration T1 of the state description data 91-1. Is within the range of the minimum duration Tmin1 and the maximum duration Tmax1 of the state description data 121-1 of the notification determination table 111, and the duration T2 of the state description data 91-2 is notified. It is determined whether or not the state description data 121-2 of the determination table 111 is within the range of the minimum duration value Tmin2 and the maximum duration value Tmax2, and if at least one of them is not within the range. It is determined that a notification event has occurred.

  Further, in the state determination unit 44, the duration T1 of the state description data 91-1 falls within the range of the minimum duration Tmin1 and the maximum duration Tmax1 of the state description data 121-1 of the notification determination table 111. If the duration T2 of the state description data 91-2 is within the range of the minimum duration Tmin2 and the maximum duration Tmax2 of the state description data 121-2 of the notification determination table 111, the non-notification event It is determined that has occurred (the event is not notified).

  In the initial state of the multi-sensor camera 1, the notification determination table 111 has not yet been transmitted from the processing box 2, and the processing parameter holding unit 46 does not hold this notification determination table. Is immediately determined as a notification event when a sensor reaction result is supplied from the sensor reaction detector 42.

  In step S <b> 6, the state output unit 48 transmits the state description data 91 supplied from the state determination unit 44 to the processing box 2 via the transmission unit 49. The processing box 2 receives this state description data 91 and stores it in the state description data storage unit 63 as a notification determination table (step S58 in FIG. 15 described later), and updates this notification determination table as necessary ( The updated notification determination table is transmitted (step S64 in FIG. 15 described later).

  In step S7, the state determination unit 44 determines whether or not the event is a notification event based on the comparison result obtained in the process of step S5. If it is determined that the event is a notification event, the process proceeds to step S8, and the CCD camera 21 The power supply control signal is supplied to turn on the power supply, the event is notified to the processing box 2 through the transmission unit 49, and the transmission control signal is supplied to the switch 47 to be turned on.

  As a result, transmission of notification image data (event image) from the CCD camera 21 to the processing box 2 is started. The processing box 2 receives the notification image data and causes the presenting unit 3 to present it (step S53 in FIG. 15 described later). That is, the power of the CCD camera 21 is turned on only when it is determined that it is a notification event, and when it is not a notification event, the power of the CCD camera 21 remains off. Can be suppressed.

  When it is determined in step S7 that the event is not a notification event, that is, a non-notification event, the process proceeds to step S9, where the state determination unit 44 supplies a power control signal to the CCD camera 21 to turn off the power and transmit A control signal is supplied to the switch 47 to turn it off. Thereby, transmission of the notification image data (event image) transmitted from the CCD camera 21 to the processing box 2 via the switch 47 and the transmission unit 49 in the process of step S8 is stopped.

  After the process of step S8 or step S9, in step S10, the receiving unit 50 determines whether or not the notification determination table is received from the processing box 2, and if it is determined that the notification determination table is received, the process proceeds to step S11. Then, the received notification determination table is supplied to the processing parameter holding unit 46 to be updated.

  If it is determined in step S10 that the notification determination table has not been received from the processing box 2, or after the process of step S11, the process returns to step S1, and the above-described process is repeatedly executed.

  Next, the details of the photosensor reaction process in step S1 of FIG. 11 will be described with reference to the flowchart of FIG.

  In step S <b> 21, the sensor reaction detection unit 42 acquires a photosensor value via the A / D conversion unit 41 from the photosensors 22-1 to 22-3 that are turned on. In step S22, the sensor reaction detection unit 42 performs steady state detection processing. The details of this steady state detection process will be described later with reference to the flowchart of FIG. 14. With this process, each of the photosensors 22-1 to 22-3 is in a steady state (a state where the sensor is not responding). A photosensor value is calculated.

  In step S23, the sensor reaction detector 42 determines whether or not the steady values of the photosensors 22-1 to 22-3 have been calculated, and the steady values of the photosensors 22-1 to 22-3 that have not been calculated. If it is determined that there is, the process returns to step S21 and the above-described process is repeatedly executed.

  If it is determined in step S23 that the steady values of the photosensors 22-1 to 22-3 have been calculated, the process proceeds to step S24, where the sensor reaction detection unit 42 calculates the current photosensor value and the process of step S22. The absolute value of the difference between the steady values is calculated. That is, as described above with reference to FIG. 6, the difference between the steady value L and the photosensor value (the detection signal 81-1 in the example of FIG. 6) is calculated.

  In step S25, the sensor reaction detection unit 42 determines whether or not the reaction flag is on. If it is determined that the reaction flag is on, the process proceeds to step S26, and further, the difference calculated in the process of step S24. It is determined whether or not the absolute value is equal to or less than a predetermined threshold (whether or not it falls within the steady range shown in FIG. 6).

  If it is determined in step S26 that the difference absolute value is equal to or smaller than the predetermined threshold value, the process proceeds to step S27, and the sensor reaction detection unit 42 turns off the reaction flag. On the other hand, if it is determined in step S26 that the absolute difference value is not less than or equal to the predetermined threshold value, that is, greater than the predetermined threshold value (exceeds the steady range shown in FIG. 6), the process of step S27 is skipped. (Ie, the reaction flag remains on).

  In step S25, when it is determined that the reaction flag is not on but off, the process proceeds to step S28, and the sensor reaction detection unit 42 determines whether or not the absolute difference value is equal to or greater than a predetermined threshold (steady state shown in FIG. 6). If it is determined whether or not the absolute value of the difference is greater than or equal to a predetermined threshold value, the process proceeds to step S29, and the reaction flag is turned on. On the other hand, if it is determined in step S28 that the absolute difference value is not greater than or equal to the predetermined threshold value, that is, smaller than the predetermined threshold value (is within the steady range shown in FIG. 6), the process of step S29 is skipped. (Ie, the reaction flag is left off).

  In step S30, the sensor reaction detection unit 42 outputs the photosensor values of the photosensors 22-1 to 22-3 acquired in the process of step S21 together with the reaction flag to the state determination unit 44 as a reaction result.

  Through the above processing, the reaction result output from the sensor reaction detector 42 is stored in step S2 of FIG. 11, and the photosensor value output from the sensor reaction detector 42 is described in the state description data in step S4. Used for processing.

  Next, the details of the steady state detection process in step S22 of FIG. 13 will be described with reference to the flowchart of FIG.

  In step S41, the sensor reaction detection unit 42 clears the steady state counter. In step S42, the sensor reaction detector 42 determines whether or not it is in a steady state based on the photosensor value acquired in the process of step S21 in FIG. That is, as shown in FIG. 6, it is determined that the state is a steady state when a state in which the output level of the detection signal 81-1 does not change (a state in which no person is present in the monitoring area) continues for a predetermined time or longer.

  If it is determined in step S42 that the current state is the steady state, the process proceeds to step S43, and the sensor reaction detection unit 42 increments the steady state counter by 1. In step S44, the current photosensor value is stored in the steady state calculation buffer. To store.

  In step S45, the sensor reaction detection unit 42 determines whether or not the steady state counter is larger than a predetermined threshold, that is, the number of photosensors necessary for the averaging process in the process of step S46 described later (for example, 10). It is determined whether or not the value is stored in the buffer, and when it is determined that the steady state counter is smaller than the predetermined threshold value, the process returns to step S42 and the above-described processing is repeatedly executed.

  If it is determined in step S45 that the steady state counter is larger than the predetermined threshold (if it is determined that the number of photosensor values necessary for averaging (for example, 10) is stored in the buffer), step In S46, the sensor reaction detection unit 42 reads out and averages a plurality of photosensor values stored in the steady state calculation buffer, and sets them as steady sensor values.

  In step S47, the sensor reaction detector 42 supplies the steady sensor value set in the process of step S46 to the steady sensor reaction holding unit 43 to hold it.

  Through the above process, the steady sensor values of the photosensors 22-1 to 22-3 calculated by the sensor reaction detection unit 42 are held in the steady sensor reaction holding unit 43. In step S24 of FIG. It is used for calculating the absolute value of the difference from the current photosensor value.

  Next, processing in the processing box 2 executed in correspondence with the processing of the multi-sensor camera 1 in FIG. 11 will be described with reference to the flowchart in FIG. This process is performed when the user instructs the presenting unit 3 to present an image corresponding to the general viewing signal (broadcast program signal), or when it is instructed to start monitoring in the monitoring area. To be started.

  In step S51, the notification determination table update unit 64 clears the state description data stored in the state description data storage unit 63 and the temporary notification determination table stored in the temporary notification determination table storage unit 105, and Turn off the user feedback reception flag. The receiving unit 61 turns off the event reception flag and the state description data reception flag.

  In step S52, the reception unit 61 determines whether or not the event reception flag is on (notification event reception is in progress), and if it is determined that the event reception flag is on (step of FIG. 11 described above). The notification image data and notification event transmitted from the multi-sensor camera 1 are supplied to the presentation image construction unit 62 (by the process of S8), and the process proceeds to step S53.

  In step S53, the presented image construction unit 62 receives notification data (image data for presenting in picture-in-picture) in which the notification image data supplied from the receiving unit 61 is inserted into a part of the general viewing signal. Build it and present it to the presentation unit 3. The presented image construction unit 62 constructs notification data for the remote controller 4 that does not include a general viewing signal (data configured by the notification image data), and transmits the notification data to the remote controller 4 via the transmission unit 66. The remote controller 4 receives the notification data and causes the presenting unit 72 to present it (step S92 in FIG. 17 described later).

  If it is determined in step S52 that the event reception flag is not on but off, the process proceeds to step S54, where the reception unit 61 determines whether a notification event has been received from the multi-sensor camera 1 and determines the notification event. When it determines with having received, it progresses to step S55 and turns on an event reception flag.

  After the process of step S53, after the process of step S55, or when it is determined in step S54 that the notification event has not been received, the process proceeds to step S56, where the receiving unit 51 receives the state description data from the multi-sensor camera 1. It is determined whether 91 (FIG. 8) has been received.

  When it is determined in step S56 that the state description data has been received, the process proceeds to step S57, where the receiving unit 61 turns on the state description data reception flag, and in step S58 (by the processing of step S6 in FIG. 11 described above). ) The state description data 91 transmitted from the multi-sensor camera 1 is received and stored in the state description data storage unit 63. However, at this time, if the user feedback reception flag is already on, the state description data 91 is stored in association with the user feedback.

  After the process of step S58 or when it is determined in step S56 that the state description data has not been received, the process proceeds to step S59, where the notification determination table update unit 64 receives from the remote controller 4 via the reception unit 67. It is determined whether or not the transmitted user FB signal has been received (by the process of step S94 in FIG. 17 described later). If it is determined that the user FB signal has been received, the process proceeds to step S60.

  In step S60, the notification determination table update unit 64 turns on the user feedback reception flag, and the reception unit 61 turns off the event reception flag. In step S61, if the state description data reception flag is on at this time, the notification determination table update unit 64 performs user feedback (“OK (would like to be notified in the future)” or “NG (does not notify in the future). Is also associated with the state description data 91 stored in the state description data storage unit 63, and is stored as new user feedback if the state description data reception flag is off. If the event reception flag is off, the user feedback is ignored.

  That is, by storing user feedback in association with the state description data 91 as a notification determination table, it is possible to detect and notify only an event intended by the user.

  In step S62, the notification determination table update unit 64 determines whether or not both the state description data reception flag and the user feedback reception flag are on, and if both the state description data reception flag and the user feedback reception flag are on. When it determines, it progresses to step S63 and a notification determination table update process is performed. Details of the notification determination table update processing will be described later with reference to the flowchart of FIG. 16, but the notification determination table stored in the past notification determination table storage unit 107 is updated by this processing.

  In step S64, when the notification determination table update unit 64 creates a notification determination table different from the past notification determination table by the processing in step S63 and stores it in the past notification determination table storage unit 107, the new notification is updated. The determination table is transmitted to the multi-sensor camera 1 via the transmission unit 65. The multi-sensor camera 1 receives this new notification determination table and updates the notification determination table storage unit 122 (step S11 in FIG. 11 described above).

  In step S65, the notification determination table update unit 64 turns off the state description data reception flag and the user feedback reception flag.

  After the process of step S65 or when it is determined in step S62 that at least one of the state description data reception flag and the user feedback reception flag is not on, the process returns to step S62 and the above-described process is repeated. Executed.

  Next, details of the notification determination table update processing in step S63 of FIG. 14 will be described with reference to the flowchart of FIG.

  In step S <b> 71, the state description pattern comparison unit 102 of the notification determination table update unit 64 clears the temporary notification determination table stored in the temporary notification determination table storage unit 105. In step S <b> 72, the user feedback determination unit 101 reads the state description data 91 stored in the state description data storage unit 63 and the user feedback corresponding thereto.

  In step S73, the user feedback determination unit 101 determines whether or not the user feedback read in the process of step S72 is data indicating “NG (it may not be detected as an event in the future)”. Is determined to be data indicating “NG”, the determination result is supplied to the state description pattern comparison unit 102 together with the state description data 91 (FIG. 8), and the process proceeds to step S74.

  In step S 74, the state description pattern comparison unit 102 stores the pattern of the state number (number defined in FIG. 7) included in the state description data 91 supplied from the user feedback determination unit 101 and the provisional notification determination table storage unit 105. The state number patterns included in the state description data 121 of the accumulated notification determination table 111 (FIG. 10) are compared.

  In step S75, the state description pattern comparison unit 102 determines whether there is a pattern matching as a result of the comparison in step S74, for example, in the order of state number 1, state number 2, and state number 4. If it is determined whether there is a match in the notification determination table 111, and it is determined that there is a match in the pattern, the state description data 91 and the pattern that matches the state description data 91 (that is, the notification determination table 111) are displayed. The process proceeds to step S76.

  In step S76, the existing pattern update unit 104 supplies the minimum duration of the duration included in the current state description data 91 supplied from the state description pattern comparison unit 102 and the pattern corresponding to the state description data 91. Compare the value and the maximum value.

  Then, when the existing pattern update unit 104 determines that the duration of the current state description data 91 is shorter than the minimum value of the duration corresponding to the matching pattern as a result of the comparison, the minimum duration of the matching pattern When the value is replaced (updated) with the duration of the current state description data 91, or when it is determined that the duration of the current state description data 91 is longer than the maximum value of the duration corresponding to the matching pattern, The maximum value of the duration of the matching pattern is replaced (updated) with the duration of the current state description data 91, and is stored in the temporary notification determination table storage unit 105 as an update notification determination table.

  If it is determined in step S75 that the patterns do not match as a result of the comparison in step S74, the state description data 91 is supplied to the new pattern creation unit 103, and the process proceeds to step S77.

  In step S77, the new pattern creation unit 103 uses the state number included in the state description data 91 supplied from the state description pattern comparison unit 102 and the corresponding duration as the minimum value of the duration of the new notification determination table and The maximum value is added to the temporary notification determination table storage unit 105 and stored therein.

  After the process of step S76 or after the process of step S77, in step S78, the user feedback determination unit 101 receives all the state description data 91 stored in the state description data storage unit 63 and the corresponding user feedback. It is determined whether or not data has been read. If it is determined that there is data that has not yet been read, the process returns to step S72 and the above-described processing is repeatedly executed.

  If it is determined in step S78 that all the state description data 91 and the corresponding user feedback have been read, the process proceeds to step S79, and the table comparison unit 106 stores the past information stored in the past notification determination table storage unit 107. The notification determination table is compared with the temporary notification determination table stored in the temporary notification determination table storage unit 105.

  In step S80, the table comparison unit 106 determines whether or not the past notification determination table and the provisional notification determination table are the same as a result of the comparison in step S79. Proceeding to S81, the provisional notification determination table stored in provisional notification determination table storage unit 105 is transmitted to transmission unit 65, and the process proceeds to step S82. Thereby, a temporary notification determination table is transmitted to the multi-sensor camera 1 in step S64 of FIG.

  If it is determined in step S80 that the past notification determination table is the same as the provisional notification determination table, or after the processing in step S81, the table comparison unit 106 in step S82 causes the temporary notification determination table storage unit 105 to The provisional notification determination table stored in the past notification is supplied to the past notification determination table storage unit 107 and updated as an update notification determination table.

  Through the above processing, the notification determination table 111 as shown in FIG. 10 is stored in the past notification determination table storage unit 107. In other words, the notification determination table 111 stores a pattern when it is not necessary to notify as an event.

  Next, processing in the remote controller 4 that is executed corresponding to the processing in the processing box 2 in FIG. 15 will be described with reference to the flowchart in FIG. This process is started when the process of step S64 in FIG. 15 is executed by the transmission unit 66 of the process box 2.

  In step S91, the receiving unit 71 determines whether or not a notification event has been received from the processing box 2, and waits until a notification event is received. If it is determined that a notification event has been received, the process proceeds to step S92, where the receiving unit 71 performs an event based on the notification data transmitted together with the notification event from the processing box 2 (by the process of step S53 in FIG. 15 described above). An image (notification image data) is presented to the presentation unit 72.

  The user looks at the event image presented in the presenting unit 72 and operates the input unit 73 to determine (for example, whether the presently presented event is an event that he / she wants to keep informed or will not inform in the future) Is it a good event?

  In step S93, the input unit 73 determines whether or not a judgment (user feedback) from the user with respect to the presented event has been input. If the input unit 73 determines that the user feedback has been input, the input unit 73 transmits the user FB signal to the transmission unit 74. To proceed to step S94.

  In step S94, the transmission unit 74 transmits the user FB signal supplied from the input unit 73 to the processing box 2. The processing box 2 receives this and associates it with the state description data 91 stored in the state description data storage unit 63 (step S61 in FIG. 15).

  After the process of step S94 or when it is determined in step S93 that no user feedback has been input, the process returns to step S91 and the above-described process is repeatedly executed.

  As described above, since the notification determination table used for determining event notification is changed (updated) based on the feedback from the user, only the event intended by the user can be detected, and the event Since the power of the CCD camera 21 is turned on only when notification is made, useless battery consumption can be suppressed.

  Further, in the above description, as shown in FIG. 7, the state description data 91 (FIG. 8) including the state number defined according to the reaction state of the photosensors 22-1 to 22-3 and the reaction duration is described. However, this is not limited to this, but it is not limited to this. For example, a response from one photosensor until the next photosensor starts a response or the response of a photosensor ends. It is also possible to describe the state description data 91 including the state number defined on the basis of the time from when the next photosensor response is completed and the duration of the reaction, and use the state description data 91 for event notification. It is.

  18 and 19 are diagrams illustrating an example in which the state number is defined based on the reaction between rising points among the reactions of the photosensors 22-1 to 22-3. Here, the interval between rising points means a section between a point at which a certain photosensor starts a reaction and a point at which the next photosensor starts a reaction.

  In FIG. 18, the person 131 is acting in the direction indicated by the arrow in the drawing (from the left to the right in the drawing) in the monitoring areas 31-1 to 31-3 of the photosensors 22-1 to 22-3. The situation is shown schematically. Each of the photo sensors 22-1 to 22-3 always outputs the average luminance in the monitoring areas 31-1 to 31-3 as a detection signal, and the person 131 acts as shown in FIG. Correspondingly, the output level of the detection signal changes (FIG. 5).

  In the case of the example in FIG. 18, first, the output level of the detection signal output from the photosensor 22-3 changes due to the action of the person 131, and then the output level of the detection signal output from the photosensor 22-2 changes. After that, the output level of the detection signal output from the photosensor 22-1 changes. Here, the state number between the rising point P1 at which the photosensor 22-3 starts the reaction and the rising point P2 at which the photosensor 22-2, which is the next (adjacent monitoring area) photosensor, starts the reaction is set. “T0” is set, and the state number between the rising point P2 at which the photosensor 22-2 starts the reaction and the rising point P3 at which the next photosensor 22-1 starts the reaction is set to “T1”. .

  In FIG. 19, the person 131 is acting in the direction indicated by the arrow in the drawing (from the right to the left in the drawing) in the monitoring areas 31-1 to 31-3 of the photosensors 22-1 to 22-3. The situation is shown schematically. As described above, the photosensors 22-1 to 22-3 always output the average luminance in the monitoring areas 31-1 to 31-3 as a detection signal, as shown in FIG. 19. When 131 acts, the output level of the detection signal changes correspondingly (FIG. 5).

  In the case of the example in FIG. 19, first, the output level of the detection signal output from the photosensor 22-1 changes due to the action of the person 131, and then the output level of the detection signal output from the photosensor 22-2 changes. After that, the output level of the detection signal output from the photosensor 22-3 changes. Here, the state number between the rising point P11 at which the photosensor 22-1 starts the reaction and the rising point P12 at which the next photosensor 22-2 starts the reaction is “T3”, and the photosensor The state number between the rising point P12 where 22-2 starts the reaction and the rising point P13 where the photosensor 22-3 which is the next photosensor starts the reaction is “T2”.

  The state value holding unit 45 holds the state number defined as described above as a state value. Based on the sensor reaction result supplied from the sensor reaction detector 42 and the state value held in the state value holding unit 45, the state determination unit 44, for example, state description data 91 as shown in FIG. -1, 91-2 are described.

  Specifically, according to the action of the person 131 shown in FIG. 18, as shown in FIG. 20, the state description data 91-1 including the state number “T0” and its reaction duration is described. State description data 91-2 including the state number of T1 ″ and its reaction duration is described. Further, according to the action of the person 131 shown in FIG. 19, as shown in FIG. 21, the state description data 91-1 including the state number of “T3” and its reaction duration is described, and “T2” State description data 91-2 including the state number and its reaction duration is described.

  Then, the state determination unit 44 outputs the state description data 91-1 and 91-2 continuously arranged in the time axis direction to the state output unit 48.

  As described above, by describing the state description data 91 including the state number and the reaction duration in accordance with the reaction between the rising points among the reactions of the photosensors 22-1 to 22-3, A person's behavior can be roughly estimated.

  In the state number defined in FIG. 7, the horizontal direction and the depth direction can be detected, whereas in the state number defined in FIGS. 18 and 19, only the horizontal direction is detected ( That is, detection in the depth direction is omitted), and the processing capability can be improved.

  Further, among the reactions of the photosensors 22-1 to 22-3, not only the state number is defined based on the reaction between the rising points, but also based on both the reaction between the rising points and the reaction between the falling points. The state number can also be defined.

  FIG. 22 is a diagram illustrating an example in which the state number is defined based on both the reaction between rising points and the reaction between falling points among the reactions of the photosensors 22-1 to 22-3. FIG. 22 shows the directions of the persons 131-1 to 131-3 indicated by arrows in the monitoring areas 31-1 to 31-3 of the photosensors 22-1 to 22-3 (the photosensor 22- 1 to 22-3 schematically showing a behavior from left to right, right to left, or from left to right at positions close to the photo sensors 22-1 to 22-3). ing. Here, the interval between the falling points means a section between a point at which the reaction of a certain photo sensor is finished and a point at which the reaction of the next photo sensor is finished.

  As described above, the photosensors 22-1 to 22-3 always output the average luminance in the monitoring areas 31-1 to 31-3 as a detection signal, as shown in FIG. When 131-1 thru | or 131-3 act each, the output level of a detection signal changes corresponding to them (FIG. 5).

  In the case of the example of FIG. 22, the photo sensor 22-3 reacts at the position farthest from the photo sensors 22-1 to 22-3 according to the action of the person 131-1 moving from left to right in the figure. The state number between the rising point P21 at which the photosensor 22-2 is started and the rising point P22 at which the next photosensor 22-2 starts the reaction is "T0", and the rising point at which the photosensor 22-2 starts the reaction From P22, the state number between the rising point P23 at which the photosensor 22-1 as the next photosensor starts reaction is set to “T1”, and from the falling point P24 at which the reaction of the photosensor 22-3 ends, The state number between the falling points P25 where the reaction of the photosensor 22-2 ends is “T2”, and from the falling point P25 where the reaction of the photosensor 22-2 ends, Reaction of the photo sensor 22-1 and the state number "T3" between the falling point P26 to the end of.

  Further, the photosensor 22-1 starts a reaction in response to the action of the person 131-2 moving from the right to the left in the figure at a position closer to the photosensors 22-1 to 22-3 than the person 131-1. The state number between the rising point P26 where the photosensor 22-2, which is the next photosensor, and the rising point P25 where the reaction starts is “T3”, and from the rising point P25 where the photosensor 22-2 starts the reaction. The state number between the rising points P24 at which the photosensor 22-3 as the next photosensor starts the reaction is set to “T2”, and from the falling point P23 at which the reaction of the photosensor 22-1 ends, the next photo The state number between the falling points P22 at which the reaction of the sensor 22-2 ends is “T1”, and from the falling point P22 at which the reaction of the photosensor 22-2 ends, the next The reaction of the photo sensor 22-3 and the state number "T0" between the falling point P21 to end.

  Furthermore, the rising point P21 at which the photosensor 22-3 starts reacting at the position closest to the photosensors 22-1 to 22-3 in accordance with the action of the person 131-3 moving from left to right in the drawing. From the falling point P23 at which the reaction of the photosensor 22-2 ends, the state number between the rising points P22 at which the photosensor 22-2 as the next photosensor starts the reaction is set to “T0”. The state number between the falling points P25 at which the reaction of the photosensor 22-2 as the photosensor ends is “T2”, and from the rising point P22 at which the photosensor 22-2 starts the reaction, the next photosensor 22- The state number between the rising points P23 at which 2 starts reaction is set to “T1”, and the next photo from the falling point P25 at which the photosensor 22-2 completes the reaction. Reaction of the capacitors 22-1 and the state number "T3" between the falling point P26 to the end.

  The state value holding unit 45 holds the state number defined as described above as a state value. Based on the sensor reaction result supplied from the sensor reaction detection unit 42 and the state value held in the state value holding unit 45, the state determination unit 44, for example, state description data 91-1, 91-2 is described.

  Specifically, according to the action of the person 131-1 shown in FIG. 22, as shown in FIG. 23A, state description data 91-1 including the state number “T0” and its reaction duration is described. , State description data 91-2 including the state number of "T1" and its reaction duration is described, state description data 91-3 including the state number of "T2" and its reaction duration, and "T3" State description data 91-4 including the state number and the reaction duration is described.

  Further, according to the action of the person 131-2 shown in FIG. 22, as shown in FIG. 23B, state description data 91-1 including the state number of “T3” and its reaction duration is described, and “T2”. State description data 91-2 including the state number and its reaction duration is described, state description data 91-3 including the state number of "T1" and its reaction duration is described, and the state number of "T0" and State description data 91-4 including the reaction duration is described.

  Further, according to the action of the person 131-3 shown in FIG. 22, as shown in FIG. 23C, state description data 91-1 including the state number of “T0” and its reaction duration is described, and “T2”. State description data 91-2 including the state number and its reaction duration is described, state description data 91-3 including the state number of "T1" and its reaction duration is described, and the state number of "T3" and State description data 91-4 including the reaction duration is described.

  Then, the state determination unit 44 outputs the state description data 91-1 and 91-2 continuously arranged in the time axis direction to the state output unit 48.

  Here, although the person 131-1 and the person 131-3 are acting in the same direction, the state transitions of the state numbers described in the state description data 91 are different. That is, the state description data 91-2 in FIG. 23A describes the state number “T1”, whereas the state description data 91-2 in FIG. 23C describes the state number “T2”. ing. In addition, the state description data 91-3 in FIG. 23A describes the state number “T2”, whereas the state description data 91-2 in FIG. 23C describes the state number “T1”. ing.

  Therefore, among the reactions of the photosensors 22-1 to 22-3, the state number is defined based on both the reaction between the rising points and the reaction between the falling points, and the state description data 91 is described. 24 and 25, the state description data 91 is described by classifying the reaction between rising points and the reaction between falling points.

  FIG. 24 is a diagram illustrating an example when state description data described based on the reaction between rising points of the photosensors 22-1 to 22-3 is extracted from the state description data illustrated in FIG.

  FIG. 24A shows the state description data 91-1 to 91-4 shown in FIG. 23A from which state description data that is a reaction between rising points of the photosensors 22-1 to 22-3 is extracted. Yes. That is, the state description data 91-1 describes the state number of “T0” and its reaction duration as a reaction between the rising points of the photosensor 22-3 and the photosensor 22-2. 2 describes a state number of “T1” and a reaction duration time as a reaction between the rising points of the photosensor 22-2 and the photosensor 22-1.

  FIG. 24B shows the state description data 91-1 to 91-4 shown in FIG. 23B from which state description data that is a reaction between the rising points of the photosensors 22-1 to 22-3 is extracted. Yes. That is, the state description data 91-1 describes the state number of “T3” and its reaction duration as a reaction between the rising points of the photosensor 22-1 and the photosensor 22-2. 2 describes a state number of “T2” and its reaction duration as a reaction between the rising points of the photosensor 22-2 and the photosensor 22-3.

  FIG. 24C shows the state description data 91-1 to 91-4 shown in FIG. 23C from which state description data that is a reaction between rising points of the photosensors 22-1 to 22-3 is extracted. Yes. That is, the state description data 91-1 describes the state number of “T0” and its reaction duration as a reaction between the rising points of the photosensor 22-3 and the photosensor 22-2. 2 describes a state number of “T1” and a reaction duration time as a reaction between the rising points of the photosensor 22-2 and the photosensor 22-1.

  FIG. 25 is a diagram illustrating an example of the case where state description data described based on a reaction between falling points of the photosensors 22-1 to 22-3 is extracted from the state description data illustrated in FIG. .

  FIG. 25A shows the state description data 91-1 to 91-4 shown in FIG. 23A from which state description data that is a reaction between the falling points of the photosensors 22-1 to 22-3 is extracted. ing. That is, the state description data 91-1 describes the state number of T2 ″ and its reaction duration as a reaction between the falling points of the photosensor 22-3 and the photosensor 22-2. 2 describes the state number of “T3” and its reaction duration as a reaction between the falling points of the photosensor 22-2 and the photosensor 22-1.

  FIG. 25B shows the state description data 91-1 to 91-4 shown in FIG. 23B from which state description data that is a reaction between the falling points of the photosensors 22-1 to 22-3 is extracted. ing. That is, the state description data 91-1 describes the state number of “T1” and its reaction duration as a reaction between the falling points of the photosensor 22-1 and the photosensor 22-2. -2 describes the state number of “T0” and its reaction duration as a reaction between the falling points of the photosensor 22-2 and the photosensor 22-3.

  FIG. 25C shows the state description data 91-1 to 91-4 shown in FIG. 23C from which state description data that is a reaction between the falling points of the photosensors 22-1 to 22-3 is extracted. ing. That is, the state description data 91-1 describes the state number of “T2” and its reaction duration as a reaction between the falling points of the photosensor 22-3 and the photosensor 22-2. -2 describes the state number of “T3” and its reaction duration as a reaction between the falling points of the photosensor 22-2 and the photosensor 22-1.

  As described above, among the reactions of the photosensors 22-1 to 22-3, the state number is defined based on both the reaction between the rising points and the reaction between the falling points, and the state description data 91 is described. 24 and FIG. 25, the person 131-1 and the person 131-3 (by comparing the state transitions by classifying the reaction between the rising points and the reaction between the falling points, respectively, as shown in FIGS. In the case where FIG. 22) acts, even if the position in the depth direction is different, the same state description data 91 can be obtained.

  Furthermore, as shown in FIG. 24A and FIG. 24C, or as shown in FIG. 25A and FIG. 25C, in the same state description data 91, the respective reaction continuation times are compared. If it is determined that they are close, it can be estimated that a similar action has been taken.

  Next, among the reactions of the photosensors 22-1 to 22-3, the state number is defined based on both the reaction between the rising points and the reaction between the falling points, and the state description data 91 is described. The processing in the multi-sensor camera 1 used will be described with reference to the flowchart of FIG. This process is basically the same as the process described above with reference to the flowchart of FIG. 11, and only different process steps will be described here.

  Steps S101 to S103 are the same as the processes of steps S1 to S3 in FIG. If it is determined in step S103 that the process has been executed for all the photosensors, the process proceeds to step S104, and the state determination unit 44 performs a state determination process. The details of this state determination processing will be described later with reference to the flowchart of FIG. 27, but this processing causes the photosensors 22-1 to 22-3 to respond to a rising point or a falling point. Is determined.

  In step S105, the state determination unit 44 determines whether or not all data has been read. If it is determined that there is data that has not been read yet, the state determination unit 44 returns to step S104 and repeatedly executes the above-described processing. If it is determined in step S105 that all data has been read, the process proceeds to step S106, and the state determination unit 44 describes the state description data. That is, as shown in FIG. 24 and FIG. 25, the state determination unit 44 classifies the reactions of the photo sensors 22-1 to 22-3 into reactions between rising points and reactions between falling points. State description data 91 each including a state number and a reaction continuation time is described and output to state output unit 48.

  The processing in steps S107 to S113 is the same as the processing in steps S5 to S11 in FIG.

  Next, the details of the state determination process in step S104 of FIG. 26 will be described with reference to the flowchart of FIG.

  In step S121, the state determination unit 44 clears the end evaluation counter. In step S122, the state determination unit 44 reads the previously reacted data (photosensor value) from the processing parameter holding unit 46, and in step S123, reads the currently reacted data from the sensor reaction detection unit 42.

  In step S124, the state determination unit 44 compares the previously reacted data read in step S122 with the currently reacted data read in step S123, and determines whether or not the reaction state of the photosensor 22 has changed. If it is determined that the reaction state of the photosensor 22 has changed, the process proceeds to step S125.

  In step S125, the state determination unit 44 determines whether or not the change in the reaction state of the photosensor 22 is a rising point. If the state determination unit 44 determines that the change is a rising point, the process proceeds to step S126, and the state HX (for example, , The rising point P21) shown in FIG. 22 is output.

  If it is determined in step S125 that the change in the reaction state of the photosensor 22 is not a rising point but a falling point, the process proceeds to step S127, and the state determination unit 44 determines that the state LX (for example, FIG. The indicated falling point P24) is output.

  After step S126 or after step S127, in step S128, state determination unit 44 causes process parameter holding unit 46 to store data (photosensor value) that has reacted this time.

  If it is determined in step S124 that the photosensor response has not changed, the process proceeds to step S129, where the state determination unit 44 determines whether the photosensor is unresponsive, and the photosensor is unresponsive. If it is determined that there is, the process proceeds to step S130, and the end evaluation counter is incremented by one.

  In step S131, the state determination unit 44 determines whether or not the end evaluation counter is larger than a predetermined threshold value. If it is determined that the end evaluation counter is larger than the predetermined threshold value, the process proceeds to step S132, where the state is “0”. Print the number.

  If it is determined in step S129 that the sensor is not responding, the processes in steps S130 to S132 are skipped. If it is determined in step S131 that the end evaluation counter is not greater than the predetermined threshold, the process in step S132 is performed. Processing is skipped.

  Through the above processing, the state HX (rising point) or the state LX (falling point) is output. Based on the state, the state description data 91 including the state number is described in step S106 of FIG. For example, when the rising point P21 and the rising point P22 are output as the state HX, the state description data 91 including the state number “T0” is described in the example of FIG. Further, for example, when the falling point P24 and the falling point P25 are output as the state LX, the state description data 91 including the state number “T2” is described in the example of FIG.

  Note that the processing in the processing box 2 executed corresponding to the processing of the multi-sensor camera 1 in FIG. 27 is basically the same as the processing described with reference to the flowchart in FIG. Since the processing is basically the same as the processing described with reference to FIG. 17, the description thereof is omitted.

  As described above, among the reactions of the photosensors 22-1 to 22-3, the state description including the state number defined based on both the reaction between the rising points and the reaction between the falling points and the reaction duration time thereof. Data 91 can be described and used for event notification.

  Next, an example in which the algorithm of the event detection method shown in FIG. 7 (hereinafter referred to as method 1) and the event detection method algorithm shown in FIG. 22 (hereinafter referred to as method 2) are automatically switched will be described. To do. Here, as an example of a person's action, for example, as shown in FIG. 28, a person 131-1 moves in the monitoring areas 31-1 to 31-3 of the photosensors 22-1 to 22-3, and an arrow in the figure. (In the figure, from the left to the right at a position away from the photosensors 22-1 to 22-3) (movement 1), the person 131-2 moves to the photosensors 22-1 to 22-3. In the monitoring areas 31-1 to 31-3, the action (movement 2) in the direction indicated by the arrow in the figure (in the figure, from the left to the right at positions close to the photosensors 22-1 to 22-3) Think.

  As shown in FIG. 29, in method 1, when person 131-1 acts in the direction indicated by the arrow in the figure (in the case of movement 1), “4”, “6”, “7”, “3” When the state description data 91 is described in the order of the state number “1” and the person 131-2 acts in the direction indicated by the arrow in the drawing (in the case of movement 2), “4”, “0”, “2” State description data 91 is described in the order of the state numbers of "", "0", and "1".

  On the other hand, in the method 2, when the person 131-1 moves in the direction indicated by the arrow in the figure, the state description data 91 is described in the order of the state numbers "T0" and "T1", and the person 131-2 When acting in the direction indicated by the arrow in the figure, state description data 91 is described in the order of the state numbers “T0” and “T1”.

  The notification image data transmitted from the CCD camera 21 together with the output of the state description data 91 is presented to the presentation unit 3 via the presentation image construction unit 62 of the processing box 2. The user makes a determination on the event image presented on the presentation unit 3 and inputs user feedback using the input unit 73 of the remote controller 4.

  For example, as shown in FIG. 30, there are four patterns of user feedback for the action (movement 1) of the person 131-1 and the action (movement 2) of the person 131-2. That is, in the user evaluation 1, both the action of the person 131-1 and the action of the person 131-2 indicate “OK” (indicated by a symbol “◯” in the figure). I want to be notified as). In the user evaluation 2, user feedback indicating “OK” is input to the action of the person 131-1, and “NG” is indicated to the action of the person 131-2 (the symbol “x” in the figure). User feedback (indicated as an event in the future) is input. In the user evaluation 3, user feedback indicating “NG” is input to the action of the person 131-1 and user feedback indicating “OK” is input to the action of the person 131-2. In user evaluation 4, user feedback indicating “NG” is input to both the action of the person 131-1 and the action of the person 131-2.

  When the action (movement 1) of the person 131-1 and the feedback (user evaluation) with respect to the action (movement 2) of the person 131-2 are the same, the method 2 is used, and when the feedback is different, the method 1 is used. It is done. In this manner, an appropriate algorithm can be automatically switched based on the state description data 91 described according to past movements and user feedback.

  As described above, since the notification determination table used for determining event notification is changed (updated) based on feedback from the user, only events intended by the user can be detected with a simple configuration and with certainty. Since the power of the CCD camera 21 is turned on only when an event is notified, wasteful battery consumption can be suppressed.

  Moreover, although the example in the case of using the photosensors 22-1 to 22-3 has been described, the present invention is not limited thereto, and for example, it is possible to use an infrared sensor, a microwave sensor, or other sensors. .

  Furthermore, in the above, the multi-sensor camera 1 and the presenting unit 3 are not provided as a single unit, but a plurality of units may be provided, or the processing box 2 may not be provided as a separate casing from the presenting unit 3 and may be integrated. Instead of providing the presenting unit 72 in the remote controller 4, only the presenting unit 3 can be presented, or an input unit for inputting user feedback to the processing box 2 can be provided.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  FIG. 31 is a diagram illustrating an internal configuration example of a general-purpose personal computer 200. A CPU (Central Processing Unit) 201 executes various processes according to a program stored in a ROM (Read Only Memory) 202 or a program loaded from a storage unit 208 to a RAM (Random Access Memory) 203. The RAM 203 also appropriately stores data necessary for the CPU 201 to execute various processes.

  The CPU 201, the ROM 202, and the RAM 203 are connected to each other via the bus 204. An input / output interface 205 is also connected to the bus 204.

  The input / output interface 205 includes an input unit 206 configured with buttons, switches, a keyboard, or a mouse, an output unit 207 configured with a display such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display), and a speaker. Further, a storage unit 208 configured with a hard disk or the like and a communication unit 209 configured with a modem or a terminal adapter are connected. The communication unit 209 performs communication processing via a network including the Internet.

  A drive 210 is also connected to the input / output interface 205 as necessary, and a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted, and a computer program read therefrom is read. Are installed in the storage unit 208.

  As shown in FIG. 31, a recording medium that records a program that is installed in a computer and can be executed by the computer is distributed to provide a program to a user separately from the apparatus main body. Recording magnetic disk (including flexible disk), optical disk (including CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc)), magneto-optical disk (MD (Mini-Disc) (registered trademark) ), Or included in the ROM 203 or the storage unit 208 in which a program is provided, which is provided to the user in a state of being incorporated in advance in the apparatus main body. Hard disk.

  In the present specification, the step of describing the program stored in the program storage medium is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series. Or the process performed separately is also included.

  Further, in this specification, the system represents the entire apparatus composed of a plurality of apparatuses.

It is a figure which shows the structural example of the monitoring system to which this invention is applied. It is a figure which shows the structural example of the external appearance of a multi sensor camera. It is a figure which shows the monitoring area | region of a photosensor. It is a block diagram which shows the functional structural example of the monitoring system of FIG. It is a figure which shows the relationship between the change of the output level of the detection signal which a photosensor outputs, and a human action. It is a figure explaining the start and completion | finish of a sensor reaction of a photo sensor. It is a figure which shows the example which prescribes | regulates a state number based on reaction of a photosensor. It is a figure which shows the example of the state description data described according to a person's action. FIG. 5 is a block diagram illustrating a detailed configuration example of a notification determination table update unit in FIG. 4. It is a figure which shows the example of a notification determination table. It is a flowchart explaining the process in a multi sensor camera. It is a figure explaining the process of step S5 of FIG. It is a flowchart explaining the detail of the photosensor reaction process in step S1 of FIG. It is a flowchart explaining the detail of the steady state detection process in step S22 of FIG. It is a flowchart explaining the process in a process box. It is a flowchart explaining the detail of the notification determination table update process in FIG.15 S63. It is a flowchart explaining the process in a remote controller. It is a figure explaining the example which prescribes | regulates a state number based on the reaction between rising points among the reactions of a photosensor. It is a figure explaining the other example which prescribes | regulates a state number based on the reaction between rising points among the reactions of a photosensor. It is a figure which shows the example of the state description data described according to the person's action shown in FIG. It is a figure which shows the example of the state description data described according to the action of the person shown in FIG. It is a figure explaining the example which prescribes | regulates a state number based on both the reaction between rising points among the reaction of a photosensor, and the reaction between falling points. It is a figure which shows the example of the state description data described according to the person's action shown in FIG. It is a figure which shows the example at the time of extracting the state description data described based on the reaction between the rising points of a photosensor in the state description data shown in FIG. It is a figure which shows the example at the time of extracting the state description data described based on the reaction between the falling points of a photosensor in the state description data shown in FIG. It is a flowchart explaining the other process in a multi sensor camera. It is a flowchart explaining the detail of the state determination process in step S104 of FIG. A person's action in a surveillance field is typically shown. It is a figure explaining the state description data described according to the action of the person shown in FIG. It is a figure explaining the user feedback with respect to the action of the person shown in FIG. It is a block diagram which shows the structural example of a general purpose personal computer.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Multi-sensor camera, 2 Processing box, 3 Presentation part, 4 Remote controller, 10 Surveillance system, 22-1 thru | or 22-3 Photo sensor, 42 Sensor reaction detection part, 44 State determination part, 62 Presentation image construction part, 63 State Description data storage unit, 64 Notification determination table update unit, 72 Presentation unit, 73 Input unit, 101 User feedback determination unit, 102 State description pattern comparison unit, 103 New pattern creation unit, 104 Existing pattern update unit, 105 Temporary notification determination table Storage unit, 106 table comparison unit, 107 past notification determination table storage unit

Claims (13)

Obtaining means for obtaining sensor data from a plurality of sensors arranged in a predetermined direction ;
Photographing means for photographing a notification image of an area monitored by the plurality of sensors;
Detection of detecting the state of the sensor by comparing the sensor data acquired by the acquisition unit with data at a steady state and detecting a point at which the sensor starts to react or a point at which the reaction of the sensor ends. Means,
The point detected by the detecting means, the point at which the sensor started to react, the state number defined based on the point at which the next sensor adjacent to the sensor started to react, or the point at which the reaction of the sensor ended State data description means for describing state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has ended ,
A determination unit that compares the state data described by the state data description unit with a determination table and determines whether to notify an event;
When it is determined to notify the event, a shooting control unit that turns on the imaging unit and captures the notification image;
If it is determined by the determination means that the event is notified, a construction means for constructing presentation data including the notification image for notifying the event;
And a presenting means for presenting based on the presenting data constructed by the constructing means. Based on the presentation by the presenting means, an input obtaining means for obtaining a judgment input from the user;
And a creation means for creating the determination table based on the input of the judgment obtained by the user obtained by the input obtaining means and the state data described by the state data description means. The monitoring system according to claim 1. The monitoring system according to claim 1, wherein the plurality of sensors are photosensors. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step for comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
When it is determined to notify the event by the process of the determination step, a construction step of constructing presentation data including the notification image for notifying the event;
A presenting step for presenting based on the presenting data constructed by the processing of the constructing step. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step for comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
When it is determined to notify the event by the process of the determination step, a construction step of constructing presentation data including the notification image for notifying the event;
And a presenting step for presenting based on the presenting data constructed by the processing of the constructing step. A recording medium on which a computer-readable program is recorded. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step for comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
When it is determined to notify the event by the process of the determination step, a construction step of constructing presentation data including the notification image for notifying the event;
A program that causes a computer to execute a presentation step of presenting based on the presentation data constructed by the processing of the construction step. Obtaining means for obtaining sensor data from a plurality of sensors arranged in a predetermined direction ;
Photographing means for photographing a notification image of an area monitored by the plurality of sensors;
Detection of detecting the state of the sensor by comparing the sensor data acquired by the acquisition unit with data at a steady state and detecting a point at which the sensor starts to react or a point at which the reaction of the sensor ends. Means,
The point detected by the detecting means, the point at which the sensor started to react, the state number defined based on the point at which the next sensor adjacent to the sensor started to react, or the point at which the reaction of the sensor ended State data description means for describing state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has ended ,
A determination unit that compares the state data described by the state data description unit with a determination table and determines whether to notify an event;
When it is determined to notify the event, a shooting control unit that turns on the imaging unit and captures the notification image;
An information processing apparatus comprising: a transmission unit configured to transmit the event and the notification image for notifying the event to another device when the determination unit determines to notify the event. The information processing apparatus according to claim 7 , further comprising a determination table holding unit that acquires and holds the determination table supplied from the other apparatus. The information processing apparatus according to claim 7 , wherein the transmission unit transmits the state data described by the state data description unit to the other device. The information processing apparatus according to claim 7 , wherein the plurality of sensors are photosensors. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step of comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
An information processing method including: a transmission step of transmitting the event and the notification image for notifying the event to another device when it is determined to notify the event by the process of the determination step; Method. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step of comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
A computer comprising: a transmission step of transmitting the event and the notification image for notifying the event to another device when it is determined to notify the event by the process of the determination step. A recording medium on which a readable program is recorded. An acquisition step of acquiring sensor data from a plurality of sensors arranged in a predetermined direction ;
The sensor data obtained by the processing of the obtaining step is compared with the data at normal time, and the state of the sensor is detected by detecting the point at which the sensor has started to react or the point at which the sensor has reacted. Detecting step to
The state number defined based on the point at which the sensor has started to react and the point at which the next sensor adjacent to the sensor has started to react detected by the processing of the detecting step , or the reaction of the sensor has ended. A state data description step that describes state data relating to the state of the sensor, including a state number defined based on the point at which the reaction of the next sensor adjacent to the sensor has been completed ,
A determination step of comparing the state data described by the processing of the state data description step with a determination table and determining whether to notify an event;
When it is determined to notify the event, a photographing control step of turning on the photographing unit and causing the photographing unit to photograph a notification image of an area monitored by the plurality of sensors;
When it is determined that the event is notified by the processing of the determination step, the computer and the transmission step of transmitting the event and the notification image for notifying the event to another device are executed. Program to do.

Images