JP2005039548A - Monitoring system and method, information processing apparatus, recording medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress power consumption by sensing only the event required by a user. <P>SOLUTION: A human body sensing/judging section 13 judges that it senses a human body when sensor data are supplied from an infrared sensor 12, and turns on the power supply of a CCD camera 11. A feature amount calculator 14 calculates a feature amount from the image data supplied from the CCD camera 11 in connection with power on. An event notification judging section 15 calculates a distance between the calculated feature amount data and past feature amount data in a feature amount space, if judging that an event has occurred on the basis of the calculated result, notifies the processing box 2 of the event via a transmitter 17, and allows the processing box 2 to transmit the notification image data outputted from the CCD camera 11. A presentation image constructing section 22 constructs notification data in which notification data received by a receiver 21 into a general view signal, and allows a presenting section 3 to present the constructed data. This system is applicable to a home-use monitoring system. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a monitoring system and method, an information processing apparatus and method, a recording medium, and a program, and in particular, a monitoring system capable of reliably detecting and notifying a necessary event and suppressing power consumption of a camera or the like. The present invention relates to a system and method, an information processing apparatus and method, a recording medium, and a program.

  Conventionally, as a home security system, a method of knowing sensor information by viewing a monitor TV (Television) that displays a monitoring image transmitted from an imaging device has been proposed (see, for example, Patent Document 1).

  In addition, a method has been proposed in which a monitoring device in which an infrared sensor and an image sensor are combined detects a human body that has entered a monitoring area by determining the presence or absence of a human body and the presence or absence of a plan (for example, Patent Document 2). reference).

  Furthermore, a technique has been proposed in which a surveillance camera system having a plurality of intelligent cameras detects an abnormality in a surveillance area and records or reproduces the detected video and audio (for example, see Patent Document 3).

In the inventions described in these Patent Documents 1 to 3, a specific place or a specific abnormality (event) is mainly detected.
Japanese Patent Laid-Open No. 8-124078 JP 2000-339554 A JP-A-7-2127748

  However, in the inventions described in these Patent Documents 1 to 3, not only the adjustment when installing the sensor (imaging device, monitoring device, or a plurality of intelligent cameras) is troublesome, but it is also necessary to install it once. As a result, there is a problem that it is difficult to move to another location.

  Moreover, since the wireless camera used conventionally always transmits an image, an audio | voice, etc., there existed a subject that it was difficult to apply to the system using a battery.

  The present invention has been made in view of such a situation, and is capable of reliably detecting and notifying a necessary event and suppressing power consumption of a camera or the like.

  The monitoring system according to the present invention includes a detection unit that detects a response of a sensor, a first calculation unit that calculates a feature amount of an object based on detection by the detection unit, and a feature amount calculated by the first calculation unit. And a second calculation unit that calculates a distance in the feature amount space with the feature amount calculated in the past, and event data for notifying the event according to the distance calculated by the second calculation unit. Construction means for constructing including presentation data, presentation means for presenting based on the presentation data constructed by the construction means, acquisition means for obtaining a judgment input from the user based on the presentation by the presentation means, and acquisition means And storing means for storing the judgment input from the user acquired in accordance with the feature amount calculated by the first calculating means.

  Based on the distance calculated by the second calculating means, a determining means for determining whether or not to notify the event is further provided, and when the determining means determines that the event is notified by the determining means, the presentation data is displayed. Can be built.

  The second calculation unit is a feature amount space between the feature amount calculated by the first calculation unit and a past feature amount stored in the storage unit and associated with a judgment input from the user. The distance can be calculated.

  The sensor may be an infrared sensor, a camera, or a microphone.

  The construction means can construct presentation data by inserting event data into a signal based on television broadcasting.

  The construction means can make data based on a predetermined signal as the presentation data when the judgment means judges that the event is not notified.

  The monitoring method of the present invention is calculated by a detection step of detecting a sensor reaction, a first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step, and processing of the first calculation step. A second calculation step of calculating a distance in the feature amount space between the calculated feature amount and a feature amount calculated in the past, and an event is notified according to the distance calculated by the processing of the second calculation step A construction step for constructing presentation data including event data to perform, a presentation step for performing presentation based on the presentation data constructed by the processing of the construction step, and a judgment from the user based on the presentation by the processing of the presentation step An acquisition step for acquiring an input and a determination input from the user acquired by the process of the acquisition step are calculated by the process of the first calculation step. Characterized in that it comprises a storage step of storing in association with the feature value.

  The program recorded in the first recording medium of the present invention includes a detection step for detecting a sensor reaction, a first calculation step for calculating a feature amount of an object based on detection by processing of the detection step, It is calculated by the second calculation step for calculating the distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and the feature amount calculated in the past, and by the processing of the second calculation step. A construction step for constructing presentation data including event data for notifying an event according to the distance, a presentation step for performing presentation based on the presentation data constructed by the processing of the construction step, and a presentation by the processing of the presentation step Based on the acquisition step of acquiring the determination input from the user, and the input of the determination from the user acquired by the processing of the acquisition step, Possible to perform the processing including leaving a storage step of storing in association with the feature value calculated by the processing in step the computer and said.

  The first program of the present invention includes a detection step for detecting a sensor reaction, a first calculation step for calculating a feature amount of an object based on detection by the processing of the detection step, and processing of the first calculation step. A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the above and a feature amount calculated in the past, and an event according to the distance calculated by the processing of the second calculation step A construction step for constructing presentation data including event data for notifying a user, a presentation step for presenting based on the presentation data constructed by the processing of the construction step, and a presentation from the user based on the presentation by the processing of the presentation step An acquisition step for acquiring a determination input, and a determination input from the user acquired by the processing of the acquisition step are performed by the processing of the first calculation step. Processing including a storage step of storing in association with the issued feature quantity, characterized in that causing a computer.

  The first information processing apparatus according to the present invention is calculated by a detection unit that detects a sensor response, a first calculation unit that calculates a feature amount of an object based on detection by the detection unit, and a first calculation unit. A second calculation means for calculating a distance in the feature quantity space between the calculated feature quantity and a feature quantity calculated in the past, and for notifying an event according to the distance calculated by the second calculation means A first transmission unit for transmitting event data to another device, an acquisition unit for acquiring a determination input from a user supplied from the other device, and a determination input from the user acquired by the acquisition unit. Storage means for storing in association with the feature amount calculated by the calculation means.

  Based on the distance calculated by the second calculating means, there is further provided a determining means for determining whether or not to notify an event. When the determining means determines that the event is notified, the transmitting means stores event data. It can be transmitted to other devices.

  The second calculation unit is a feature amount space between the feature amount calculated by the first calculation unit and a past feature amount stored in the storage unit and associated with a judgment input from the user. The distance can be calculated.

  The sensor may be an infrared sensor, a camera, or a microphone.

  The first information processing method of the present invention includes a detection step for detecting a sensor reaction, a first calculation step for calculating a feature amount of an object based on detection by processing of the detection step, and a first calculation step. A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the process and a feature amount calculated in the past, and the distance calculated by the process of the second calculation step From the transmission step of transmitting event data for notifying the event to another device, the acquisition step of acquiring the judgment input from the user supplied from the other device, and the user acquired by the processing of the acquisition step And an accumulation step of accumulating the determination input in association with the feature amount calculated by the processing of the first calculation step.

  The program recorded on the second recording medium of the present invention includes a detection step for detecting a sensor response, a first calculation step for calculating a feature amount of an object based on detection by processing of the detection step, It is calculated by the second calculation step for calculating the distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and the feature amount calculated in the past, and by the processing of the second calculation step. Depending on the distance, a transmission step of transmitting event data for notifying an event to another device, an acquisition step of acquiring a judgment input from a user supplied from the other device, and a process of the acquisition step The computer performs a process including an accumulation step of accumulating the acquired determination input from the user in association with the feature amount calculated by the process of the first calculation step. And characterized in that.

  The second program of the present invention includes a detection step for detecting a sensor reaction, a first calculation step for calculating a feature amount of an object based on detection by the processing of the detection step, and processing of the first calculation step. A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the above and a feature amount calculated in the past, and an event according to the distance calculated by the processing of the second calculation step A transmission step for transmitting event data to notify other devices, an acquisition step for acquiring determination input from the user supplied from the other devices, and a determination from the user acquired by the processing of the acquisition step And a storage step of storing the input in association with the feature amount calculated by the processing of the first calculation step.

  The second information processing apparatus according to the present invention is configured to construct presentation data by inserting event data transmitted together with an event into data based on a predetermined signal when an event is notified from another apparatus. Means, presenting means for presenting based on the presentation data constructed by the constructing means, acquisition means for obtaining an input of judgment from the user based on the presentation by the presenting means, and from the user obtained by the obtaining means Transmission means for transmitting a determination input to another device.

  When the event is not notified from the other device, the construction unit can make data based on a predetermined signal as the presentation data.

  The second information processing method according to the present invention is configured to construct presentation data by inserting event data transmitted together with an event into data based on a predetermined signal when an event is notified from another device. A step, a presenting step for presenting based on the presenting data constructed by the process of the constructing step, an obtaining step for obtaining an input of judgment from the user based on the presenting by the process of the presenting step, and a process of the obtaining step A transmission step of transmitting the acquired determination input from the user to another device.

  The program recorded in the third recording medium of the present invention is presented by inserting event data transmitted together with the event into data based on a predetermined signal when the event is notified from another device. A construction step for constructing data, a presentation step for performing presentation based on the presentation data constructed by the processing of the construction step, an acquisition step for obtaining an input of judgment from the user based on the presentation by the processing of the presentation step, It is characterized by causing a computer to perform a process including a transmission step of transmitting a judgment input from a user acquired by the process of the acquisition step to another apparatus.

  The third program of the present invention comprises a construction step of constructing presentation data by inserting event data transmitted together with an event into data based on a predetermined signal when an event is notified from another device. Obtained by the presenting step for presenting based on the presenting data constructed by the processing of the construction step, the obtaining step for obtaining the judgment input from the user based on the presentation by the processing of the presenting step, and the processing of the obtaining step And a transmission step of transmitting a judgment input from a user to another device.

  In the first aspect of the present invention, the response of the sensor is detected, the feature amount of the object is calculated based on the detection, and the distance in the feature amount space between the calculated feature amount and the feature amount calculated in the past is calculated. In accordance with the calculated distance, presentation data including event data for notifying the event is constructed and presented. In addition, the judgment from the user input based on the event presentation is accumulated in association with the calculated feature amount.

  In the second aspect of the present invention, the sensor is detected, the feature amount of the object is calculated based on the detection, and the distance in the feature amount space between the calculated feature amount and the feature amount calculated in the past is calculated. Depending on the calculated distance, event data for notifying the event is transmitted to another device. In addition, judgments from users supplied from other devices are stored in association with the calculated feature values.

  In the third aspect of the present invention, when an event is notified from another device, event data transmitted together with the event is inserted into data based on a predetermined signal, and presented data is constructed and presented. . Moreover, the judgment from the user input based on the event presentation is transmitted to another device.

  According to the first aspect of the present invention, a detected event can be notified. In particular, it is possible to reliably detect and notify a necessary event based on a user's judgment input. Moreover, useless power consumption can be suppressed.

  According to the second aspect of the present invention, a detected event can be notified. In particular, it is possible to reliably detect only the events required by the user, notify other devices, and suppress unnecessary power consumption.

  According to the third aspect of the present invention, the detected event can be presented. In particular, in a normal case, when a predetermined signal is viewed by the user and an event occurs, the event can be presented and notified to the user.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even if there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

  The monitoring system according to claim 1 (for example, the monitoring system 10 in FIG. 1) is a detection unit that detects the reaction of the sensor (for example, the human body detection determination unit 13 in FIG. 2 that executes the process of step S2 in FIG. 5). And a first calculation means for calculating the feature quantity of the object based on the detection by the detection means (for example, the feature quantity calculation section 14 in FIG. 2 that executes the process of step S4 in FIG. 5), and a first calculation. Second calculation means for calculating the distance in the feature quantity space between the feature quantity calculated by the means and the feature quantity calculated in the past (for example, distance calculation in FIG. 3 for executing the processing of step S26 in FIG. 6) Unit 41) and construction means for constructing presentation data including event data for notifying an event according to the distance calculated by the second calculation means (for example, a diagram for executing the processing of step S45 in FIG. 7) 2 presentation image structure Unit 22) and presenting means for presenting based on the presentation data constructed by the constructing means (for example, the presenting unit 3 in FIG. 2 for executing the process in step S45 in FIG. 7 or the process in step S62 in FIG. 8). 2 and the acquisition unit (for example, the event notification determination unit 15 in FIG. 2 that executes the process of step S7 in FIG. 5) that acquires the input of the judgment from the user based on the presentation by the presentation unit. ) And a storage unit that stores the judgment input from the user acquired by the acquisition unit in association with the feature amount calculated by the first calculation unit (for example, a diagram for executing the processing of step S8 in FIG. 5) 3 feature amount accumulating unit 42).

  The monitoring system according to claim 2 determines whether or not to notify the event based on the distance calculated by the second calculation unit (for example, the process of step S29 or step S30 in FIG. 6). The distance determining unit 43) of FIG. 3 to be executed is further provided, and the construction unit constructs the presentation data when the judgment unit determines that the event is notified.

  The second calculation unit of the monitoring system according to claim 3 is a past calculation unit in which a feature amount calculated by the first calculation unit and a judgment input from a user stored in the storage unit are associated with each other. Feature amount space with the feature amount (for example, three types of feature amount axes including the sum of absolute values of background differences as shown in FIG. 4, the horizontal component of the centroid position of the background difference, and the vertical component of the centroid position of the background difference The feature distance is calculated in a feature amount space.

  The sensor of the monitoring system according to claim 4 is an infrared sensor (for example, infrared sensor 12 in FIG. 2), a camera, or a microphone.

  According to a fifth aspect of the present invention, there is provided a monitoring system constructing unit that constructs presentation data by inserting event data into a signal based on a television broadcast (for example, a general viewing signal shown in FIG. 2).

  The construction means of the monitoring system according to claim 6 uses the data based on a predetermined signal (for example, the general viewing signal shown in FIG. 4) as the presentation data when the judgment means judges that the event is not notified. It is characterized by that.

  The monitoring method according to claim 7 is a first calculation for calculating a feature amount of an object based on a detection step (for example, step S2 in FIG. 5) for detecting a response of the sensor and detection by processing of the detection step. Step 2 (for example, step S4 in FIG. 5) and a second calculation step for calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and the feature amount calculated in the past. (For example, step S26 in FIG. 6) and a construction step for constructing presentation data including event data for notifying the event according to the distance calculated by the processing in the second calculation step (for example, in FIG. 7). Step S45) and a presentation step for performing presentation based on the presentation data constructed by the construction step processing (for example, step S45 in FIG. 7 or step S62 in FIG. 8). The acquisition step (for example, step S7 in FIG. 5) for acquiring the judgment input from the user based on the presentation by the processing of the presentation step, and the judgment input from the user obtained by the processing of the acquisition step And an accumulation step (for example, step S8 in FIG. 5) for accumulating in association with the feature amount calculated by the processing of one calculation step.

  In the program recorded on the recording medium according to claim 8 and the program according to claim 9, an embodiment (however, an example) corresponding to each step is the monitoring method according to claim 7. It is the same.

  The information processing apparatus according to claim 10 (for example, the multi-sensor camera 1 in FIG. 1) is a detection unit that detects the reaction of the sensor (for example, the human body detection determination unit in FIG. 2 that executes the process of step S2 in FIG. 5). 13), a first calculation unit that calculates the feature amount of the object based on detection by the detection unit (for example, the feature amount calculation unit 14 in FIG. 2 that executes the process of step S4 in FIG. 5), a first The second calculation means for calculating the distance in the feature quantity space between the feature quantity calculated by the calculation means and the feature quantity calculated in the past (for example, the process of step S26 in FIG. 6 is executed. According to the distance calculated by the distance calculation unit 41) and the second calculation unit, a transmission unit that transmits event data for notifying an event to another apparatus (for example, the process of step S24 in FIG. 6 is executed). The event shown in Figure 2 A determination unit 15), an acquisition unit that acquires a determination input from a user supplied from another device (for example, the event notification determination unit 15 in FIG. 2 that executes the process of step S7 in FIG. 5), and an acquisition unit The storage means for storing the judgment input from the user acquired in accordance with the feature amount calculated by the first calculation means (for example, the feature amount storage in FIG. 3 for executing the processing of step S8 in FIG. 5) Part 42).

  The information processing apparatus according to claim 11 is a determination unit that determines whether to notify an event based on the distance calculated by the second calculation unit (for example, the process of step S29 or step S30 in FIG. 6). 3 is further provided, and the transmission means transmits the event data to another device when it is determined that the event is notified by the determination means.

  The second calculation unit of the information processing device according to claim 12 is a past in which the feature amount calculated by the first calculation unit and the judgment input from the user stored in the storage unit are associated with each other. Feature amount space (for example, three types of feature amounts: sum of absolute values of background differences as shown in FIG. 4, horizontal component of centroid position of background differences, and vertical component of centroid position of background differences) It is characterized in that a distance in a feature amount space composed of axes is calculated.

  The sensor of the information processing apparatus according to claim 13 is an infrared sensor (for example, infrared sensor 12 in FIG. 2), a camera, or a microphone.

  The information processing method according to claim 14 is a first step of calculating a feature amount of an object based on a detection step (for example, step S2 in FIG. 5) for detecting a reaction of the sensor and detection by processing of the detection step. Second calculation for calculating the distance in the feature amount space between the feature amount calculated by the calculation step (for example, step S4 in FIG. 5) and the feature amount calculated in the first calculation step. In accordance with the step (for example, step S26 in FIG. 6) and the distance calculated by the processing of the second calculation step, a transmission step for transmitting event data for notifying the event to another device (for example, FIG. 6). Step S24), an acquisition step (for example, step S7 in FIG. 5) for acquiring a judgment input from the user supplied from another device, and an acquisition step. The input of the determination from the user, a first storage step of storing in association with the feature value calculated by the processing of the calculating step (e.g., step S8 in FIG. 5), characterized in that it comprises a.

  In the program recorded on the recording medium according to claim 15 and the program according to claim 16, an embodiment (however, an example) corresponding to each step is the information processing according to claim 14. It is the same as the method.

  The information processing device according to claim 17 (for example, the processing box 2 in FIG. 1), when an event is notified from another device, the event data transmitted together with the event is data based on a predetermined signal. A construction means (for example, the presentation image construction section 22 shown in FIG. 2 that executes the processing of step S45 in FIG. 7) and a presentation means that performs presentation based on the presentation data constructed by the construction means. (For example, the presentation unit 3 of FIG. 2 that executes the process of step S45 of FIG. 7 or the presentation unit 32 of FIG. 2 that executes the process of step S62 of FIG. 8) and the presentation by the presentation means from the user From the acquisition unit (for example, the event notification determination unit 15 in FIG. 2 that executes the processing of step S7 in FIG. 5) and the user acquired by the acquisition unit Transmitting means for transmitting an input of the determination to the other device (e.g., transmitter 25 of FIG. 2 for executing processing in step S49 in FIG. 7); and a.

  In the information processing device according to claim 18, when an event is not notified from another device, the construction unit uses the data based on a predetermined signal (for example, the general viewing signal shown in FIG. 2) as the presentation data. It is characterized by doing.

  The information processing method according to claim 19, wherein when an event is notified from another device, the event data transmitted together with the event is inserted into data based on a predetermined signal to construct the presentation data Step (for example, step S45 in FIG. 7), a presentation step for performing presentation based on the presentation data constructed by the process of the construction step (for example, step S45 in FIG. 7 or step S62 in FIG. 8), and processing in the presentation step An acquisition step (for example, step S7 in FIG. 5) for acquiring a determination input from the user based on the presentation by the user, and a transmission for transmitting the determination input from the user acquired by the processing of the acquisition step to another device And a step (for example, step S49 in FIG. 7).

  In the program recorded on the recording medium according to claim 20 and the program according to claim 21, an embodiment (however, an example) corresponding to each step is the information processing according to claim 19. It is the same as the method.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a configuration example of a monitoring system 10 to which the present invention is applied. In this configuration example, the multi-sensor camera 1 is provided on the left monitoring area side in the figure, and the processing box 2, the presentation unit 3, and the processing box 2 are remotely operated on the notification / presentation side on the right side in the figure. A remote controller 4 is provided. The multi-sensor camera 1 and the processing box 2 perform wireless communication with each other via the wireless antenna 1A and the wireless antenna 2A. The processing box 2 and the remote controller 4 perform wireless communication or infrared communication with each other. The processing box 2 and the presentation unit 3 are connected by a wired or wireless connection such as a bus. The multi-sensor camera 1 and the processing box 2 are not limited to wireless communication, and may be wired communication.

  The multi-sensor camera 1 is installed in an area (necessary place) where an event is to be monitored. The multi-sensor camera 1 is provided with a CCD (Charge Coupled Device) camera 11 and an infrared sensor 12 (FIG. 2), and each sensor is driven by a battery (not shown). Although the details will be described later, the multi-sensor camera 1 determines whether or not to notify the event data based on the event detected by the infrared sensor 12, and determines that the event data is notified, the wireless sensor 1A is Then, image data (data necessary for event presentation) taken by the CCD camera 11 is transmitted to the processing box 2.

  The processing box 2 receives data necessary for event presentation transmitted from the multi-sensor camera 1 via the wireless antenna 2A, constructs a presentation image and sound based on the received data, and presents the presentation unit 3 and the remote Supplied or transmitted to the controller 4 to present an event.

  The presentation unit 3 is, for example, a general television receiver, and when an event has not occurred (normal case), a general viewing signal (video based on a broadcast signal) is displayed, and when an event has occurred, A picture-in-picture image in which an event image is inserted into a part of a general viewing signal is displayed. The presenting unit 3 is not limited to a television receiver, and may be a dedicated monitor. The displayed image may be an image of the entire screen, not a picture-in-picture image.

  The user can make a determination on the event presented on the presentation unit 3 and can input various commands from the remote controller 4 based on the result of the determination. For example, if you want to continue to notify the event that has occurred, operate the OK button (not shown), and if you do not need to notify the event that has just occurred, indicate that An instruction can be input by operating a button (not shown). Based on the judgment input from the user, the event detected by the processing box 2 changes with time, and whenever the user uses the monitoring system 10, only the event intended by the user is detected and notified. .

  In addition, the CCD camera 11 mounted on the multi-sensor camera 1 operates only when it is determined to notify an event, so that wasteful power consumption can be suppressed.

  FIG. 2 is a block diagram illustrating a functional configuration example of the monitoring system 10 illustrated in FIG. 1.

  The CCD camera 11 of the multi-sensor camera 1 captures the situation in the monitoring area as needed, and supplies the image signal as notification image data to the transmission unit 17 via the switch 16 and also to the feature amount calculation unit 14. The infrared sensor 12 receives infrared region light emitted from an object (not shown), converts the received light into an electrical signal, and supplies it to the human body detection determination unit 13 as sensor data.

  When the sensor data is supplied from the infrared sensor 12, the human body detection determination unit 13 determines that the infrared sensor has reacted (that is, has detected mainly animals such as human bodies, cats, and dogs), and supplies a power control signal. The power is supplied to the CCD camera 11 and turned on. As a result, the notification image data output from the CCD camera 11 is supplied to the feature amount calculation unit 14.

  The feature amount calculation unit 14 calculates feature amount data from the image data supplied from the CCD camera 11 and supplies the calculation result to the event notification determination unit 15.

  The event notification determination unit 15 calculates the distance in the feature amount space between the feature amount data supplied from the feature amount calculation unit 14 and the feature amount data calculated in the past, and based on the calculation result, the event is determined. If it is determined whether or not an event has occurred, an event to be notified to the processing box 2 is supplied to the transmitter 17 and an event notification signal is supplied to the switch 16 to turn it on. Thus, the notification image data output from the CCD camera 11 is supplied to the transmission unit 17 via the switch 16.

  In addition, the event notification determination unit 15 converts a signal related to user feedback (FB) received from the processing box 2 via the receiving unit 18 (hereinafter referred to as a user FB signal as appropriate) into the feature amount data of the currently occurring event. Accumulate and store.

  Here, the user feedback means a user's determination input that is input using the input unit 33 of the remote controller 4 when the user makes a determination on the presented event. For example, the user operates the OK button (not shown) of the input unit 33 when the user wants to keep informed of the event in the future, and the NG button (not shown) when the user does not need to detect the event in the future. Can be input as user feedback. Alternatively, feedback may be performed only when it is not necessary to detect the event.

  The transmission unit 17 transmits the event supplied from the event notification determination unit 15 to the processing box 2 and the notification image data supplied from the CCD camera 11. The receiving unit 18 receives the user feedback transmitted from the processing box 2 and supplies it to the event notification determination unit 15.

  The reception unit 21 of the processing box 2 supplies the notification image data and the event transmitted from the multi-sensor camera 1 to the presentation image construction unit 22.

  When the event is notified from the multi-sensor camera 1 via the receiving unit 21, the presented image constructing unit 22 receives a general viewing signal (television broadcast signal) supplied from a device (not shown) (which may be the presenting unit 3). Notification data in which notification image data is partially inserted is constructed (created), and is supplied to the presentation unit 3 for presentation. Also, the presentation image construction unit 22 constructs notification data for the remote controller 4 (not including a general viewing signal) configured by notification image data, and supplies the notification data to the transmission unit 23. In addition, when the event is not notified (normal case), the presentation image construction unit 22 supplies a general viewing signal (video based on a broadcast signal) to the presentation unit 3 for presentation.

  Since the notification data for the presenting unit 3 is configured by inserting the notification image data into a part of a general viewing signal, the presenting unit 3 is presented with a picture-in-picture display. Further, since the notification data for the remote controller 4 is composed of notification image data, only the display representing the event (for example, the image of the place being monitored) is presented on the presentation unit 32 of the remote controller 4. The

  The transmission unit 23 transmits the notification data supplied from the presentation image construction unit 32 to the remote controller 4. The receiving unit 24 receives the user FB signal transmitted from the remote controller 4 and supplies it to the transmitting unit 25. The transmission unit 25 transmits the user FB signal supplied from the reception unit 24 to the multi-sensor camera 1.

  The receiving unit 31 of the remote controller 4 receives the notification data transmitted from the processing box 2 and causes the presenting unit 32 to present it. The input unit 33 receives an input based on a judgment from the user with respect to the presented event, and supplies a signal related to the input (user feedback) to the transmission unit 34. The transmission unit 34 transmits the user FB signal supplied from the input unit 33 to the processing box 2.

  Here, as described above, the user feedback indicates, for example, a determination input by the user such as “an event that I want to be notified in the future” or “an event that should not be notified in the future”. The multi-sensor camera 1 and the processing box 2 change processing based on this user feedback.

  FIG. 3 is a block diagram illustrating a detailed configuration example of the event notification determination unit 15 of the multi-sensor camera 1 of FIG.

  The distance calculation unit 41 includes the current feature amount data supplied from the feature amount calculation unit 14 and user feedback (OK (desired to be notified)) or NG (not notified) stored in the feature amount storage unit 42. The distance in the feature amount space with the past feature amount data associated with (good)) is calculated, and the calculated distance data is supplied to the distance determination unit 43. Here, the feature amount used is the sum of the absolute values of the background difference (the difference between the pixel values of the background image data stored in advance and the current image data representing the position of the moving object), and the barycentric position of the background difference. There are three types, a horizontal component in the image and a vertical component in the image at the center of gravity of the background difference, and the distance in the feature amount space constituted by these three types of feature amount axes is calculated.

  In addition, the distance calculation unit 41 supplies the current feature amount data supplied from the feature amount calculation unit 14 to the feature amount storage unit 42 and stores it therein.

  The distance determination unit 43 determines whether or not the nearest distance among the distance data supplied from the distance calculation unit 41 is equal to or greater than a predetermined threshold, and notifies the processing box 2 based on the determination result Is supplied to the transmitter 45.

  The feature amount storage unit 42 stores the feature amount data added by the distance calculation unit 41. When user feedback is supplied from the processing box 2 to the accumulated feature amount data, the feature amount accumulation unit 42 accumulates the user feedback in association with the feature amount data.

  Note that, in the initial state of the multi-sensor camera 1, the feature amount data is not stored in the feature amount storage unit 42, and the event notification determination unit 15 is supplied with the current feature amount data from the feature amount calculation unit 14. It is immediately determined as a notification event. That is, all events are notified in the initial state. Thereby, it is prevented that a required event is not notified to a user.

  FIG. 4 is a diagram for explaining distance calculation and event notification in the feature amount space. In the figure, the x-axis represents the horizontal component of the centroid position of the background difference, the y-axis represents the sum of the absolute values of the background difference, and the z-axis represents the vertical component of the centroid position of the background difference.

  In the example of FIG. 4, the feature amount P1 represents the feature amount data calculated by the feature amount calculation unit 14 at time t1, and the feature amount P2 is the feature amount data calculated by the feature amount calculation unit 14 at time t2. The feature amount P3 represents the feature amount data calculated by the feature amount calculation unit 14 at time t3. In the figure, the feature quantities Q1 to Q4 indicated by white circles are NG (no need to notify the event) by user feedback among the past feature quantity data accumulated in the feature quantity accumulation unit 42. The feature quantities Q5 to Q10 indicated by black circles in the figure are the past feature quantity data stored in the feature quantity storage unit 42. This represents the feature quantity data that was requested.

  The distance calculation unit 41 calculates the distance (Euclidean distance in the feature amount space) between the current feature amount P1 and all the feature amounts Q1 to Q4 determined as NG (no event notification is required) by user feedback at time t1. ) And the calculated distance data is supplied to the distance determination unit 43. The distance determination unit 43 has the closest distance data (distance to the feature amount Q1 in the example of FIG. 4) among the distance data supplied from the distance calculation unit 41 equal to or greater than a predetermined threshold value. If it is determined whether or not it is equal to or greater than a predetermined threshold (less than the threshold), it is determined as a non-notification event.

  The distance calculation unit 41 calculates the distance between the current feature value P2 and all the feature values Q1 to Q4 determined as NG by user feedback at time t2, and supplies the calculated distance data to the distance determination unit 43. To do. The distance determination unit 43 has the closest distance data (distance to the feature amount Q2 in the example of FIG. 4) among the distance data supplied from the distance calculation unit 41 equal to or greater than a predetermined threshold value. If it is determined whether or not it is equal to or greater than a predetermined threshold (less than the threshold), it is determined as a non-notification event.

  Further, the distance calculation unit 41 calculates the distance between the current feature amount P3 and all the feature amounts Q1 to Q4 determined as NG by user feedback at time t3, and supplies the calculated distance data to the distance determination unit 43. To do. In the distance determination unit 43, the closest distance data (distance to the feature amount Q4 in the example of FIG. 4) among the distance data supplied from the distance calculation unit 41 is equal to or greater than a predetermined threshold value. If it is determined that the value is equal to or greater than a predetermined threshold, it is determined as a notification event.

  In the example of FIG. 4, the distances between the current feature amounts P1 to P3 and all the feature amounts Q1 to Q4 that are determined to be NG (no event notification is required) by user feedback are calculated, and the nearest distance data is obtained. When it is equal to or greater than a predetermined threshold, it is determined that the event is a notification event, and when it is smaller than the predetermined threshold, it can be determined that the event is a non-notification event. Alternatively, the distances between the current feature amounts P1 to P3 and all the feature amounts Q5 to Q10 that are OK (to be notified of an event) by user feedback are calculated, and the nearest distance data is preset. If it is less than or equal to a predetermined threshold, it may be determined that the event is a notification event, and if it is greater than the predetermined threshold, it may be determined that the event is a non-notification event.

  Next, processing in the multi-sensor camera 1 will be described with reference to the flowchart of FIG. This process is started when the user gives an instruction to start monitoring in the monitoring area.

  In step S1, the human body detection determination unit 13 supplies a power control signal to the CCD camera 11 to turn off the power. The event notification determination unit 15 turns off the event notification flag and clears the feature amount data stored in the feature amount storage unit 42.

  In step S2, the human body detection determination unit 13 determines whether or not the infrared sensor 12 has reacted, that is, whether or not sensor data indicating that an animal (mainly a person) has been detected is supplied from the infrared sensor 12. If it is determined that the infrared sensor 12 has reacted, the process proceeds to step S3, where a power control signal is supplied to the CCD camera 11 to turn on the power. That is, until the infrared sensor 12 reacts, the power of the CCD camera 11 that consumes more power than that of the infrared sensor 12 remains off, thereby suppressing wasteful battery consumption.

  Then, image data is supplied from the CCD camera 11 to the feature amount calculation unit 14 by the process of step S3. In step S <b> 4, the feature amount calculation unit 14 calculates a feature amount based on the image data supplied from the CCD camera 11. Specifically, the feature amount calculation unit 14 acquires and holds background image data from the CCD camera 11 in advance, and the current image data and background supplied from the CCD camera 11 according to the reaction of the infrared sensor 12. Three types of feature quantities are calculated from the image data: the sum of absolute values of background differences, a horizontal component in the image of the center position of the background difference, and a vertical component in the image of the center position of the background difference.

  In step S5, the event notification determination unit 15 performs an event notification determination process based on the feature amount data calculated in the process of step S4. The details of the event notification determination process will be described later with reference to the flowchart of FIG. 6, but this process generates a notification event from the event notification determination unit 15 or a non-notification event (event) Will not be notified).

  If it is determined in step S2 that the infrared sensor is not responding, the process proceeds to step S6, where the human body detection determination unit 13 supplies a power control signal to the CCD camera 11 to turn off the power, and an event notification determination unit 15 turns off the event notification flag. Thereafter, the process proceeds to step S7.

  In step S7, the event notification determination unit 15 determines whether or not the user FB signal transmitted from the processing box 2 (by the processing in step S49 in FIG. 7 described later) via the reception unit 18 has been received, If it is determined that the user FB signal has been received, the process proceeds to step S8, and user feedback ("OK (I want to be notified in the future)" or "NG (I do not need to be notified in the future)") has recently occurred. The feature amount is stored in the feature amount storage unit 42 in association with the feature amount data corresponding to the event.

  If it is determined in step S7 that the user FB signal has not been received, or after the process of step S8, the process returns to step S2, and the above-described process is repeatedly executed.

  Next, details of the event notification determination process in step S5 of FIG. 5 will be described with reference to the flowchart of FIG.

  In step S21, the distance calculation unit 41 determines whether there is feature amount data calculated by the feature amount calculation unit 14 (calculated in the process of step S4 in FIG. 5) (that is, the power of the CCD camera 11 is turned on). If it is determined that there is feature amount data, the process proceeds to step S22, and the feature amount data is read.

  In step S23, the distance determination unit 43 determines whether or not the event flag is on (event notification is in progress). If it is determined that the event flag is on, the process proceeds to step S24, and the transmission unit 17 is turned on. The process box 2 is notified of the event via an event and an event notification signal is supplied to the switch 16 to be turned on. As a result, transmission of notification image data (event image) from the CCD camera 11 to the processing box 2 is started. The processing box 2 receives the notification image data and causes the presenting unit 3 to present it (step S45 in FIG. 7 described later).

  If it is determined in step S23 that the event flag is not on but off (not being notified of an event), the process proceeds to step S25, and the distance calculation unit 41 stores past features stored in the feature amount storage unit 42. Read volume data and corresponding user feedback ("OK (notify me in the future)" or "NG (do not need to be notified in the future)"). In step S26, the distance calculation unit 41 calculates the distance in the feature amount space between the current feature amount data read in the process of step S22 and the past feature amount data read in the process of step S25. That is, as shown in FIG. 4, the distance calculation unit 41 uses three types of feature amount axes: the sum of the absolute values of the background differences, the horizontal component of the center position of the background difference, and the vertical component of the background position of the center of gravity. The distance in the configured feature amount space is calculated.

  Furthermore, when the user feedback corresponding to the past feature amount data of interest is NG, the distance calculation unit 41 focuses on the shortest distance from the feature amount data corresponding to the previously calculated NG. If the distance of the existing data is smaller, the distance of the data of interest is held as the shortest distance from the data corresponding to NG. Similarly, when the user feedback corresponding to the past feature quantity data currently focused on is OK, the distance determination unit 43 focuses on the current distance from the shortest distance from the feature quantity data corresponding to the OK calculated in the past. If the distance of the current data is smaller, the distance of the data of interest is held as the shortest distance from the data corresponding to OK.

  In step S27, the distance calculation unit 41 determines whether or not all past feature amount data stored in the feature amount storage unit 42 has been read, and determines that there is past feature amount data that has not yet been read. In this case, the process returns to step S25, and the above-described process is repeatedly executed.

  If it is determined in step S27 that all past feature quantity data has been read, the process proceeds to step 28, where the distance calculation unit 41 supplies the current feature quantity data to the feature quantity storage unit 42 and accumulates it therein. .

  In step S29, the distance determination unit 43 determines whether or not the shortest distance from the past feature quantity data corresponding to the NG calculated by the distance calculation unit 41 in the process of step S26 is equal to or greater than a predetermined threshold. If it is determined that the value is equal to or greater than the predetermined threshold value, the process proceeds to step S31.

  If it is determined in step S29 that the shortest distance from the past feature quantity data corresponding to NG is not equal to or greater than the predetermined threshold value but is smaller than the predetermined threshold value, the process proceeds to step S30, and the distance determination unit 43 further includes It is determined whether or not the shortest distance from past feature value data corresponding to OK is equal to or smaller than a predetermined threshold value. When it is determined that the shortest distance is equal to or smaller than the predetermined threshold value, the process proceeds to step S31. In step S31, the event notification determination unit 15 turns on the event flag.

  In step S21, when it is determined that there is no feature amount data calculated by the feature amount calculation unit 14 (that is, when it is determined that the power of the CCD camera 11 is off), the process proceeds to step S32, and an event notification determination is made. The unit 15 turns off the event flag.

  After the process of step S24, after the process of step S31, after the process of step S32, or in step S30, it is determined that the shortest distance from the past feature amount data corresponding to OK is larger than a predetermined threshold value. If so, the process returns to step S6 of FIG.

  As a result of the above processing, an event is generated from the event notification determination unit 15 according to the distance in the feature amount space, or the event is not notified (this is a non-notification event).

  Note that, in the initial state of the multi-sensor camera 1, the feature amount data is not stored in the feature amount storage unit 42, and the distance determination unit 43 is supplied with the current feature amount data from the feature amount calculation unit 14. Raise the event immediately.

  Next, processing in the processing box 2 executed in correspondence with the processing of the multi-sensor camera 1 in FIG. 5 will be described with reference to the flowchart in FIG. This process is performed when the user instructs the presenting unit 3 to present an image corresponding to the general viewing signal (broadcast program signal), or when it is instructed to start monitoring in the monitoring area. To be started.

  In step S41, the receiving unit 21 turns off the event reception flag. In step S42, the reception unit 21 determines whether or not the event reception flag is on (the event is being received). If the reception unit 21 determines that the event reception flag is on, the process proceeds to step S43.

  In step S43, the receiving unit 21 determines whether or not the reception of the notification image data transmitted from the multi-sensor camera 1 has been completed (by the processing of step S24 in FIG. 6 described above), and receives the notification image data. If it is determined that the process has ended, the process proceeds to step S44, and the event reception flag is turned off. Thereafter, the process proceeds to step S48.

  If it is determined in step S43 that the reception of the notification image data has not yet been completed, the reception unit 21 transmits the notification image data transmitted from the multi-sensor camera 1 (by the processing of step S24 in FIG. 6 described above). The notification event is supplied to the presentation image construction unit 22, and the process proceeds to step S45.

  In step S45, the presentation image construction unit 22 receives notification data (image data to be presented in picture-in-picture) in which notification image data supplied from the reception unit 21 is inserted into a part of the general viewing signal. Build it and output it to the presentation unit 3 for presentation. The presentation image construction unit 22 constructs notification data for the remote controller 4 that does not include a general viewing signal (data configured by the notification image data) and transmits the notification data to the remote controller 4 via the transmission unit 23. The remote controller 4 receives this notification data and causes the presenting unit 62 to present it (step S62 in FIG. 8 described later).

  If it is determined in step S42 that the event reception flag is not on but off (no event is being received), the process proceeds to step S46, and the reception unit 21 performs the multi-processing (by the process of step S24 in FIG. 6 described above). It is determined whether an event transmitted from the sensor camera 1 has been received.

  If it is determined in step S46 that an event has been received, the process proceeds to step S47, and the receiving unit 21 turns on the event reception flag, and then proceeds to step S48. On the other hand, if it is determined in step S46 that no event has been received, the process of step S47 is skipped, and the process proceeds to step S48.

  In step S48, the receiving unit 24 determines whether or not the user FB signal transmitted from the remote controller 4 (by the process of step S64 in FIG. 8 described later) has been received, and determines that the user FB signal has been received. If so, the process proceeds to step S49.

  In step S49, the reception unit 24 transmits the received user FB signal to the multi-sensor camera 1 via the transmission unit 25. The multi-sensor camera 1 receives this user FB signal and associates it with the feature data (step S8 in FIG. 5 described above).

  After the process of step S49 or when it is determined in step S48 that the user FB signal has not been received, the process returns to step S42 and the above-described process is repeatedly executed.

  Next, processing in the remote controller 4 that is executed corresponding to the processing in the processing box 2 in FIG. 7 will be described with reference to the flowchart in FIG. This process is started when the process of step S45 of FIG. 7 is executed by the transmission unit 23 of the process box 2.

  In step S61, the receiving unit 31 determines whether or not a notification event has been received from the processing box 2, and waits until a notification event is received. If it is determined that the notification event has been received, the process proceeds to step S62, and the receiving unit 31 performs an event based on the notification data transmitted together with the notification event from the processing box 2 (by the process of step S45 in FIG. 7 described above). An image (notification image data) is presented to the presentation unit 32.

  The user looks at the event image presented on the presenting unit 32, operates the input unit 33, and determines (for example, whether the presently presented event is an event that the user wants to be notified in the future or will not notify the future. Is it a good event?

  In step S63, the input unit 33 determines whether or not a judgment (user feedback) from the user with respect to the presented event has been input. If it is determined that the user feedback has been input, the input unit 33 transmits the user FB signal to the transmission unit 34. To proceed to step S64.

  In step S <b> 64, the transmission unit 34 transmits the user FB signal supplied from the input unit 33 to the processing box 2. The processing box 2 receives this and transmits it to the multi-sensor camera 1 (step S49 in FIG. 7).

  After the process of step S64 or when it is determined in step S63 that no user feedback has been input, the process returns to step S61 and the above-described process is repeatedly executed.

  As described above, the current feature amount is calculated from the image data of the CCD camera 11 obtained according to the response of the infrared sensor 12, and the past feature feature and NG (not required to be notified as an event) When the distance to all the feature quantities is calculated and the shortest distance is equal to or greater than a predetermined threshold, an event can be notified. In addition, the distance between the current feature amount and all the past feature amounts that are OK (desired to be notified as an event) is calculated, and if the shortest distance is equal to or less than a predetermined threshold, an event may be notified. it can.

  A process of calculating distances from all past feature quantities that are OK (notified as events) and determining whether the shortest distance is equal to or less than a predetermined threshold (step S30 in FIG. 6). May be omitted. Because it calculates the distance from all the past feature quantities that are NG (not required to be notified as an event), and when the shortest distance is equal to or greater than a predetermined threshold, the event is notified. Because it is redundant to calculate the distance to all past feature values that are OK (to be notified as an event) and determine whether the shortest distance is less than or equal to a predetermined threshold It is.

  As described above, by determining the distance from the designation (user feedback) from the past user in the feature amount space, it is possible not to notify a disturbance with a small difference due to a shake of a leaf or the like, It is possible not to notify even if it is detected.

  In the above, since the past feature amount used for determining event notification changes based on feedback from the user, only the event intended by the user can be detected and the event is notified. In addition, since the power of the CCD camera 11 is turned on, wasteful battery consumption can be suppressed.

  Further, in the above, an example in which three feature amounts of the sum of absolute values of background differences, a horizontal component of the center position of the background difference, and a vertical component of the center position of the background difference are used has been described. Not limited to, for example, three feature amounts such as the sum of absolute values of inter-frame differences, a horizontal component of the centroid position of the inter-frame difference, and a vertical component of the centroid position of the inter-frame difference are used. The number of quantities is not limited to three but may be increased beyond that.

  Furthermore, although the example in the case of detecting a human body using the infrared sensor 12 has been described, the present invention is not limited thereto, and for example, a microphone, a photo sensor, a microwave sensor, or another sensor can be used. is there.

  Further, the multi-sensor camera 1 and the presenting unit 3 are not provided as a single unit, but a plurality of units may be provided. The processing box 2 may not be a separate housing from the presenting unit 3 and may be integrated. 4, the presentation unit 32 can be provided without providing the presentation unit 32, or an input unit for inputting user feedback to the processing box 2 can be provided.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a network or a recording medium into a general-purpose personal computer or the like.

  FIG. 9 is a diagram illustrating an internal configuration example of the general-purpose personal computer 100. A CPU (Central Processing Unit) 101 executes various processes according to a program stored in a ROM (Read Only Memory) 102 or a program loaded from a storage unit 108 to a RAM (Random Access Memory) 103. The RAM 103 also appropriately stores data necessary for the CPU 101 to execute various processes.

  The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 104. An input / output interface 105 is also connected to the bus 104.

  The input / output interface 105 includes an input unit 106 composed of buttons, switches, a keyboard or a mouse, an output unit 207 composed of a display such as a CRT (Cathode Ray Tube) or LCD (Liquid Crystal Display), and a speaker. Further, a storage unit 108 composed of a hard disk or the like and a communication unit 109 composed of a modem or a terminal adapter are connected. The communication unit 109 performs communication processing via a network including the Internet.

  A drive 110 is connected to the input / output interface 105 as necessary, and a removable medium 111 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted, and a computer program read therefrom is read. Installed in the storage unit 108.

  As shown in FIG. 9, a recording medium that records a program that is installed in a computer and can be executed by the computer is distributed to provide a program to a user separately from the apparatus main body. Recording magnetic disks (including flexible disks), optical disks (including CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc)), magneto-optical disks (MD (Mini-Disc) (registered trademark) ), Or included in the ROM 103 or the storage unit 108 in which the program is recorded, which is provided to the user in a state of being incorporated in the apparatus main body in advance, in addition to being configured by the removable medium 111 including a semiconductor memory or the like. Hard disk.

  In the present specification, the step of describing the program stored in the program storage medium is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series. Or the process performed separately is also included.

  Further, in this specification, the system represents the entire apparatus composed of a plurality of apparatuses.

It is a figure which shows the structural example of the monitoring system to which this invention is applied. It is a block diagram which shows the functional structural example of the monitoring system of FIG. It is a block diagram which shows the detailed structural example of the event notification determination part of FIG. It is a figure for demonstrating distance calculation and event notification in a feature-value space. It is a flowchart explaining the process in a multi sensor camera. It is a flowchart explaining the detail of the event notification determination process in the process of step S5 of FIG. It is a flowchart explaining the process in a process box. It is a flowchart explaining the process in a remote controller. It is a block diagram which shows the structural example of a general purpose personal computer.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Multi-sensor camera, 2 Processing box, 3 Presentation part, 4 Remote controller, 10 Surveillance system, 11 CCD camera, 12 Infrared sensor, 13 Human body detection determination part, 14 Feature-value calculation part, 15 Event notification determination part, 22 Presentation image Construction part, 32 presentation part, 33 input part

Claims (21)

Detection means for detecting the reaction of the sensor;
First calculation means for calculating a feature amount of an object based on detection by the detection means;
Second calculation means for calculating a distance in the feature quantity space between the feature quantity calculated by the first calculation means and a feature quantity calculated in the past;
Construction means for constructing presentation data including event data for notifying an event according to the distance calculated by the second calculation means;
Presenting means for presenting based on the presentation data constructed by the constructing means;
Obtaining means for obtaining an input of judgment from the user based on the presentation by the presenting means;
A monitoring system comprising: an accumulation unit that accumulates an input of a judgment from the user acquired by the acquisition unit in association with the feature amount calculated by the first calculation unit. Based on the distance calculated by the second calculation means, further comprising a determination means for determining whether to notify an event;
The monitoring system according to claim 1, wherein the construction unit constructs the presentation data when it is determined by the determination unit that the event is notified. The second calculation means includes the feature quantity calculated by the first calculation means and a past feature quantity stored in the storage means and associated with a judgment input from the user. The monitoring system according to claim 1, wherein a distance in the feature amount space is calculated. The monitoring system according to claim 1, wherein the sensor is an infrared sensor, a camera, or a microphone. The monitoring system according to claim 1, wherein the construction unit constructs the presentation data by inserting the event data into a signal based on television broadcasting. The monitoring system according to claim 1, wherein, when the determination unit determines that the event is not notified by the determination unit, data based on a predetermined signal is used as the presentation data. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A construction step of constructing presentation data including event data for notifying an event according to the distance calculated by the processing of the second calculation step;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
And a storage step of storing the judgment input from the user acquired by the processing of the acquisition step in association with the feature amount calculated by the processing of the first calculation step. Method. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A construction step of constructing presentation data including event data for notifying an event according to the distance calculated by the processing of the second calculation step;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
And a storage step for storing the judgment input from the user acquired by the processing of the acquisition step in association with the feature amount calculated by the processing of the first calculation step. Is a recording medium on which a readable program is recorded. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A construction step of constructing presentation data including event data for notifying an event according to the distance calculated by the processing of the second calculation step;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
Causing the computer to execute an accumulation step of accumulating the judgment input from the user acquired by the process of the acquisition step in association with the feature amount calculated by the process of the first calculation step. Program. Detection means for detecting the reaction of the sensor;
First calculation means for calculating a feature amount of an object based on detection by the detection means;
Second calculation means for calculating a distance in the feature quantity space between the feature quantity calculated by the first calculation means and a feature quantity calculated in the past;
Transmission means for transmitting event data for notifying an event to another device according to the distance calculated by the second calculation means;
Obtaining means for obtaining a judgment input from a user supplied from the other device;
An information processing apparatus comprising: an accumulation unit that accumulates a judgment input from the user acquired by the acquisition unit in association with the feature amount calculated by the first calculation unit. Based on the distance calculated by the second calculation means, further comprising a determination means for determining whether to notify an event;
The information processing apparatus according to claim 10, wherein the transmission unit transmits the event data to the other device when the determination unit determines to notify the event. The second calculation means includes the feature quantity calculated by the first calculation means and a past feature quantity stored in the storage means and associated with a judgment input from the user. The information processing apparatus according to claim 10, wherein a distance in the feature amount space is calculated. The information processing apparatus according to claim 10, wherein the sensor is an infrared sensor, a camera, or a microphone. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A transmission step of transmitting event data for notifying an event to another device according to the distance calculated by the processing of the second calculation step;
An obtaining step of obtaining a judgment input from a user supplied from the other device;
An accumulation step of accumulating the judgment input from the user acquired by the process of the acquisition step in association with the feature amount calculated by the process of the first calculation step. Processing method. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A transmission step of transmitting event data for notifying an event to another device according to the distance calculated by the processing of the second calculation step;
An obtaining step of obtaining a judgment input from a user supplied from the other device;
And a storage step for storing the judgment input from the user acquired by the processing of the acquisition step in association with the feature amount calculated by the processing of the first calculation step. Is a recording medium on which a readable program is recorded. A detection step for detecting the response of the sensor;
A first calculation step of calculating a feature amount of the object based on detection by the processing of the detection step;
A second calculation step of calculating a distance in the feature amount space between the feature amount calculated by the processing of the first calculation step and a feature amount calculated in the past;
A transmission step of transmitting event data for notifying an event to another device according to the distance calculated by the processing of the second calculation step;
An obtaining step of obtaining a judgment input from a user supplied from the other device;
Causing the computer to execute an accumulation step of accumulating the judgment input from the user acquired by the process of the acquisition step in association with the feature amount calculated by the process of the first calculation step. Program. When an event is notified from another device, construction means for constructing the presentation data by inserting event data transmitted together with the event into data based on a predetermined signal;
Presenting means for presenting based on the presentation data constructed by the constructing means;
Obtaining means for obtaining an input of judgment from the user based on the presentation by the presenting means;
An information processing apparatus comprising: a transmission unit configured to transmit an input of determination from the user acquired by the acquisition unit to the other device. 18. The information processing apparatus according to claim 17, wherein when the event is not notified from the other apparatus, the construction unit uses data based on the predetermined signal as presentation data. When an event is notified from another device, a construction step of constructing presentation data by inserting event data transmitted together with the event into data based on a predetermined signal;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
A transmission step of transmitting to the other device an input of the judgment acquired by the user acquired by the processing of the acquisition step. When an event is notified from another device, a construction step of constructing presentation data by inserting event data transmitted together with the event into data based on a predetermined signal;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
A recording medium on which a computer-readable program is recorded, comprising: a transmission step of transmitting a judgment input from the user acquired by the processing of the acquisition step to the other device. When an event is notified from another device, a construction step of constructing presentation data by inserting event data transmitted together with the event into data based on a predetermined signal;
A presentation step for presenting based on the presentation data constructed by the processing of the construction step;
An obtaining step for obtaining a judgment input from the user based on the presentation by the processing of the presenting step;
A program for causing a computer to execute a transmission step of transmitting a judgment input from the user acquired by the processing of the acquisition step to the other device.

Images