CN100559410C - Situation monitoring device and situation monitoring system - Google Patents

Abstract

Provide a kind of single assembly that can use to monitor various situations and the situation monitoring device of reporting in response to situation.This situation monitoring device is installed easily and is used, and therefore realizes system marked downly.This situation monitoring device is discerned the infield (step S102) that this device is installed, the related information that preservation is associated infield and situation about will discern, and according to infield recognition result and the definite predetermined case (step S104) that will discern of related information, discern determined predetermined case (step S106), and to the result (S108) of this predetermined case of user report.

Description

Situation monitoring device and situation monitoring system

Technical field

The present invention relates to a kind of situation monitoring device that is used for the situation of recognition objective object and reports this situation, and a kind of situation monitoring system, in this situation monitoring system, this situation monitoring device is connected to network, more particularly, relate to situation monitoring device and the situation monitoring system that is used for surveillance scenarios.

Background technology

Along with the progress of the broadband service of access to the Internet that continues and expansion, the concern of safety problem is day by day increased, be used for recently family and office telemonitoring apparatus for video communication commercialization and extensively the bill of sale understand this point.By use the existing apparatus for video communication of this class, can make up the intrusion that is used for observing from afar suspicious people, monitor patient for example, the elderly, and weaklings' such as child security system.

Yet, utilizing aforesaid security system, user a long way off need periodically check video data, therefore is difficult to response fast when problem takes place.Therefore, although also there is the security system that can detect and report lived object, for example by the system that proposes in the TOHKEMY 2002-74566 communique, this system can only detect and report the people's that may be suspicious people intrusion.

In addition, utilize aforesaid security system, because the privacy concern that the indiscriminate issue of video data causes, the situation that this system can be suitable for is restricted.In order to address this problem, a kind of dedicated system has been proposed, this dedicated system does not issue video itself but identification is also according to circumstances carried out suitable processing by the situation of user's appointment.

For example, in TOHKEMY 2002-352354 communique, proposed a kind of based on for example detecting not at the scene information, the system of identification and report people's under care emergency condition by acoustic frequency response or by image recognition.In addition, proposed a kind of system in Japanese kokai publication hei 10-151086 communique, this system gives a warning when detecting emergency according to the situation in video data identification user's the bathroom.

Yet all these systems all are built as the dedicated system that is used for certain unique situation, rather than can be applicable to the single assembly of multiple situation.Therefore, for example, when the plan structure is applicable to the security system of a plurality of purposes, need assembling to be used to handle a plurality of isolated plants of every kind of situation, this has increased the size and the cost of system.In addition, these dedicated system are very difficult introduces (need set up etc.) and be difficult for installing and using.In addition, the composition of family and member's situation thereof change in time, make that this type systematic is impracticable.

By contrast, along with the progress of recent image processing techniques and computing power, identification ordinary people's action and a large amount of devices of situation have been proposed.For example, the device that a kind of characteristic vector sequence that will obtain from time-series image is converted to symbol sebolic addressing and selects most possible kind based on hidden Markov model among the kind of identifying object has been proposed in Japanese kokai publication hei 6-251159 communique.In addition, also proposed much to be used to discern the technology of facial expression, for example the identification that proposes in the Japanese kokai publication hei 11-214316 communique for example pain, excitement etc. the expression device.

Yet, using this class technology to realize in the trial of common action/situation recognition device (that is, using single assembly to discern the ability of multiple situation), along with increase as the action kind of identifying object, the quantity of wrong identification increases, and causes desired processing power further to increase.

In addition, because when the emergency condition of any kind of took place, these conventional security system were all to the identical general emergency condition target of predetermined Objective of Report ground (for example security company) report, so be difficult to this device is used for a plurality of purposes.For example, in for the situation that monitors the security system that child designs, preferably give mother with child's situation report.Similarly, in situation, preferably this emergency condition is reported to security company etc. rapidly for the security system of emergency conditioies such as the generation design of the intrusion that monitors suspicious people for example or fire.Yet, be difficult to make conventional security system to be operated neatly according to this many purposes.

Summary of the invention

Design the present invention is as the solution of above-mentioned prior art problems, the present invention has such purpose: the situation monitoring device and the system that are configured to single assembly are provided cheaply, it can monitor multiple situation and report that according to circumstances in addition, it is installed easily and uses.

For achieving the above object, monitoring arrangement according to the present invention has structure as described below, that is, situation monitoring device comprises:

The place identification component, it is used to discern the infield that this device is installed;

The information storing section part, it is used to preserve the related information that makes a plurality of infields and will be associated in the situation that each infield of these a plurality of infields is discerned, and wherein, described situation is the situation corresponding with each infield of these a plurality of infields;

Determine parts, it is used for according to infield of being identified by the place identification component and the definite predetermined case that will discern of related information;

The situation identification component, whether it is used to discern the infield that this device installs and is in by the predetermined case of determining that parts are determined; And

Communication component, it is used for the recognition result to user report situation identification component.

For achieving the above object, monitoring arrangement according to the present invention has structure as described below, that is, situation monitoring device comprises:

The place identification component, it is used to discern the infield that described device is installed;

The destination object identification component, it is used for the recognition objective object;

The information storing section part, it is used to preserve the related information that makes a plurality of infields, the destination object that will discern in each infield of these a plurality of infields and will be associated in the situation that each infield of these a plurality of infields is discerned, wherein, described destination object is the destination object corresponding with each infield of these a plurality of infields, and described situation is the situation corresponding with each infield of these a plurality of infields;

Determine parts, it is used for determining the intended target object that will discern and the predetermined case that will discern according to infield of being identified by described place identification component and described related information;

The situation identification component, it is used for whether being in the described predetermined case of being determined by described definite parts at the described intended target object that the infield identification that described device is installed is determined by described definite parts; And

Communication component, it is used for the recognition result to the described situation identification component of user report.

For achieving the above object, monitoring arrangement according to the present invention has structure as described below, that is, situation monitoring device comprises:

The destination object identification component, it is used for the recognition objective object;

The information storing section part, it is used to preserve the related information that makes a plurality of destination objects and will be associated to the situation that each destination object of these a plurality of destination objects is discerned, and wherein, described situation is the situation corresponding with each destination object of these a plurality of destination objects;

Determine parts, it is used for according to destination object that is identified by described destination object identification component and the definite predetermined case that will discern of described related information;

The situation identification component, it is used to discern the described destination object that is identified by described destination object identification component and whether is in the described predetermined case of being determined by described definite parts; And

Communication component, it is used for the recognition result to the described situation identification component of user report.

For achieving the above object, monitoring arrangement according to the present invention has structure as described below, that is, situation monitoring system comprises:

Aforesaid situation monitoring device; And

Link, it is used to be connected to network,

Wherein, the Processing Algorithm of being carried out by described situation identification component is kept in the external unit that is connected to described network.

In addition, for achieving the above object, another monitoring arrangement according to the present invention has structure as described below, that is, situation monitoring device comprises:

The situation analysis parts, it is used for the situation of evaluating objects object;

Distinguish parts, it is used for differentiating predetermined case according to the output from the situation analysis parts;

The situation addressable part, it is used for based on the output from the situation analysis parts situation being converted to prearranged signals; And

Communication component, it is used for the operating position addressable part and gives the user with the output report of situation analysis parts.

According to the present invention, a kind of situation monitoring device and system that is configured to single assembly can be provided, it can monitor multiple situation and report that according to circumstances in addition, it is installed easily and uses.

According to below in conjunction with the description of the drawings, other features and advantages of the present invention will be apparent.In whole accompanying drawings, identical Reference numeral is represented same or analogous part.

Description of drawings

The accompanying drawing that is included in the instructions and constitutes the part of instructions is set forth embodiments of the invention with this explanation, is used to explain the principle of invention.

Fig. 1 is the process flow diagram that illustrates according to the treatment scheme of being carried out by situation monitoring device of first embodiment of the invention;

Fig. 2 is the figure that illustrates according to the structural outline of the situation monitoring system that comprises situation monitoring device of first embodiment of the invention;

Fig. 3 is the figure that schematically shows according to the structure of the situation monitoring device of first embodiment of the invention;

Fig. 4 is the figure that illustrates according to the hardware configuration of the situation monitoring device of first embodiment of the invention;

Fig. 5 is the figure that the control panel of controller shown in Fig. 4 is shown;

Fig. 6 is the process flow diagram that the details of the S102 of step shown in Fig. 1 is shown;

Fig. 7 is the figure that is illustrated schematically in the view data that obtains among the S602 of step shown in Fig. 6;

Fig. 8 is the process flow diagram that the details of the S103 of step shown in Fig. 1 is shown;

Fig. 9 is the figure that the last example displaying contents that shows of LCD of controller is shown;

Figure 10 be the expression infield is shown, as the figure of the example identifying information table of the relation between the people of identifying object and the situation identification content;

Figure 11 is the process flow diagram that the details of the S104 of step shown in Fig. 1 is shown;

Figure 12 is the figure that is illustrated in the last example displaying contents that shows of LCD of the S1103 of step shown in Figure 11 middle controller;

Figure 13 is the figure that the hierarchy of the software that is used for situation monitoring device is shown;

Figure 14 is the figure that the table that concerns between expression position code and the characteristic parameter is shown;

Figure 15 A, 15B and 15C are the figure that schematically shows according to the structure of the situation monitoring device of second embodiment of the invention;

Figure 16 is the process flow diagram that illustrates according to the treatment scheme of being carried out by situation monitoring device of second embodiment of the invention;

Figure 17 is the figure that the example admin table is shown;

Figure 18 is the process flow diagram that illustrates according to the treatment scheme of being carried out by situation monitoring device of third embodiment of the invention;

Figure 19 is the process flow diagram that the details of the S1802 of step shown in Figure 18 is shown;

Figure 20 illustrates the figure that expression is discerned the example identifying information table that concerns between the content as the people and the situation of identifying object;

Figure 21 illustrates the figure of remote controllers as the hardware configuration under the situation of controller;

Figure 22 is the process flow diagram that illustrates according to the treatment scheme of the situation monitoring device of fourth embodiment of the invention;

Figure 23 is the figure that the control panel of the controller shown in Fig. 4 is shown;

Figure 24 is the process flow diagram that the details of Objective of Report ground set handling (step S2203) is shown;

Figure 25 is the figure that example report control information table is shown;

Figure 26 is the figure that the example displaying contents on the LCD that is presented at controller is shown;

Figure 27 the Objective of Report on the LCD that is presented at controller is shown is provided with the figure that the example of picture shows;

Figure 28 is the figure that the example conversion table is shown;

Figure 29 is the figure that the table of the relation between expression position code and the characteristic parameter is shown;

Figure 30 is the figure that illustrates according to the structure of the situation monitoring device of fifth embodiment of the invention;

Figure 31 is the process flow diagram that the details of Objective of Report ground set handling (step S2203) is shown;

Figure 32 is the figure that the content of report control information table is shown;

Figure 33 is the figure that illustrates according to the treatment scheme summary of the situation monitoring device of sixth embodiment of the invention;

Figure 34 is the figure that example report control information table is shown;

Figure 35 is the figure that the example recognition processing software module that provides among the step S2205 is provided;

Figure 36 illustrates the process flow diagram that the details of (S2209) is handled in report;

Figure 37 illustrates the process flow diagram that the details of (S2209) is handled in report; And

Figure 38 illustrates the process flow diagram that the details of (S2209) is handled in report.

Embodiment

Describe the preferred embodiments of the present invention now with reference to the accompanying drawings in detail.

Situation monitoring device according to the present invention responds the predetermined case of this Unit Installation environment identification intended target object, and by network the change of situation is notified to the user.

First embodiment

Fig. 2 is the figure that illustrates according to the structural outline of the situation monitoring system that comprises situation monitoring device of first embodiment of the invention.

In Fig. 2, Reference numeral 201 expression situation monitoring devices, it for example is connected to networks 203 such as the Internet by for example cable modem/ADSL Modem 202 coupling arrangements such as circuit such as grade.Reference numeral 204 is for example represented mobile terminal devices such as portable phone, the situation recognition result information that its reception condition monitoring arrangement 201 sends.Reference numeral 205 is represented the server unit that the service ability of providing is provided for mail server etc. for example.

When predetermined situation change takes place in the destination object that will discern (identifying object), situation monitoring device 201 produces the text document that the predetermined information that is predetermined is shown, and according to Internet Protocol this information is sent to mail server 205 as email documents.The mail server 205 that receives this email documents arrives to mobile terminal device 204 informing E-mails as the Email transceiver with predetermined protocol.Then, mobile terminal device 204 accepts to be kept at email documents in the mail server 205 according to Email arrival information.Like this, the user who holds mobile terminal device 204 can confirm the change of the situation of situation monitoring device 201 detected identifying objects from afar.Should be pointed out that the build-in function that situation monitoring device 201 can be configured to have direct accesses network 203, in this case, situation monitoring device 201 is connected to network 203, and not by internal wiring coupling arrangement 202.In addition, the terminal of reception condition recognition result information is not limited to mobile terminal device 204, can be personal computer or PDA (personal digital assistant, Personal Digital Assistance) etc.

Fig. 3 is the figure of structural outline that the situation monitoring device 201 of first embodiment is shown.In Fig. 3, Reference numeral 301 is illustrated in the camera lens of the interior pitching (moving up and down) of framework of Reference numeral 302 expressions.Reference numeral 303 expression be used to the to flat turn external frame of motion.Camera lens 301 is with this external frame flat turn (side-to-side movement).Reference numeral 304 expression stands, the significant element that it contains except that camera comprises built-in power etc.Therefore, situation monitoring device 201 can be done compactly and be light and handy, in addition, by built-in can pitching/camera of flatting turn, situation monitoring device 201 can easily be installed in various position.

Then, the user is installed in any position that is fit to this purpose with situation monitoring device 201, monitors the situation of specific objective object.

Specifically, situation monitoring device 201 can be used for various occasions, for example following occasion:

It is neighbouring to confirm their safety to be placed on the baby.

It is neighbouring to confirm their health to be placed on patient.

It is neighbouring to confirm their safety to be placed on the elderly.

The porch that placement is in passes in and out to confirm the kinsfolk, and monitors a suspect's intrusion.

It is neighbouring to monitor a suspect's intrusion to be placed on window.

Be placed in the bathroom to confirm occupant's safety.

The above is to situation monitoring device and general summary description of using thereof according to present embodiment.Hereinafter, provide the detailed description of the processing of carrying out by this situation monitoring device with reference to the accompanying drawings.

Fig. 4 is the figure that illustrates according to the hardware configuration of the situation monitoring device of first embodiment of the invention.In Fig. 4, Reference numeral 401 expression CPU (CPU (central processing unit)), the bridge that 402 expressions have the ability of bridge joint high-speed CPU bus 403 and idling slow speed system bus 404.In addition, bridge 402 has built-in Memory Controller function, and control is to the ability of the visit of the RAM (random access storage device) 405 that is connected to bridge.

RAM 405 is made up of the required high capacity of the operation of CPU 401, high-speed memory, for example SDRAM (synchronous dram)/DDR (Double Data Rate SDRAM)/RDRAM (Rambus DRAM).In addition, RAM 405 is also as image data buffer.In addition, bridge 402 has the device that is operatively connected to system bus 404 and built-in DMAC (direct memory access controller, the Direct Memory Access C0ntroUer) function of the data transmission between the RAM405.Required various data and the director datas of being provided with of operation of EEPROM (Electrically Erasable Read Only Memory) 406 storage CPU 401.Should be pointed out that during the initialization of CPU 401, director data to be transferred to RAM 405 that afterwards, CPU 401 proceeds to handle according to the director data among the RAM 405.

Reference numeral 407 expression RTC (real-time clock, Real Time Clock) IC, it is the isolated plant that is used for execution time management/calendar management.Communication interface 408 is to connect the required processor of the internal wiring coupling arrangement (various modulator-demodular units and router) of present embodiment and situation monitoring device 201, for example can be the processor that is used to handle WLAN (IEEE802.11b/IEEE802.11a/IEEE802.11g etc.) Physical layer and lower-level protocols.The situation monitoring device 201 of present embodiment is connected to external network 203 by communication interface 408 and circuit coupling arrangement 202.Reference numeral 409 expression controllers, it is the processor of the user interface between control device and the user.Controller 409 is installed in rear surface of device stand 304 etc.

Fig. 5 is the figure that the control panel of controller shown in Fig. 4 409 is shown.Reference numeral 502 expressions are to the LCD of user's display message.Reference numeral 503-506 represents the menu selector button, is used for operating the menu that is presented on the LCD 502.Reference numeral 507,508 is represented OK button and cancel button respectively.The user uses control panel 501 that situation about will discern is set.

In addition, Reference numeral 410 expression video input blocks shown in Fig. 4, it comprises photoelectric conversion device such as CCD (charge-coupled device (CCD))/CMOS (complementary metal oxide semiconductor (CMOS)) sensor for example and controls the signal processing circuit of the drive circuit of this device, the various image rectifications of control and be used to realize flat turn/electricity and the physical construction of luffing mechanism.Reference numeral 411 expression video input interfaces, it will be converted to Digital Image Data together from the raster image data and the synchronizing signal of video input block 410 outputs, and with its buffer memory.In addition, video input interface 411 produces the signal that is used for the flatting turn of control of video input block 410/luffing mechanism.

Use the DMAC for example be built in the bridge 402 will be transported to assigned address among the RAM 405 by the Digital Image Data of video input interface 411 buffer memorys.For example, use the vision signal vertical synchronizing signal as this DMA transmission of activation trigger signal.Then, the DMA transmission that produces based on bridge 402 of CPU401 is finished look-at-me and is begun to handle the view data that is kept among the RAM 405.Should be pointed out that situation monitoring device 201 also has unshowned power supply.This power supply can be provided by for example rechargeable secondary cell, or is under the situation of wired lan in communication interface 408, is provided by Power Over Ethernet (registered trademark).

Fig. 1 is the process flow diagram that illustrates according to the treatment scheme of the situation monitoring device 201 of first embodiment.This process flow diagram is to be loaded into the program of being handled by CPU 401 among the RAM 405.

When connecting the power supply of situation monitoring device 201, in step S101, carry out various initialization process.Specifically, in step S101, the processing of network is handled and be used to be connected to execution command data load (that is, being transferred to RAM 405 from EEPROM 406), various hardware initialization.

Then, in step S102, the identification of the installation site of implementation status monitoring arrangement 201 is handled.In the present embodiment, use the installation environment of discerning this device installation by the video image information of video input block 410 inputs.

Fig. 6 is the process flow diagram that the details of step S102 shown in Figure 1 is shown.At first, in step S601, obtain video data and it is kept at the RAM405 from video input block 410.Next, in step S602, video input interface 411 activates video input block 410 and flats turn/luffing mechanism, and the view data in the zone outside the zone that obtains obtaining in step S601.Fig. 7 is the figure that is illustrated schematically in the view data that obtains among the S602 of step shown in Fig. 6.Utilize camera images to obtain the inside of process with the order of A-＞B-＞C-＞D in wide region photographs room.

Then, in step S603, whether obtaining of the view data among the determining step S602 is finished.In step S603, finish if be judged as not obtaining of view data, then handle turning back to step S601.On the contrary,, be judged as and finished obtaining of view data, then handle advancing to step S604 if in step S603.

Then, in step S604, carry out characteristic parameter extraction and handle.Should be pointed out that the processing of extracting characteristic parameter can use the various technology that proposed by picture search algorithm etc.For example, here adopt position dislocation feature extracting method (Nobuyuki Otsu, Takio Kurita, the Sekita Iwao: " Pattern Recognition " of color histogram, the local autocorrelation characteristic of high-order, Asakura Shoten, pp.165-181 (1996)) etc.Specifically, the preset range of extraction use color histogram value and local autocorrelation characteristic are as the characteristic parameter of feature.In addition, not only can use this class primitive character, can also use more senior feature extracting method.For example, can use for example window, bed, technology (the K Yanai that concrete object such as chair or desk is searched for, K.Deguchi: " Recognition of Indoor Images Using Support Relations betweenObjects ", Transactions of the Institute of Electronics, Information andCommunication Engineers, vol.J84-DII, no.8, and extract detailed features (their shape of these objects pp.1741/1752 (August2001)),, color etc.) and the particular kind of relationship between the object as characteristic parameter.Specifically, extract the characteristic parameter of the existence/location/size/color of use object as feature.Which kind of should be pointed out that at situation image data extraction characteristic parameter from be kept at RAM 405 all.

Then, in step S605, use the characteristic parameter in step S604, obtain and carry out and distinguish processing, and whether be that the previous reposition of not installing of this device is judged this installation environment corresponding to the characteristic parameter of the position of having write down.The table of the relation between referential expression characteristic parameter and the infield is carried out this judgement.Specifically, in table, exist one to have Euclidean distance when having surpassed the infield of characteristic parameter of predetermined threshold recently and also, this infield is identified as the position that situation monitoring device 201 is placed.Should be pointed out that this determination methods is not limited to by apart from distinguishing, can also use any of existing various technology.

In step S605, be the reposition that device had not before been installed if judge installation environment, then handle advancing to step S606.On the contrary, be the position that device had before been installed if in step S605, judge installation environment, then processing finishes.

Then, in step S606, registration is corresponding to the position code of this characteristic parameter.Figure 14 is the figure that the table of mutual relationship between expression position code and the characteristic parameter is shown.

" position code " is the number of this device management.When identification makes new advances the place, reassign and use still untapped arbitrary numbers." characteristic parameter " Pnm is a scalar data, is illustrated in the feature level of the feature m of position code n place.For example, under the situation of color histogram, Pnm is corresponding with the standardization histogram values in the predetermined color scope.Should be pointed out that this table for example is kept in EEPROM 406 grades.

Therefore, as mentioned above, in step S102, this device is discerned the installation site according to view data, and produces unique position code of differentiating the infield and determine whether the position of this device of installation is the both information of reposition.

Then, in step S103 shown in Figure 1, determine situation about will discern.Fig. 8 is the process flow diagram that the details of the S103 of step shown in Fig. 1 is shown.

At first, the step S801 in Fig. 8 uses the judged result of making in step S102, judges whether the position that this device is installed is the reposition that this device is installed for the first time.If it is new that judged result shows this position, then handles and advance to step S802, and begin to be provided with the operation of identifying object.On the contrary, not new if the judged result of making in step S801 shows this position, then handle advancing to step S807.

In step S802,409 prompting users are provided with identifying object by controller.Fig. 9 is the figure that the example displaying contents on the LCD 502 that is presented at controller 409 is shown.If judge the position is new, then shows on LCD 502 and points out the user that the message of identifying object is set as mentioned above.When pressing the button 504-505, show the people of previous registration in succession.When pressing the button 506, the people of current demonstration is set to identifying object.

When finishing people's selection and pressing OK button 507, will be arranged on (Figure 10) in the table as the people of the identifying object of current infield.Should be pointed out that if selected the people people in addition of previous registration, then handle advancing to from the registration of new registration picture (not shown) this people (905) as identifying object.In location registration process shown in Figure 9 (905), the people's that register video is carried out imaging, and extract the required characteristic parameter of this people who is registered of identification from this video data.In addition, in location registration process (905), the people's that prompting user input is registered attribute information (for example name etc.).

Figure 10 be the expression infield is shown, as the figure of the example identifying information table of the relation between the content of the people of identifying object and situation about will discern.Position code is a unique code of distributing to the place of identifying in infield identification processing (step S102).People's code is a unique code of distributing to the people of previous registration.Should be pointed out that for certain location (as shown in Figure 10 under the situation of position code P0002) a plurality of people as identifying object can also be set.In this case, the priority of identifying object can be added to the identifying information table.If be provided with priority, then in reality identification treatment step, people's priority is high more, and it is frequent more that he or she is identified.In addition, ad-hoc location is not provided as the specific people (under the situation as position code P0003 in Figure 10) of identifying object sometimes.

Next, in step S803, identifying object is set.In addition, if do not import in the section at the fixed time, then device is not judged and is changed, and determines actual identifying object in step S804.Then, in step S804, check the identifying information table, confirm people as identifying object.For example, be P0002 if identify the position, then this device is discerned the situation of people H1001 and H1002.Should be pointed out that under the situation for the position that specific people is not registered as identifying object the proprietary situation of this device identification.For example, this device is carried out and is detected the proprietary identification processing that enters or detect all suspicious people.

By contrast, in step S807, judge whether the infield changes.In step S807, change if judge the infield, then handle advancing to step S805.On the contrary,, judge the infield and do not change, then handle advancing to step S806 if in step S807.

Next, in step S805, by predetermined user interface, change has taken place in notice user installation place, in addition, checks the identifying information table, and similarly to the people of user report as the identifying object of this infield.Can be used as to the user interface of user notification and report to user notification and method of reporting by the demonstration on the LCD 502 of controller 409 or by the voice messaging that produces by phonetic synthesis etc. and to use.This processing is carried out by CPU401.

Next, in step S806, will on the LCD 502 of controller 409, show the preset time section, during this period of time judge whether to exist instruction from user's change destination object about whether changing the message that content is set.There is the instruction that changes destination object if the result of the judgement of carrying out shows in step S806, then handles advancing to step S802, and select identifying object.On the contrary, there is not the instruction that changes destination object in step S806, then handles advancing to step S804 if the result of the judgement of carrying out shows.Then, in above-mentioned steps S804, determined identifying object after, processing finishes.

Therefore, as mentioned above, in step S102, determine situation about will discern.Processing shown in the key diagram 1 again.Among the step S104 in Fig. 1, the content of definite situation about will discern.Figure 11 is the process flow diagram that the details of the S104 of step shown in Fig. 1 is shown.

At first, in step S1101, check the identifying information table, obtain people's code as the people of identifying object according to the position code that in step S102, obtains.In example shown in Figure 10, when identifying position code P0002, two personal settings that will have people's code H1001 and H1002 are the people as identifying object.

Then, in step S1102, judge whether these people as identifying object are provided with situation content identified in this position.If in step S1102, judge the identification situation (as under the situation of new situation) that is not arranged on this position, then handle advancing to step S1103, and carry out selection the situation content that will discern.

Figure 12 is the figure that is illustrated in the last example displaying contents that shows of LCD502 of the S1103 of step shown in Figure 11 middle controller 409.At first, the display reminding user selects the message (1201) of the situation content that will discern for the people of appointment.When pressing the button 504-505, adjoining land shows default situation identification content.When pressing the button 506, current content displayed is set to situation identification content.When the selection of having finished situation identification content and when supressing OK button 507, will be arranged on (step S1104) in the identifying information table as the people's of the identifying object of current infield situation identification content.Should be pointed out that if be provided with " acquiescence " (1202), if, then content is set to automatically acquiescence perhaps through there not being input before the predetermined amount of time from the user.Acquiescence is to specify under most of situation situation about being provided with usually automatically, for example to the identification in " turnover room " etc., eliminates the inconvenience when being provided with thus.

On the contrary, if the result of the judgement of carrying out in step S1102 shows the situation content identified that is provided with in this position, then handle and advance to step S1108, and judge whether to exist change as the people of identifying object.If the result of this judgement shows the change of existence as the people of identifying object, then handle and advance to step S1106.On the contrary, if the result of the judgement of carrying out in step S1108 shows the change that does not exist as the people of identifying object, then handle and advance to step S1107.

Then, in step S1106,, notify the user to be provided with new person, in addition, check the identifying information table as identifying object by predetermined user interface, and equally to the corresponding situation identification of user report content.Can use by the demonstration on the LCD 502 of controller 409 or by the voice messaging that produces by phonetic synthesis etc. to user notification and method of reporting as user interface to user notification and report.Carry out this processing by CPU 401.

Then, in step S1107, will show predetermined amount of time, in this time period, judge whether to exist instruction from user's change destination object about the message of the content that whether changes setting.There is the instruction that changes destination object if judged result shows, then handles advancing to step S1103.On the contrary, there is not the instruction that changes destination object in step S1107, then handles advancing to step S1105 if the result of the judgement of carrying out shows.

Then, in step S1103 and step S1104, carry out the processing that this situation identification content is set as newly being provided with.If do not having the user to import through before the predetermined amount of time, then this device is judged the change that does not have content, and determines to want the content of actual situation about discerning in step S1105.Then, in step S1105, check the identifying information table, and be provided as the people's of identifying object situation identification content.

Therefore, as mentioned above,, determined people and situation content identified, and carried out actual situation identification according to determined condition and handle as identifying object by the processing shown in Fig. 1 from step S102 to step S104.

Next, in step S105, for example, detect the main change in the background area of obtained view data, and whether the infield of estimate of situation monitoring arrangement moves.Can use the different information between the frame easily to extract change in this background area with underload.If the result of the judgement of making in step S105 shows that the infield changes, then handle and turn back to step S102, and begin the identification processing of infield again.On the contrary, do not change, then handle advancing to step S106 if the result of the judgement of making in step S105 shows the infield.Event configuration is only become where necessary just execution in step S105, can reduce to handle load thus.

Next, in step S106 shown in Figure 1, follow the trail of the people who in step S103, determines, and discern this people's predetermined case.Realize this trackings processing by the flatting turn of video input interface 411 control cameras/luffing mechanism.In step S106, if for example P0002 is identified as this position, then install to as identifying object people H0001 implementation status " you have fallen down? " identification, to as identifying object people H0002 implementation status " you have put thing at you in the mouth? " identification.Here, required people's identification is handled can adopt in the various prior aries any one (for example for this step, S.Akamatsu: " Research Trends in Face Recognition by Computer ", Transactions of the Institute of Electronics, Information andCommunication Engineers, vol.80 No.3, pp.257-266 (March 1997)).Extract the characteristic parameter of differentiating that the individual is required at aforesaid period of registration.

In addition, any one of various existing methods can be used for the situation recognition technology carried out at step S106.For example, enter into the room or go out, or detect suspicious people and enter into the room, result's realization situation easily identification of then using the individual that carries out by facial recognition techniques etc. to differentiate from the room if detect specific people.In addition, a lot of methods (for example, Japanese kokai publication hei 11-214316 communique and TOHKEMY 2001-307246 communique) about qualification situations such as for example feeling under the weather or fall down have been proposed.

In addition, according to the identification of the manual work that in traditional sign language identification etc., proposes, and, can also discern the baby foreign matter has been put into his or her situation in the mouth according to detect the information that obtains by face about the position of mouth.The software of the algorithm that execution is handled about this identification is stored in the server unit 205 on EEPROM 406 or the network, and is loaded into RAM 405 before (step S106) beginning is handled in identification.

Software according to the situation monitoring device 201 of present embodiment has for example hierarchy shown in the image pattern 13.Reference numeral 1301 expression RTOS (real time operating system), its Processing tasks management, scheduling etc.Reference numeral 1302 indication device drivers, it for example handles the device control of video input interface 411 grades.Reference numeral 1303 expression middlewares, it handles relevant signal and the communication protocol of carrying out with present embodiment of processing.Reference numeral 1304 expression application software.The situation identification relevant with present embodiment is handled required software and is installed as middleware 1303.The software that has desirable algorithm by dynamic load and the unloading on demand of the loader program of CPU 401.

Specifically, when in step S1105, having determined situation about will discern, in above-mentioned example, from EEPROM 406 load be used to discern people H0001 situation " people has fallen down? " with the situation of people H0002 " people is put something at you in the mouth? " two kinds of process software modules.By limiting the identification situation with the device installation environment or as the people of identifying object, can avoid discerning the complicacy of Processing Algorithm, and marked down the real system of constructing.

In addition, by this process software being stored on another server unit that is connected to network, can also provide system cheaply with bigger extendability.In this case, when determining the content of situation about will discern (step S1105), CPU 401 uses for example FTP (file transfer protocol (FTP)) or HTTP communication protocols such as (HTML (Hypertext Markup Language)) visit service specified apparatus, and sends the software module of appointment to RAM 406 from this server unit.In step S106 shown in Figure 1, this software is as the situation recognition processing software.By stores processor software module on server unit, can reduce the capacity of EEPROM 406, in addition, implement device function expansion (Processing Algorithm expansion) easily.

Then, in step S107 shown in Figure 1, make judgement to whether identifying predetermined case.Identify predetermined case if the result of this judgement shows, then handle advancing to step S108, and CPU 401 reports on the implementation are handled.For example, can by communication interface 408 this report processing be sent as character information according to e-mail, instant message or other agreement.At this moment, except that character information, can also send visual information.In addition, if this device can be configured to the user in the same house that this device is installed, then can notify the generation of user's emergency condition by unshowned audio interface.

On the contrary, do not identify predetermined case in step S107, then handle turning back to step S105, and check possibility to judge that the infield has been moved if the result of the judgement of making shows.If the infield does not change, then continue this situation identification and handle (step S106).

Like this, as mentioned above, in the present embodiment, according to recognition result, determine situation about will discern automatically and will become the people of identifying object, in addition the infield of situation monitoring device, according to recognition result, suitable identification situation is set automatically as the people of identifying object.Therefore, can realize using the cheap situation monitoring device of few resources.In addition,, just can provide the situation surveillance coverage that is fit to this position only by device is placed on the optional position, and because handle various situations by single assembly, so it is simple and easy to use.

Second embodiment

Figure 15 A, 15B and 15C are the figure that schematically shows according to the structure of the situation monitoring device of second embodiment of the invention.The main portion of the Reference numeral 1501 expression situation monitoring devices shown in Figure 15 A, it comprises the structure shown in first embodiment.Reference numeral 1502a-1502c shown in Figure 15 A-15C represents to be called the stand (stand) of support (cradle), and main portion is arranged in this support.Main portion 1501 is equiped with the interface and the interface that is used for input information that is used for providing from support 1502 power supply.Support 1502 is equipped with the device of preserving the information that is used for unique identification of power and support.For example cheap information record carrier such as serial ROM can be used as this device, and can communicate by letter with main portion 1501 by serial line interface.

Only be the processing of step S102 shown in Figure 1 by the situation monitoring device of second embodiment processing operation of carrying out and the difference of operating by the processing of first embodiment execution.

Figure 16 illustrates the process flow diagram by the treatment scheme of situation monitoring device execution according to second embodiment.

At first, in step S1601, CPU 401 is arranged on serial ROM in the support 1502 and the ID data of playback record on ROM by unshowned serial interface access.Here, the ID code of being read is meant the unique code in dress place, Dingan County.Then, in step S1602, check the table of management ID code.

Then, in step S1603, judge whether the infield of this ID code is reposition.Should be pointed out that the hypothesis admin table is stored among the EEPROM 406.Figure 17 is the figure that the example admin table is shown, and records the corresponding ID code of optional position code with the situation monitoring device management in this table.If it is reposition that the result of the judgement of making in step S1603 shows the infield of ID code, then handle and advance to step S1604, and with in the admin table of this ID code record in EEPROM 406.On the contrary, not reposition if the result of the judgement of making in step S1603 shows the infield of ID code, then handle stopping.

Under the situation of present embodiment, by main portion 1501 is arranged on the support 1502, identify the support of setting like this, therefore, identify the position that this device is installed.Should be pointed out that for identifying object of determining according to the position and situation about will discern, it is identical with the step of first embodiment that (step S102) treatment step is afterwards handled in infield identification.

In addition, under the situation of present embodiment, the user is wanting a plurality of positions mounting bracket of operating position monitoring arrangement in advance, and according to the only mobile main portion 1501 of the purpose that will use this device.For example, 1502a is placed on the entrance hall with support, support 1502b is placed on child's room.Therefore, for example, if main portion 1501 is arranged on the support 1502a, the then situation recognition mode operation of this device to monitor suspicious people and enter, if main portion 1501 is arranged on the support 1502b, then this device is to monitor the situation recognition mode operation of child safety.

As previously mentioned, according to second embodiment, use and come the straightforward procedure of recognizing site can accurately discern the infield by obtaining the ID code.

The 3rd embodiment

Figure 18 is the process flow diagram that illustrates according to the treatment scheme of being carried out by situation monitoring device of third embodiment of the invention.This process flow diagram is the program that is loaded among the RAM 405 and is handled by CPU 401.Under the situation of present embodiment, hardware configuration is also identical with first embodiment of the invention, therefore only provides the explanation that does not exist together with first embodiment.

When connecting the power supply of situation monitoring device, in step S1801, carry out various initialization process.Specifically, in step S1801, carry out initialization that is used for load instructions data (sending data to RAM 405), hardware and the processing that network connects from EEPROM 406.

Then, in step S1802, select the content of identifying object and at the situation about will discern of this identifying object.Figure 19 is the process flow diagram that the details of step S1802 is shown.

In step S1901, the prompting user is provided with identifying object by controller 409.Fig. 9 is the figure that is illustrated in the example displaying contents that shows on the LCD 502 of controller 409.At first, the display reminding user selects the message (901) of identifying object.When pressing the button 504-505, adjoining land shows the people of previous registration.When pressing the button 506, the people of current demonstration is set to identifying object.

When finishing people's selection and pressing OK button 507, will be recorded in (step S1902) in the table as the people of the identifying object of current infield.Should be pointed out that if select people outside the people of previous registration then as first embodiment, device enters that register from new registration picture 905 will be as the people's of identifying object pattern.

Figure 20 illustrates the figure of expression as the example identifying information table of the relation between the people of identifying object and the situation about will discern.

Code as the people of identifying object is a unique code of distributing to the previous people who registered.In addition, the assignment of code that acquires a special sense can be given people as identifying object.For example, in example shown in Figure 20, H9999 represents that everyone is the special code of target.When selecting this code, everyone is discerned predetermined case.

Then, in step S1903, the people's that will select as identifying object type and situation identification content report to the user.Can be used as to the user interface of user notification and report to user notification and method of reporting by the demonstration on the LCD 502 of controller 409 or by the voice messaging that produces by phonetic synthesis etc. and to use.

In step S1905, predetermined amount of time is carried out in the demonstration that will the inquiry user whether will change selected situation identification content, carries out in this predetermined amount of time about whether there being the judgement from the instruction of the selected situation identification of will changing of user content.If the result of this judgement shows the instruction of existence from the selected situation identification of will changing of user content, then handle and advance to step S1906.On the contrary, if the result of this judgement shows the instruction that does not exist from the selected situation identification of will changing of user content, then processing finishes.

Then, in step S1906, be provided as everyone content of situation about will discern of identifying object.For example, when pressing the button 504-505, adjoining land shows default situation identification content.When pressing the button 506, current content displayed is set to situation identification content.When the selection of having finished situation identification content and when pressing OK button 507, will be arranged on (step S1804) in the identifying information table as the people's of the identifying object of current infield situation identification content.Should be pointed out that if be set to " acquiescence " (1202) if or through there not being input before the predetermined amount of time from the user, then content is set to automatically acquiescence.Acquiescence is to specify under most of situation situation about being provided with usually automatically, for example to the identification in " turnover room " etc., eliminates the inconvenience when being provided with thus.

When the situation of having finished is discerned being provided with of content, begin actual identifying operation.At first, in step S1803 shown in Figure 180, carry out the processing of detection and Identification identifying object.Here, also as described in first embodiment, any existing people's recognizer etc. may be used to the processing of recognition objective object.Should be pointed out that if detected people is the new person who is not arranged in the identifying information table, then carry out this people is arranged on processing in the identifying information table in that step (S1802) is set.Yet the judgement that whether moves to set handling in step S1804 can be set in advance by the user.That is,, can also be set to ignore this people routinely or carry out the previous default situations identification of determining by device when detecting the man-hour that is not arranged in the table.

Then, in step S1805, check the identifying information table, and definite people's who is identified situation identification content.Then, in step S1806, handle at the situation identification content implementation status identification of in step S1805, determining.As first embodiment, the situation identification of carrying out here can also be used any realization the in the various existing methods.Then, in step S1807, when determining to have identified predetermined people's predetermined identification,, in step S1808, notify the user as first embodiment.

Therefore, as mentioned above,, automatically determine everyone situation about will discern, and suitable situation identification is set automatically as identifying object for the 3rd embodiment.Therefore, may realize using the cheap system of seldom installing resource.In addition,, just can provide the situation surveillance coverage that is fit to this position only by device is placed on the optional position, and because handle various situations by single assembly, so it is simple and easy to use.

Although should be pointed out that from the aspect as the people of identifying object previous embodiment has been described, the present invention is not limited to this situation, and for example, the present invention is applicable to any identifying object such as for example animal or special object etc.For example, under the situation of special object, device can be used for identification and report, and for example this object " is removed from the precalculated position " or the situation of " disappearing ".The identification of moving or occurring can easily realize by using existing mode-matching technique.

In addition, although from the situation aspect of using video information recognition device installation site and recognition objective object previous embodiment has been described, the present invention is not limited to this, for example, can be configured to use video information sensitive information in addition to come the identification situation.In addition, the present invention can use the combination of video information and other sensitive information.Information by voice, infrared ray, electromagnetic wave or the set of other detection technology can be used as sensitive information.

In addition, although from using the aspect that concerns between common table definition infield, identifying object and the situation identification content that previous embodiment has been described, the present invention is not limited to this, for example, can use more senior recognition technology to judge.For example, can use such technology: according to the identification of the special object that is in the infield or appear at the people's of this position discriminating, and the result who uses this identification and discriminating to the meaning of position (promptly, this place is child's room or the room that patient is sleeping) carry out senior distinguishing, to determine identifying object and situation identification content.

In addition, although from beginning that by the change of using obtained background the identification processing aspect in this Unit Installation place has been illustrated above-mentioned first embodiment, the present invention is not limited to this, for example, can use other technology.For example, can use such method: machinery or optical sensor are installed to the bottom of this device, detect and when lift and put down this device, in this time starting position identification after a while.In addition, can use such method: when the predetermined button on the controller is set up, the processing of beginning recognizing site.Under any one situation of these two kinds of methods, handle with the identification of executing location continuously and to compare, can reduce to handle load.In addition, can use such method: use RTC 407 to handle with predetermined time interval automatic starting position identification.In this case, compare, can reduce to handle load equally with continuous executing location identification processing.

In addition, although from by the different support identification aspect, infield that is provided with situation monitoring device above-mentioned second embodiment being described, the present invention is not limited to this, for example, can use other technology.For example, can built-in wireless identification tag receiver be set, for example make and to be attached to the infield that the wireless identification tag in precalculated position in the house comes pick-up unit by detection this device.In this case, can provide wireless identification tag, make that thus it can be easily and realize reliable infield detectability cheaply by paster etc.In addition, can with the form of GPS (GPS) etc. to this device be provided with built-in, independently positional information obtains the unit, and is used to obtain the position of this device in house etc. by the information that this unit obtains.In this case, by in conjunction with GPS position probing result and image detection result, can provide more accurate infield recognition performance.

In addition, although, can expect from using internet E-mail the foregoing description to be described as the media aspect of the change of the situation of report identifying object, if the use email protocol, then may be on real-time Transmission the generation problem.Therefore, can use other agreement.For example, by using instant message protocol etc., can realize the snap information report.In addition, replace utilizing text message report, the master unit that the present invention can be arranged to this device is provided with built-in telephony capability and phonetic synthesis ability, so that directly get in touch report information by phone and distant place.

In addition, although from camera (what is called is flatted turn/the pitching camera) aspect that use has a mechanical control structure the foregoing description has been described, the present invention is not limited to this, for example, can use pantoscope to replace.In this case, need not mechanically replenish identifying object, but instead, use the view data that obtains with wide-angle can realize identical processing.

In addition, although provide control module aspect that the foregoing description has been described with input/output capabilities as controller from master unit to this device, but the present invention is not limited to this, for example can use remote controllers of separating with this device etc. as control module.Figure 21 illustrates the figure of remote controllers as the hardware configuration under the situation of control module.In Figure 21, has only controller 2109 with different about the illustrated hardware configuration (Fig. 4) of above-mentioned first embodiment.Like this, Reference numeral 2109b, c represent to be used to control the communication unit of the communication between controller I/F 2109 and the master unit, and this communication unit for example uses wave point such as electromagnetic wave or infrared and radio interface to realize.Use the low-speed wireless transmission medium can be easily and realize these communication units cheaply.Reference numeral 2109a represents controller I/F, and it is equipped with the demonstration/input function of the controller 409 shown in first embodiment.The remote controllers 2109d volume in light weight that comprises controller I/F 2109a and communication unit 2109b is little.The user can be provided with the required parameter of operation of this device by operation remote controllers 2109d.With aforementioned manner controller and master unit branch are arranged, this provides greater flexibility in Unit Installation, has also strengthened its convenience.

In addition, the present invention can be configured to use the required parameter of network settings operation.For example, the present invention can provide HTTP (HTML (Hypertext Markup Language)) server-capabilities, provides based on network user interface based on HTTP to the user by communication interface 2108.Http server can be used as the part of middleware (Reference numeral 1303 shown in Figure 13) and comprises, and activates the preset parameter setting program based on http response from input at a distance.The user can be provided with the required parameter of operation of master unit from for example ordinary terminals such as portable phone, PDA, personal computer.In addition, can carry out this setting operation from afar.In addition, because device does not need to provide nonshared control unit, so it is realized marked downly.

In addition, carry out whole processing aspect the foregoing description has been described although comprise and be built in processor the situation monitoring device from use, but the present invention is not limited to this, for example, can combine with personal computer or other external treatment device and realize the present invention.In this case, have only reading in of view data to use isolated plant to finish, for example other processing such as image recognition, communication all uses the personal computer resource to finish.For example, by for example using wave point such as bluetooth, or for example HPA power line communication interfaces such as (plug-in alliance of family, HomePower Plug Alliance) etc. connects isolated plant and personal computer, can realize aforesaid same facility.Certainly, the distributed situation monitoring system of this function not only can be used for realizing, can also realize by the help of multiple other internet equipment by making of personal computer.

In addition, although from using CPU to realize that by software processes aspect of the present invention has illustrated the foregoing description, the present invention is not limited to this, for example, can also handle by specialized hardware and realize the present invention.In this case, it is corresponding to be used for the object data of internal circuit of the object data of internal circuit of the algorithm of situation identification and definite FPGA (field programmable gate array, Field Programmable Gate Array) or definite reconfigurable processor.When having determined situation about will discern (step S1105), system control processor from EEPROM 406 or the server unit etc. that is connected to network with data load to specialized hardware.Then, specialized hardware is handled according to the identification that the object data that is loaded begins pre-defined algorithm.

Therefore, as mentioned above,,, realize reliable situation monitoring device because limit the content of situation about will discern according to the infield of device own according to present embodiment marked downly.In addition, because the automatic diagnosis infield, and the definite in view of the above suitable situation that will discern, so the user can discern multiple situation by single assembly is installed simply.

In addition, according to the foregoing description, because according to Unit Installation site limitation identifying object and situation identification content, so realize more reliable situation monitoring device marked downly.In addition, because the automatic diagnosis infield, and determine suitable identifying object and situation about will discern in view of the above, so the user can discern desirable situation with height reliability by this device is installed simply.

In addition, according to the foregoing description, because according to identifying object limited case identification content, so realize reliable situation monitoring device marked downly.In addition, the user can discern desirable situation by near the destination object that simply device is placed on identification or the very big position of possibility of the destination object of identification appearance.

In addition, according to the foregoing description, realize this device marked downly, and do not need sensor special etc.In addition, only just executing location identification processing where necessary can reduce to handle load.Consequently, can use the starting position identification processing reliably of simpler method.In addition, can carry out the location recognition processing reliably and not increase sensor special etc.

In addition, the mistake in the recognition function that can prevent to produce by the wrong identification of infield.Mistake in the recognition function that can also prevent to produce by the wrong identification of identifying object.Can also be provided for the user interface of configuration information at reasonable time, improve convenience thus.

In addition, according to the foregoing description,, therefore improved convenience because when changing the infield, can be provided for the user interface of configuration information automatically.Can also just think the user interface that changes the infield even just think just to be provided in case of necessity configuration information to improve convenience thus.Can also just think just to be provided in case of necessity the user interface of configuration information according to the recognition result of identifying object.

In addition,, just think just to be provided in case of necessity the user interface of configuration information, improved convenience, and make and to discern according to the situation that the priority realization is more wished according to the foregoing description.Can also use the simple method infield of recognition device reliably.

In addition, the foregoing description makes user's required parameter of operation of setting device more easily, also makes user's required parameter of operation of setting device from afar.Can also be from the required parameter of the operation of ordinary terminal setting device.In addition, can also realize having the more compatible device of bigger extended capability cheaply.

The 4th embodiment

Figure 22 is the figure that illustrates according to the summary of the treatment scheme of being carried out by situation monitoring device of fourth embodiment of the invention.This treatment scheme is to be carried in the program of being handled by CPU401 among the RAM 405.

When connecting the power supply of situation monitoring device 201, in step S2201, carry out various initialization process.Specifically, execution command data load (that is, being transferred to RAM 405 from EEPROM 406), hardware initialization are connected with network.

Next, in step S2202, carry out the processing of differentiating the infield.In the present embodiment, use the infield of video image information identification device, this video image information uses 410 inputs of video input block.Should be understood that, the details of (step S2202) differentiate to be handled with identical in above-mentioned details illustrated in fig. 6 about first embodiment in the infield, so omit its explanation (identical (referring to Figure 29) among the table of representing the relation between position code and the characteristic parameter and Figure 14) here.

As selection, replace automatically performing the discriminating of infield, this device can be configured to make the user manually carry out this task.In this case, the user imports the information of pointing out the infield by the unshowned interface on the control panel 501 that is presented at controller 409.

In addition, when the Objective of Report ground of having selected situation identification content or report media, when not using the information relevant, can cancel the infield and differentiate processing (step S2202) or place set handling with the infield.

Next, in step S2203, the Objective of Report ground when identifying predetermined case is set.Figure 24 is the process flow diagram (step S2203) that the details of Objective of Report ground set handling is shown.

In step S2401, the interface (not shown) that whether the inquiry user is changed setting is presented on the control panel 501 of controller 409.Change under the situation of setting the configuration information on new regulation Objective of Report ground more in following step (S2402-S2405) the user.

At first, in step S2402, identifying object is set by controller 409 (Reference numeral 901 among Fig. 9) prompting user.Should be pointed out that Fig. 9 illustrates the example displaying contents on the LCD 2301 (Figure 23) that is presented at controller 409.

Here, when pressing the button 504-505, adjoining land shows the people (902-904) of registered in advance.When pressing the button 506, the people of current demonstration is set to the target that reporting event takes place.When the selection of performance identification content and when pressing OK button 507, will be arranged in the report control information table (Figure 25) as the people of the identifying object of current infield.

Report control information table is the table data that are stored in EEPROM 406 grades, when the Objective of Report ground that illustrates after a while this table of quantitative check really.In other words, by checking that this shows the Objective of Report ground between the control report incident emergence period.Should be pointed out that the man-hour outside the people who selects registered in advance, then handle advancing to from the people (905) of new registration picture (not shown) registration as identifying object.In this location registration process (905), the people's that register video is carried out imaging, and from this video data, extract the required characteristic parameter of this people who is registered of identification.In addition, in this location registration process (905), the people's that prompting user input is registered attribute information (for example name etc.).

Figure 25 illustrates explanation as the people of identifying object, the content of report and the example report control information table of the relation between the Objective of Report ground.Position code is a unique code of distributing to the position of identifying among the identification step S2202 of infield.People's code is a unique code of distributing to the people of registered in advance.

Should be pointed out that at a position and a plurality of people can be set as identifying object (situation of position code P0002 as shown in Figure 25).In this case, the priority of identifying object can be added to report control information table.If set up priority, then in the processing (step S2205) of analyzing the situation content, the people's of higher priority situation is carried out more frequent identification handle.In addition, at ad-hoc location the specific people as identifying object (as the situation of position code P0004 among Figure 25) is not set sometimes.In this case, when identifying the predetermined case of this position (for example the someone invades), reports on the implementation are handled in step S2209, and no matter the output of the identification of objects process of step S2206.

Next, in step S2403, at the situation content of wanting reports on the implementation as everyone setting of identifying object.Figure 26 illustrates an example of the displaying contents on the LCD 2301 that is presented at controller 409.When pressing the button 504-505, adjoining land shows the identification situation content of registered in advance.When pressing the button 506, the situation of current demonstration is set to that a situation arises at the report as the people of identifying object.

When the selection of performance content and when pressing OK button 507, will be arranged in the situation content of current infield in the report control information table (Figure 25).Should be pointed out that when " acquiescence " (2602) are set or when in the section at the fixed time less than from user's input the time, content is set to default setting automatically.Acquiescence is to specify under most of situation situation about being provided with usually automatically, and the inconvenience when being provided with is eliminated in for example identification in " turnover room " etc. thus.

Next, in step S2404, the Objective of Report ground that is provided for reporting at each identifying object and situation content thereof.The example that Figure 27 the Objective of Report on the LCD2301 that is presented at controller 409 is shown is provided with picture shows.When pressing the button 504-505, adjoining land shows the Objective of Report ground of registered in advance.When pressing the button 506, with the Objective of Report of current demonstration the Objective of Report ground when being set to identify situation as the people of identifying object.

When the selection of finishing situation about will discern and when pressing OK button 507, with the Objective of Report be arranged in the report control information table (Figure 25).Should be pointed out that if " new registration " (2705) are set, then on predetermined control panel 501, show unshowned predetermined interface, and carry out the registration of latest report destination.In addition, can also a plurality of Objectives of Report ground be set for single situation.

The report control information table (Figure 25) of ad-hoc location is set in step S2402-S2404 as mentioned above.Use Figure 25 to explain object lesson: if position code is P0002, then will inquire " people has fallen down? " report condition for people H1001 is set,, then reports this result to " father " if identify this condition.

In addition, will inquire " people has been put something at him in the mouth? " " people is in prohibited area? " report condition for people H1002 is set,, then reports this result to " mother " and " elder brother " if identify the situation of this condition.Should be pointed out that under the situation of the position of not registering specific people the situation of the proprietary situation of system identification or this position (for example generation of fire etc.).For example, in Figure 25,, carry out the identification of for example proprietary detection that enters or suspicious people's detection and handle, invade, then make report this result to " security company " if detect the someone at position P0004.

As mentioned above, in step S2203, with identifying object, situation about will discern and the corresponding Objective of Report be recorded in the report control information table.

Next, in step S2204, judge whether the variation that a situation arises.Here, for example, system uses the difference between the frame of view data to detect the change of image in the zone of identifying object.If in this step, confirm change above presumptive area, the then processing of the situation content of beginning evaluating objects object in step S2205.Should be pointed out that in step S2204, for example, can use the change of the information detection case outside the view data.For example, can use such technology: use sensor such as utilizing infrared ray to have the people to invade.In this step, utilize the simple change (for example people's appearance) of handling detection case, and the only processing (step S2205) of just execution analysis situation content where necessary.

When detecting the change of situation, in step S2205, the processing of the change of execution analysis situation.In step S2205, follow the tracks of the people in the sensing range, and analyze this people's situation.Should be pointed out that for needed situation recognition technology, can use any in the existing the whole bag of tricks.For example, use by the independent identification result of face detections/facial recognition techniques generation and can realize easily that specific people enters the detection that room or suspicious people enter the room.In addition, proposed to be used to discern a lot of technology of facial expression, for example the identification that proposes in the Japanese kokai publication hei 11-214316 communique for example pain, excitement etc. the expression device.

In addition, the baby is placed on his or she situation in the mouth with foreign matter and also can comes out according to the identification of the manual work that proposes in traditional synthetic language identification etc. and according to the information Recognition about the position of mouth that the detection by face obtains.In addition, in Japanese kokai publication hei 6-251159 communique, proposed and to be converted to symbol sebolic addressing from the characteristic vector sequence that time-series image obtains, and selected the device of most possible kind based on hidden Markov model among the kind of identifying object.

In addition, in Japanese kokai publication hei 01-268570 communique, the method according to view data identification fire has been proposed.In step S2205, carry out the processing module that comprises these a plurality of situation recognizers, determine the output valve of described processing, and whether output predetermined case has taken place.

Figure 35 is the figure that an example of the recognition processing software module that provides among the step S2205 is provided.Reference numeral 3501-3505 correspond respectively to the posture that is used for the people module identified, be used to detect the effractor of presumptive area module, be used to discern people's expression module, be used to discern the people predetermined action module and be used for the environment-identification situation (promptly, the for example identification of particular case such as fire) module, it handles the view data by video input block 410 imagings (and being stored among the RAM 405).

Described module is carried out time-division or continued operation as the middleware task.In this step, the output valve of described module is as the analysis result of the data that are encoded to predetermined format is exported.Should be pointed out that these modules can also realize as application specific hardware modules.In this case, hardware module is connected to system bus 404, and handles the view data that is stored in RAM 405 at the fixed time.

In step S2206, identification is as the people of the identifying object of situation about identifying in the processing (step S2205) of the situation of analysis content.Can adopt and variously of the prior artly anyly (for example carry out the processing relevant with the required people's of this step identification, S.Akamatsu: " Research Trends in Face Recognition by Computer ", Transactions of the Institute of Electronics, Information andCommunication Engineers, vol.80 No.3, pp.257-266 (March 1997)).Should be pointed out that and during aforesaid individual's new registration, extract the characteristic parameter (Reference numeral 905 shown in Fig. 9) of differentiating that the individual is required.

In step S2207, audit report control information table, and judge whether to identify reportable predetermined people's predetermined case, if identify, then in step S2208, carry out the processing that the content of this situation is encoded.Should be understood that, although the description to the situation content reported in Figure 25 illustrates as the literal of expressing predetermined case, in practice, the unshowned code corresponding to the predetermined code data (that is the code of the corresponding situation of unique appointment) that the processing (step S2206) of the situation of analysis content is exported is recorded in the table.

Next, the processing that the content of situation is encoded (step S2208) use is converted to book character information from the output of the processing (step S2206) of the situation of analysis content with the situation content.For example, this conversion can provide predetermined conversion table, obtains this character information according to the output of the processing (step S2206) of the content of analyzing situation and the content of this table.

Figure 28 is the figure that the example conversion table is shown.For example, situation recognition processing module R0001 (corresponding to the identification module shown in Figure 35 3501) is at an individual identification and export three kinds of situations.Situation recognition processing module R0003 (corresponding to the identification module shown in Figure 35 3503) is at an individual identification and export two kinds of situations.If obtain predetermined output from recognition processing module (the Reference numeral 3501-3505 shown in Figure 35), then check conversion table, and export corresponding predetermined sequence of characters.Like this, by checking conversion table, the processing (step S2208) that the output valve (predetermined code) of the processing (step S2205) of operational analysis situation content is encoded to the content of situation obtains character information.Should be pointed out that the hypothesis conversion table is recorded among the EEPROM 406 in advance.

Figure 36 illustrates the details that (step S2209) handled in report.In this step, based on the output of the processing (step S2202) of differentiating the infield, analyze the situation content processing (step S2205) output and differentiate the output of the processing (step S2206) of identifying object, and, determine to want the informant by in step S3601, checking the report control information table (Figure 25) that is stored among the EEPROM 406.

Next, in step S3602, the character information that will obtain in situation encoding process (step S2208) sends to wants the informant.Send this character information according to for example agreement such as Email, instant message by communication interface 408.Should be pointed out that under the situation of Email, by for the Objective of Report set up the selection that specific email address realizes Objective of Report ground.

Should be pointed out that when after the master unit power supply, the processing of repeated execution of steps S2204-S2209, and when identifying predetermined case, to wanting in this case the informant to report the content of situation.

Explanation according to the front is appreciated that according to present embodiment, when identifying predetermined case, can easily grasp the content of this situation, in addition, according to this Unit Installation place, identifying object and situation about will discern, can give suitable Objective of Report ground with the context notification of this situation.

The 5th embodiment

Figure 30 is the figure that illustrates according to the structure of the situation monitoring device of fifth embodiment of the invention.The hardware configuration of present embodiment only is that with the hardware configuration difference of first embodiment shown in Fig. 4 communication interface 408 is different.

Reference numeral 3001 expression CPU.Reference numeral 3302 expression bridges, it has the ability with high-speed CPU bus 3003 and idling slow speed system bus 3004 bridge joints.

In addition, bridge 3002 has the internal memory controller function, and controls the ability to the visit of the RAM 3005 that is connected to bridge thus.RAM 3005 is the required storeies of the operation of CPU 3001, is made up of for example high capacity, high-speed memory such as SDRAM, DDR, RDRAM.In addition, RAM 3005 also is used as image data buffer etc.

In addition, bridge 3002 has the device that is operatively connected to system bus 3004 and the built-in DMA function of the data transmission between the RAM3005.EEPROM 3006 is required director data and the various memory of data that are provided with of operation that are used to store CPU 3001.

Reference numeral 3007 expression RTC IC, it is the isolated plant that is used for execution time management/calendar management.Reference numeral 3009 expression controllers, it is the processor of the user interface between control master unit and the user.Controller 3009 is installed in the rear surface etc. of stand 304 of master unit.Reference numeral 3010 expression video input blocks, it comprises photoelectric conversion device such as CCD/CMOS sensor for example and controls the signal processing circuit of the drive circuit of this device, the various image rectifications of control and be used to realize flat turn/electricity and the physical construction of luffing mechanism.

Reference numeral 3011 expression video input interfaces, it will be converted to Digital Image Data together from the raster image data and the synchronizing signal of video input block 3010 outputs, and with its buffer memory.In addition, video input interface 3011 has to produce and is used for control of video input block 3010 and flats turn/ability of the signal of luffing mechanism.For example, use the DMA that is built in the bridge 3002, will send to the presumptive address among the RAM 3005 by the Digital Image Data of video input interface 3011 buffer memorys.

For example, can use the vision signal vertical synchronizing signal to transmit as this DMA of activation trigger signal.Then, the DMA that CPU 3001 produces based on bridge 3002 transmits and finishes look-at-me, begins to handle the view data that is kept among the RAM 3005.Should be pointed out that situation monitoring device also has unshowned power supply.

Reference numeral 3008a represents first communication interface, and it has the ability that is connected to Wireless/wired LAN ip network.Reference numeral 3008b has the ability that is directly connected to existing telephone network or mobile telephone network.In the present embodiment, select to report media according to the object that will discern and situation thereof.Specifically, when the report generalized case,, use for example Internet Protocol such as Email, instant message report information according to urgency level.If the situation is critical, then directly by report situation contents such as phones.

Figure 31 is the process flow diagram that illustrates according to the details of the Objective of Report ground set handling (step S2203) of present embodiment.In this embodiment, compare, added new report media set handling (step S3105) with above-mentioned the 4th embodiment.Other step S3101-S3104 is identical with the step S2401-S2404 that illustrates in the 4th embodiment, and omits its explanation.

Figure 32 is the figure that the content of the report control information table that uses in the present embodiment is shown.In report media set handling (step S3105), the report media is set according to identification place, identifying object and situation content.Under the situation of Figure 32, to for example " people has fallen down? " this exceptional emergency is specified " passing through phone " report " to detect suspicious people ".On the contrary, to for example " people is in pain status? ", " people has been put something in his mouth? " " people is in prohibited area? " this general urgent situation is specified " passing through instant message ", and this not too urgent situation of for example " coming in and going out and confirm " is specified " passing through Email ".

Then will as the information that in step S3105, is provided with of above-mentioned the 4th embodiment as report control information table record in EEPROM 3006.

Handle in (step S2208) at the situation content encoding of present embodiment, the situation content is encoded according to the report media that in report media set handling (S2203), is provided with.For example, if be set to report media with " instant message " or " Email ", coded character information then, if be set to report media with " phone ", coded voice information then.Handle by unshowned phonetic synthesis, the coding of voice messaging produces and the corresponding speech data of character string shown in the table shown in Figure 28.Should be pointed out that for example can use the ITU standard G.723 or efficient compression protocol G.729 compress this speech data.Then, consequent voice messaging temporarily is stored in RAM 3005 grades.

Figure 37 illustrates the figure that the details of (S2209) is handled in report.In step S3701, inspection is stored in the report control information table (Figure 32) among the EEPROM 3006, and determines predetermined Objective of Report ground according to the output of the processing (step S2205) of the content of the output of the processing (step S2202) of differentiating the infield, the output of processing (step S2206) of differentiating identifying object and the situation of analysis.

Next, in step S3702, same audit report control information table, and determine the report media.Then, by selected report media (3008a or 3008b) coded message of expression content is sent to the Objective of Report ground of selecting in step S3702.In other words, if " instant message ", " Email " etc. are chosen as the report media, then send report content according to Internet Protocol by the first communication interface 3008a.If " phone " is chosen as the report media, the then automatic phone of calling out predetermined Objective of Report ground, after confirming the tinkle of bells, the speech data that will be kept among the RAM3005 by second communication interface 3008b sends as direct sound signal.

Therefore, according to present embodiment, can realize the reporting capabilities that matches with urgency by the predetermined Objective of Report ground of according to circumstances selecting of report media notice.

The 6th embodiment

Figure 33 is the figure that illustrates according to the summary of the treatment scheme of being carried out by situation monitoring device of sixth embodiment of the invention.This process flow diagram is the program that is carried among the RAM 3005 and is handled by CPU3001.Hardware configuration according to the situation monitoring device of present embodiment is identical with the hardware configuration of the 5th embodiment, therefore only provides the explanation that does not exist together between the two.

Figure 33 is the process flow diagram of details that the Objective of Report ground set handling (step S2203) of present embodiment is shown.In the present embodiment, compare, increased report newly and determined time set handling step (S3306) with the Objective of Report ground set handling of the 5th embodiment.Remaining step S3301-S3305 is identical with the step S3101-S3105 that illustrates among the 4th embodiment respectively, and therefore not existing together between them only be described.

Figure 34 is the figure that illustrates according to an example of the report control information table of present embodiment.Being provided with corresponding to the temporal information of identification situation and identifying under the situation of predetermined case, determine the time that this identifies, and report to Objective of Report ground according to the content that this time will be discerned situation.For example, under the situation of position code P0003, if detect the effractor between time 08:00 and 24:00, then this system is configured to by the email notification mother.On the contrary, if detecting the effractor under the identical condition between time 24:00 and 08:00, then this system is configured to notify security company.As the 4th embodiment, the information that is provided with in step S3306 is as reporting that the control information table record is in EEPROM 3006.

Figure 38 illustrates the process flow diagram of handling the details of (S2209) according to the report of present embodiment.In step S3801, from RTC 3007, obtain identifying the time of predetermined case.In step S3802, based on the identification place, as the people of identifying object, identification situation and the time that in step S3801, obtains, check the report control information table (Figure 34) that is stored among the EEPROM 3006, and determine predetermined Objective of Report ground.

In addition, in step S3803, same audit report control information table, and determine predetermined report media.In step S3804, the coded data in step S2208 that the content of situation will be shown by the report media of determining in step S3803 sends to the Objective of Report ground of determining in step S3802.

From above stated specification, be appreciated that the use present embodiment,, can use more suitable report media to report to more suitable Objective of Report ground based on the time of identifying predetermined case.

Although should be pointed out that the present invention is not limited to this from the people has been illustrated previous embodiment as the identifying object aspect, identifying object can be animal, special object or anything else.For example, under the situation of special object, can discern and report that this object for example " is removed from the precalculated position " or the situation of " disappearing ".Can easily realize moving or the identification of appearance/disappearance by using existing mode-matching technique.

Although in the aforementioned embodiment, report control information table is specified Objective of Report ground and report media according to this Unit Installation place, identifying object, time and situation, and the present invention is not limited to this.According to purpose, can provide according at least one table of specifying Objective of Report ground or reporting media in infield, identifying object, time and the situation.

Although from by the processing aspect that provides the identification of a plurality of situations to handle and to use the output of these processing to analyze the analysis situation content of situation content previous embodiment being described, the present invention is not limited to this, can use any method.For example, more general recognizer can be installed, and identification target complete situation.

Although be encoded to predetermined sequence of characters or the audio-frequency information aspect has illustrated previous embodiment from the result of the processing that will analyze the situation content, the present invention is not limited to this, and these results can be converted to other kinds of information.For example, this information can be converted to the chart data of this information of schematic illustration, and this chart data is sent as report data.In addition, replace to use such method: will report as warning information from the optical mode of preset light sources by network-reporting.

Although from the situation aspect of using video information to discern this Unit Installation place and identifying object above-mentioned the 4th embodiment has been described, the present invention is not limited to this, can use the sensitive information outside the video information to come the identification situation.In addition, can use the combination of video information and other sensitive information to come the identification situation.Can use various sensitive informations, for example audio-frequency information, infrared ray information and electromagnetic information are as other sensitive information.

Although the media that changes from the situation of reporting identifying object is that aspects such as the Internet email, instant message and phone have illustrated previous embodiment, the present invention is not limited to this, if necessary can use other media.

Although from using controller 409 to set up report control information table aspect previous embodiment has been described,, can have used the required parameter of network settings operation as selection.In this case, for example, master unit can have HTTP (HTML (Hypertext Markup Language)) server-capabilities, and provides based on network user interface by communication interface 3008 to the user.Http server is comprised as a kind of middleware, and it is based on the actuator-activated preset parameter setting program of http response from the distant place.

In this case, the user can be provided with the required parameter of operation of master unit from for example ordinary terminals such as portable phone, PDA or personal computer, in addition, can carry out this setting operation from afar.

Carry out whole processing aspect that for example identification handles previous embodiment be described although be built in processor the master unit from use, the present invention can also be for example the external treatment device is combined realizes with for example personal computer etc.In this case, have only reading in of view data to use isolated plant to finish, for example image recognition is handled use personal computer resource with residue such as communicate by letter and is realized.

For example, by use wave point such as bluetooth for example or for example the power line communication interface etc. of HPA (plug-in alliance of family) connect isolated plant and personal computer, can realize identical facility.Certainly, the distributed situation monitoring system of this function not only can be used for realizing, can also realize by the help of various other internet equipments by making of personal computer.

Although from using CPU to realize that by software processes aspect of the present invention has illustrated previous embodiment, the present invention is not limited to this, for example, can also handle by specialized hardware and realize.In this case, the object data of the internal circuit of the object data of the algorithm that is used for situation identification and the internal circuit of definite FPGA (field programmable gate array) or definite reconfigurable processor is corresponding.System control processor from EEPROM 406 or the server unit etc. that is connected to network with data load to specialized hardware.Then, specialized hardware is handled according to the identification that the object data that is loaded begins pre-defined algorithm.

Although have camera (what is called is flatted turn/the pitching camera) aspect of mechanical control structure from use the foregoing description has been described, the present invention is not limited to this, for example, can use pantoscope to replace.In this case, need not mechanically replenish identifying object, but as an alternative, can use the view data that obtains with wide-angle to realize identical processing.

Other embodiment

Should be pointed out that the present invention is applicable to system that is made up of multiple arrangement (for example, principal computer, interface arrangement, reader, printer etc.) or the equipment of being made up of single assembly.

In addition, by the software program of the function that realizes previous embodiment is provided directly or indirectly to system or equipment, read the program code that is provided, carry out this program code then and can realize the present invention with the computing machine (or CPU or MPU) of system or equipment.

In this case, the function of previous embodiment is realized by the program code that reads from storage medium itself, and stores storage medium formation the present invention of this program code.

Can be used to provide the example of the storage medium of program code to have: the memory card of floppy disk (floppydisk, registered trademark), hard disk, CD, magneto-optic disk, CD-ROM, CD-R, tape, nonvolatile type, ROM etc.

Except these are realized the situation according to the aforementioned functional of the foregoing description by carrying out the program codes that read by computing machine, the present invention also comprises such situation: operation OS (operating system on computers, operating system) etc. carry out all or part of actual treatment according to this code instructions, make and handle the function that realizes previous embodiment by this.

In addition, after the program that will read from storage medium writes the expansion board that is inserted into computing machine or writes the storer that is arranged on the functional expansion unit that is connected to computing machine, be installed in all or part of actual treatment of execution such as CPU on expansion board or the functional expansion unit, the feasible function that can realize previous embodiment by this processing.

The present invention is not limited to the foregoing description, can make various variations and change within the spirit and scope of the present invention.Therefore, for informing public's scope of the present invention, make appended claim.

Priority claim

The application requires the right of priority of Japanese patent application 2005-164875 number of Japanese patent application 2004-167544 number submitted on June 4th, 2004 and submission on June 3rd, 2005, and its whole contents is contained in this by reference.

Claims (26)

1. situation monitoring device, it comprises:

The place identification component, it is used to discern the infield that described device is installed;

The information storing section part, it is used to preserve the related information that makes a plurality of infields and will be associated in the situation that each infield of these a plurality of infields is discerned, and wherein, described situation is the situation corresponding with each infield of these a plurality of infields;

Determine parts, it is used for according to infield of being identified by described place identification component and the definite predetermined case that will discern of described related information;

The situation identification component, it is used to discern the infield that described device installs and whether is in the described predetermined case of being determined by described definite parts; And

Communication component, it is used for the recognition result to the described situation identification component of user report.

2. situation monitoring device, it comprises:

The place identification component, it is used to discern the infield that described device is installed;

The destination object identification component, it is used for the recognition objective object;

The information storing section part, it is used to preserve the related information that makes a plurality of infields, the destination object that will discern in each infield of these a plurality of infields and will be associated in the situation that each infield of these a plurality of infields is discerned, wherein, described destination object is the destination object corresponding with each infield of these a plurality of infields, and described situation is the situation corresponding with each infield of these a plurality of infields;

Determine parts, it is used for determining the intended target object that will discern and the predetermined case that will discern according to infield of being identified by described place identification component and described related information;

The situation identification component, it is used for whether being in the described predetermined case of being determined by described definite parts at the described intended target object that the infield identification that described device is installed is determined by described definite parts; And

Communication component, it is used for the recognition result to the described situation identification component of user report.

3. situation monitoring device, it comprises:

The destination object identification component, it is used for the recognition objective object;

The information storing section part, it is used to preserve the related information that makes a plurality of destination objects and will be associated to the situation that each destination object of these a plurality of destination objects is discerned, and wherein, described situation is the situation corresponding with each destination object of these a plurality of destination objects;

Determine parts, it is used for according to destination object that is identified by described destination object identification component and the definite predetermined case that will discern of described related information;

The situation identification component, it is used to discern the described destination object that is identified by described destination object identification component and whether is in the described predetermined case of being determined by described definite parts; And

Communication component, it is used for the recognition result to the described situation identification component of user report.

4. according to any one described situation monitoring device of claim 1-3, it is characterized in that, described situation identification component comprises the parts of obtaining that are used to obtain view data, and according to obtaining the view data identification that parts obtain and whether be in described predetermined case by described.

5. according to any one described situation monitoring device of claim 1 and 2, it is characterized in that described place identification component comprises the parts of obtaining that are used to obtain view data, and according to obtaining the view data that parts obtain and discern described infield by described.

6. according to any one described situation monitoring device of claim 1 and 2, it is characterized in that when detecting predetermined condition, described place identification component begins the identification of described infield to be handled.

7. situation monitoring device according to claim 6 is characterized in that, described place identification component comprises the parts of sensing image, and described predetermined condition is the change in the image that senses.

8. situation monitoring device according to claim 6 is characterized in that, described place identification component comprises the sensor that moves that is used to detect described device, and described predetermined condition is the change in the described sensor information.

9. situation monitoring device according to claim 6 is characterized in that, also comprises the required parameter control device of operation that is used to import described device, and described predetermined condition is the specific input of user to described controller.

10. situation monitoring device according to claim 6 is characterized in that, described predetermined condition is the energising of described device.

11. situation monitoring device according to claim 6 is characterized in that, described predetermined condition is the predetermined time.

12. any one the described situation monitoring device according to claim 1 and 2 is characterized in that, described communication component has also identified the transfer of described infield to the described place of user report identification component.

13. situation monitoring device according to claim 2 is characterized in that, described communication component also changes to the described intended target object that user report will be discerned.

14. situation monitoring device according to claim 2 is characterized in that, also comprises the required parameter control device of operation that is used to import described device, is being presented under the predetermined condition interface that the prompting user upgrades described related information on the described controller.

15. situation monitoring device according to claim 14 is characterized in that, described predetermined condition is the transfer that described place identification component identifies described infield.

16. situation monitoring device according to claim 14 is characterized in that, described predetermined condition is that described place identification component identifies the infield of not registering in described related information.

17. situation monitoring device according to claim 14 is characterized in that, described predetermined condition is that described destination object identification component identifies the destination object of not registering in described related information.

18. any one described situation monitoring device according to claim 1 and 2, it is characterized in that, when described place identification component identified the infield of not registering in described related information, described definite parts were defined as predetermined default situations the described predetermined case that will discern.

19. any one described situation monitoring device according to claim 2 and 3, it is characterized in that, when described destination object identification component identified the destination object of not registering in described related information, described definite parts were defined as predetermined default situations the described predetermined case that will discern.

20. situation monitoring device according to claim 2, it is characterized in that, when there was a plurality of destination object in the infield of being identified by described place identification component, whether described situation identification component was in described predetermined case according to predetermined priority identification.

21. any one described situation monitoring device according to claim 1 and 2, it is characterized in that, described device has the structure in main portion of being distributed in and the periphery, and the information that is used for described place identification component identification infield is kept at described periphery.

22. any one described situation monitoring device according to claim 1 and 2, it is characterized in that, described place identification component also comprises be used for the communication component that communicates with external unit or the external device (ED) that is provided with near described device, and described place identification component is according to the information of being preserved by described external unit or the described infield of information Recognition of being preserved by described external device (ED).

23. any one described situation monitoring device according to claim 1-3, it is characterized in that, the communication component that also comprises the controller that separates with described device and be used for communicating by letter with described controller wherein, uses described controller to carry out the setting of the required parameter of the operation of described device.

24. any one described situation monitoring device according to claim 1-3, it is characterized in that, also comprise the link and the server unit that are used to be connected to network, wherein, use described server unit to carry out the setting of the required parameter of the operation of described device from external unit.

25. situation monitoring device according to claim 24 is characterized in that, described server unit is HTTP (HTML (Hypertext Markup Language)) server.

26. a situation monitoring system, it comprises:

Any one described situation monitoring device according to claim 1-3; And

Link, it is used to be connected to network,

Wherein, the Processing Algorithm of being carried out by described situation identification component is kept in the external unit that is connected to described network.

Images