JP2007004277A - Monitoring system, monitoring program and computer-readable recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system, a monitoring program and a computer-readable recording medium that can more reliably determine a particular situation caused by an intruder's or some other movement. <P>SOLUTION: In the monitoring system 11, a camera part 50 continuously images a fixed area. An image movement direction detection part 21a detects the movement direction of an object moving in the area imaged by the camera part 50. A memory 24 stores in advance an object movement direction required in a particular situation as a particular movement direction. A main control part 21 compares the movement direction detected by the image movement direction detection part 21a with the particular movement direction stored in the memory 24, and if they match, determines that the particular situation has occurred. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a monitoring device that functions as a security camera, a monitoring program, and a computer-readable recording medium.

  In recent years, crimes have increased and there are many opportunities for them to occur, and the demand for means for protecting them has increased.

  Locking the entrance door and locking the windows is the most important part of crime prevention, especially when living alone or on a business trip, or staying in a single room while traveling. The current situation is that there remain concerns.

Patent Documents 1 and 2 disclose a technique of using a portable terminal equipped with an imaging unit as a surveillance camera. In the monitoring apparatus described in Patent Document 1, data is transmitted when motion of an image is detected. In the monitoring device described in Patent Document 2, photographing is started when it is placed on the charging stand.
JP 2004-165829 A (publication date: June 10, 2004) JP 2004-120067 (publication date April 15, 2004)

  However, with the function of simply checking only changes in images and sounds and transmitting a photographed image, the monitoring device is activated even in operations such as drinking water, changing clothes, and turning over. Therefore, it is difficult to reliably determine a situation to be judged (referred to as a specific situation) such as an intrusion of a suspicious person such as an empty nest or a robbery.

  The present invention has been made in view of the above problems, and its purpose is a monitoring device that can more reliably determine a situation (specific situation) caused by some movement, represented by “intrusion of someone” or the like. It is to realize a monitoring program and a computer-readable recording medium.

  In order to solve the above-described problems, a monitoring apparatus according to the present invention moves in a monitoring apparatus that determines a situation related to a monitoring target, within an imaging unit that captures a fixed range and the range that is captured by the imaging unit. Detected by a moving direction detector that detects the moving direction of a thing, a specific moving direction storage that stores in advance the moving direction of an object that is always performed when a specific situation occurs, and the moving direction detector And a determination unit for comparing the specific movement direction stored in the specific movement direction storage unit and determining that the specific situation has occurred.

  With the above configuration, the imaging unit captures a fixed range. The moving direction detection unit detects the moving direction of the moving object within the range imaged by the imaging unit. The specific movement direction storage unit stores in advance a movement direction of an object that is always performed when a specific situation occurs as a specific movement direction. The determination unit determines that the specific situation has occurred by comparing the movement direction detected by the movement direction detection unit with the specific movement direction stored in the specific movement direction storage unit.

  For example, in an example in which the specific situation is a situation where “an intruder has entered a house”, a direction (referred to as D1) that is regarded as an intrusion direction is determined in advance, and a moving object in that direction is detected. Is regarded as an intruder and is not regarded as an intruder if it detects something that moves in a direction that does not match D1.

  Therefore, it is possible to reduce the possibility of misinterpreting movements in unrelated directions as “a specific situation has occurred” (for example, “someone has invaded”), and movement in a direction that an intruder always makes is possible. The occurrence of a specific situation can be correctly determined based on the movement in a related direction, such as being able to correctly determine an intruder when it occurs.

  Therefore, there is an effect that it is possible to realize a monitoring apparatus that can more reliably determine the situation.

  The determination unit determines that the specific situation has occurred, for example, because the movement direction detected by the movement direction detection unit completely matches the specific movement direction stored in the specific movement direction storage unit. Cases and similar cases.

  In addition to the above configuration, the monitoring device according to the present invention is portable and has a communication function.

  With the above structure, it is portable and has a communication function. Therefore, in addition to the effects of the above-described configuration, it can be used as a general portable communication device, and the convenience is high.

  For example, the monitoring device can be provided with a telephone communication function. Thereby, in addition to the effect by the above configuration, it can be used as a general mobile phone, and is more convenient.

  In the monitoring device according to the present invention, in addition to the above-described configuration, the determination unit determines whether the monitoring device is supplied with power from outside the device, and activates the monitoring function if supplied. If not supplied, the monitoring function is turned off.

  With the above configuration, the monitoring function is activated if the monitoring apparatus is supplied with power from outside the apparatus, and the monitoring function is turned off if power is not supplied. Therefore, when using a portable monitoring device, the monitoring function is turned off when the monitoring function is unnecessary, such as when the device is not being supplied with power from outside the device, and at home when power is supplied from outside the device. When monitoring is required, the monitoring function is turned on. Therefore, in addition to the effect by the above configuration, there is an effect that the monitoring function can be easily turned on and off according to the situation.

  For example, the monitoring function can be activated only when the monitoring device is connected to the charger, such as when the monitoring device is placed on a charging stand. Thereby, the monitoring function can be turned on and off more easily according to the situation.

  In addition to the above configuration, the monitoring device according to the present invention further includes an operation time designation unit that receives a designation of a monitoring time that is a time for operating the monitoring function, and the determination unit is currently designated as the operation time designation. It is characterized in that it is determined whether or not it is the monitoring time designated by the section, the monitoring function is activated if it is during the monitoring time, and the monitoring function is turned off if it is not during the monitoring time.

  With the above configuration, the monitoring function is activated if the current time is the monitoring time designated by the operation time designating unit, and the monitoring function is turned off if it is not during the monitoring time. That is, the user can specify the time for the monitoring function to operate. Therefore, if the user sets in advance, for example, the monitoring function is turned off when the monitoring function is unnecessary, such as during normal daytime, and the monitoring function is turned on when monitoring is required, such as at home at night. it can. Therefore, in addition to the effect by the above configuration, there is an effect that the monitoring function can be easily turned on and off according to the situation.

  In addition to the above configuration, the monitoring device according to the present invention determines that the specific situation has occurred only when the determination unit checks the size of the object and the size is equal to or greater than a predetermined value. It is characterized by doing.

  With the above configuration, it is determined that the specific situation has occurred only when the size of the object is greater than or equal to a predetermined value. Therefore, it is possible to reduce the risk of erroneously determining that a specific situation has occurred by detecting the movement of small insects such as flies flying in the room or small animals kept as pets. Therefore, in addition to the effect of the above configuration, there is an effect that the accuracy of determination can be increased.

  In addition to the above configuration, the monitoring device according to the present invention is characterized in that the imaging unit has sensitivity in an infrared region.

  With the above configuration, the photographing unit has sensitivity in the infrared region. Therefore, in addition to the effect of the above configuration, there is an effect that it is possible to monitor well even in the dark such as at night.

  Further, in addition to the above configuration, the monitoring device according to the present invention functions as a photographing unit for normal photographing by attaching the infrared shielding filter to the photographing unit having sensitivity in the infrared region. By removing the infrared shielding filter, it functions as an imaging unit for infrared region imaging.

  With the above configuration, the photographing unit functions as a photographing unit for normal photographing by attaching an infrared shielding filter to the photographing unit having sensitivity in the infrared region, and for infrared region photographing by removing the infrared shielding filter. Work as a photography department.

  The infrared shading filter may be attached / detached manually by the user, or may be driven by a solenoid or a motor when the user operates a button. In addition, a means for detecting the surrounding brightness may be provided so that the infrared light shielding filter is automatically attached when the surrounding becomes dark.

  Therefore, it is not necessary to provide both the photographing unit for normal photographing and the photographing unit for infrared region photographing. Therefore, in addition to the effect by the above configuration, the configuration can be simplified.

  In addition to the above-described configuration, the monitoring device according to the present invention includes a first imaging unit in which the imaging unit has sensitivity in the infrared region and an imaging in which sensitivity is in the infrared region separately from the first imaging unit. And a second imaging unit that works for normal imaging by attaching an infrared shielding filter to the unit, and the monitoring device includes a camera switching unit that switches between the first and second imaging units. Yes.

  With the above-described configuration, the image capturing unit normally attaches an infrared light shielding filter to the image capturing unit having sensitivity in the infrared region separately from the first image capturing unit having sensitivity in the infrared region and the first image capturing unit. And a second photographing unit that works for photographing. The first and second photographing units are switched by the camera switching unit. Therefore, it is not necessary to attach and remove the infrared light shielding filter to one normal photographing part. Therefore, in addition to the effect by the above configuration, there is an effect that it can be easily switched according to the brightness.

  In addition to the above-described configuration, the monitoring apparatus according to the present invention includes a light source that emits at least infrared rays toward the imaging range of the imaging unit.

  With the above configuration, the light source emits at least infrared rays toward the imaging range of the imaging unit. Therefore, it becomes easy to grasp the monitoring target during infrared imaging. Therefore, in addition to the effect of the above configuration, there is an effect that it can be monitored more effectively in a dark place.

  In addition to the above configuration, the monitoring apparatus according to the present invention includes a specific movement direction designating unit for the user to designate the specific movement direction.

  With the above configuration, the user can specify a specific movement direction via the specific movement direction designating unit. Therefore, in addition to the effect by the above configuration, there is an effect that it is possible to flexibly cope with monitoring in various directions.

  In addition to the above-described configuration, the monitoring apparatus according to the present invention includes an image storage unit that stores an image captured by the imaging unit. When the determination unit determines that the specific situation has occurred, the image storage unit An image captured by the imaging unit is stored in the storage unit.

  With the above configuration, when the specific situation occurs, an image captured by the imaging unit is stored. Therefore, the details of the situation can be confirmed later. Therefore, in addition to the effect of the above configuration, there is an effect that the monitoring result can be easily confirmed.

  In addition to the above configuration, the monitoring device according to the present invention includes a communication unit that notifies the contact information registered in advance that the specific situation has occurred, and the determination unit has generated the specific situation. If it is determined, the communication unit is notified of the occurrence of the specific situation to the contact.

  With the above configuration, when the specific situation occurs, the registered contact is notified, for example, by telephone or the like that the specific situation has occurred. Therefore, if you monitor at the destination and register the user's home, etc., even if the user himself / herself is not aware of the occurrence of a specific situation, the user's family who received the notification, for example, by answering the phone Can be noticed and dealt with. Therefore, in addition to the effect of the above configuration, there is an effect that the notified side can more easily know the occurrence of the specific situation.

  In addition to the above-described configuration, the monitoring device according to the present invention includes a personal information storage unit that stores user personal information. When the determination unit determines that the specific situation has occurred, the monitoring unit includes: The contact information is notified to the personal information.

  With the above configuration, when the specific situation occurs, the personal information is notified to the registered contact address, for example, by telephone. Therefore, if you monitor at the destination and register the user's home, etc., personal information can be transmitted automatically even if the user himself / herself is not able to convey personal information well by notification of the telephone etc. . Therefore, the user's family or the like can grasp who the communication is from, for example, by answering a call. Therefore, in addition to the effect by the above configuration, the notified side can easily know the contents of the specific situation.

  In addition to the above configuration, the monitoring apparatus according to the present invention includes a current location storage unit that stores the current location of the user. When the determination unit determines that the specific situation has occurred, It is characterized in that the current location is notified to a contact.

  With the above configuration, when the specific situation occurs, the current location is notified to the registered contact address, for example, by telephone. Therefore, by monitoring at the destination and registering the user's home, etc., the current location can be automatically transmitted even if the user himself / herself is unable to successfully convey the current location by notification such as a telephone call. Therefore, it is possible to grasp where the user's family and the like are taking place, for example, by answering a phone call. Therefore, in addition to the effect by the above configuration, the notified side can easily know the contents of the specific situation.

  A monitoring program according to the present invention is a program for causing a computer to function as a movement direction detection unit, a specific movement direction storage unit, and a determination unit in any of the monitoring devices described above.

  A computer-readable recording medium storing the monitoring program according to the present invention stores the monitoring program.

  As described above, the monitoring device according to the present invention includes an imaging unit that captures a fixed range, a moving direction detection unit that detects a moving direction of a moving object within the range captured by the imaging unit, and a specific situation. The moving direction of the object that is always performed when the error occurs is stored in advance as a specific moving direction storage unit, the moving direction detected by the moving direction detection unit, and the specific moving direction storage unit. And a determination unit that determines that the specific situation has occurred by comparing the specific movement direction.

  A monitoring program according to the present invention is a program that causes a computer to function as a movement direction detection unit, a specific movement direction storage unit, and a determination unit in any of the monitoring devices described above.

  A computer-readable recording medium storing the monitoring program according to the present invention is configured to store the monitoring program.

  This reduces the possibility of misinterpreting movements in unrelated directions as “a specific situation has occurred” (for example, “someone has entered”) and moves in a direction that an intruder must make. For example, it is possible to correctly determine that an intruder has occurred, so that it is possible to correctly determine the occurrence of a specific situation based on movement in a related direction. Therefore, it is possible to realize a monitoring device, a monitoring program, and a computer-readable recording medium that can more reliably determine the situation.

  As shown in FIG. 1, the monitoring device 11 includes a mobile terminal 12 and a charger 13 as a charging stand. The mobile terminal 12 is a camera-equipped mobile terminal and is a camera-equipped mobile phone. The monitoring device 11 functions as a security camera that watches an intruder into a house or the like.

  First, the outline will be described. In the monitoring apparatus 11 of the present embodiment, the camera unit 50 always captures a fixed range. The image movement direction detection unit 21a detects the movement direction of the moving object within the range captured by the camera unit 50. The memory 24 stores in advance a moving direction of an object that is always performed when a specific situation occurs as a specific moving direction. The main control unit 21 compares the movement direction detected by the image movement direction detection unit 21a with the specific movement direction stored in the memory 24, and determines that a specific situation has occurred if they match. Thereby, it is possible to realize a monitoring device, a monitoring program, and a computer-readable recording medium that can more reliably determine a specific situation caused by some movement such as an intruder. This will be described below in order.

  The mobile terminal 12 can be switched between a normal mode that is a mode used as a normal mobile phone and a monitoring mode that is a mode used as a monitoring device. When a situation that you want to detect (specific situation) occurs, such as an intruder, a notification process such as an alarm (a process that clears the occurrence on the spot) or a process that transmits the occurrence to another place (the third party you want to know about the occurrence) A function (security function) for performing processing to be transmitted to a person).

  The mobile terminal 12 includes a main control unit 21. The main control unit 21 functions as a determination unit. The main control unit 21 includes an image moving direction detection unit 21a inside. The image movement direction detection unit 21a functions as a movement direction detection unit.

  The main control unit 21 and the following elements are combined.

  The radio unit 31 and the communication control unit 32 function as a communication unit. In cooperation with the microphone 33, the speaker 34, and the audio processing unit 35, a function as a mobile phone is realized.

  The operation unit 26 is various keys and pointing devices for inputting data such as characters and numerical values, and functions as a specific movement direction designation unit. Includes phone number pushbuttons.

  The program memory 23 stores various software including a monitoring program, which will be described later, at the time of execution.

  The memory 24 functions as a specific movement direction storage unit, a personal information storage unit, and a current location storage unit. In addition, user data such as a telephone number, a telephone directory, sound information, a preset message, and address data are preset (stored).

  The large capacity memory 25 functions as an image storage unit. An image taken by the camera unit 50 can be stored here.

  The display unit 26 displays various images. A monitoring direction setting screen described later is also displayed.

  The camera unit 50 functions as a photographing unit. The camera unit 50 includes an optical system 51 and an image sensor 52. The camera unit 50 is coupled to the main control unit 21 by a video signal processing unit 53. The video signal processing unit 53 performs image processing and sensitivity adjustment described later.

  A GPS (global positioning system) function unit 40 receives current position information.

  The RFID reader / writer 41 reads and writes information with an RFID (Radio Frequency Identification) (not shown).

  The data communication interface 29 exchanges data by connecting to other devices.

  The charge control unit 28 and the battery 27 are a power supply system. The charge control unit 28 receives the main power and charges the battery 27 via the voltage conversion unit 71 and the charge control unit 72 provided in the charger 13 and the power supply connection unit 30 provided in the portable terminal. .

  The infrared lamp 54 functions as a light source that emits at least infrared rays.

  The monitoring device 11 can perform monitoring based on an image obtained from the camera unit 50. Details thereof will be described later.

  The monitoring process of the present invention can be performed by hardware or software, but in the present embodiment, it is performed by software (monitoring program). The software is recorded in a recording device such as a hard disk, read into a memory at the time of execution, and executed by a CPU (central processing unit). The main control unit 21 and the image movement direction detection unit 21a are functional modules realized by the software and the CPU.

  In this embodiment, an imaging device having sufficient sensitivity to infrared rays is provided as imaging means so that it can be photographed without requiring a special light source at night. Conceivable.

  An example in which one camera is also used is shown in FIGS. As shown in FIG. 2, the camera unit 50 a has a configuration in which a lens system 55, a lens barrel unit 56, and an imaging device 52 are joined in order, and an infrared shielding filter 57 is inserted inside the lens barrel unit 56. FIG. 3 is a modification of FIG. 2, and in the camera unit 50 b, an infrared light shielding filter 57 is attached to the tip of the lens system 55.

  Since the monitoring apparatus is a mobile terminal with a camera, the camera unit 50a and the camera unit 50b can capture a normal daytime video (image). In general, an image sensor has a certain sensitivity to the infrared region, but a normal electronic camera is basically capable of taking pictures in the daytime as beautifully as possible. In order to shield infrared rays, an infrared shielding filter 57 is provided. In this case, of course, if the color reproducibility is not considered much, a filter is unnecessary and the camera is sensitive to infrared rays. Therefore, when photographing in places where there is visible light or illumination, attach the previous filter, and remove the filter in dark places at night when there is no illumination, as shown by A in FIGS. Provide means such as.

  Alternatively, an example in which a dedicated camera is prepared is shown in FIG. As shown in the figure, a normal daytime video (image) can be taken with an original camera of a camera-equipped mobile terminal, and a separate infrared camera is provided exclusively for night use.

  In the configuration of FIG. 4, the camera unit 50a functions as a second imaging unit that does not have sensitivity in the infrared region. The camera unit 50c functions as a first photographing unit having sensitivity in the infrared region. The camera unit 50c has a configuration in which an optical filter 58 is inserted at the insertion position of the infrared light shielding filter 57 in the camera unit 50a. The configuration of the optical filter 58 is not particularly limited.

  In use, the main control unit 21 switches the camera unit 50a and the camera unit 50c by driving the camera switching unit 53a manually or automatically by the user. The camera switching unit 53a can be appropriately configured by a switch element such as a transistor, and the description of the configuration is omitted.

  The above-described camera switching and the above-described filter attachment / detachment switching may be performed manually using means such as a lever. Moreover, you may operate automatically using a solenoid or a motor drive. In this case, control may be performed by providing a dedicated button or selecting from a function menu display.

  As described above, the infrared lamp 54 functions as an infrared light source. That is, when shooting in a dark state at night, the imaging quality may deteriorate due to insufficient light quantity. Therefore, in this way, an infrared illumination device (infrared light emitting lamp) can be mounted on a part of the camera body or the charger 13 so as to be turned on manually or automatically when the infrared photographing mode is entered. This lamp may be an LED (light emitting diode).

  This lamp also has a red light characteristic, and it can also be used as a notification means described later using the characteristic.

  When a single image sensor is also used for filter switching, there is a risk of insufficient imaging sensitivity in dark places. If necessary, the main control unit 21 automatically adjusts the gain to the video signal processing unit 53 (AGC, Auto Gain Control), thereby increasing the sensitivity of the image sensor from that during normal imaging. Adjustments are made.

  The detection of an abnormal situation is based on the fact that the image shown in the camera has moved, but in this embodiment, the moving direction of the image is detected to improve the accuracy of the security function. As a basic idea, the security function is set to start when an object moves from the outside of the room to the inside of the room.

  Detects the direction of image movement that would normally not be possible, such as while sleeping, and increases the accuracy of the security function. For example, the direction from the window toward the room. That is, when this monitoring apparatus is installed in a window of a room, the security function is started only when there is a change in the image moving from the outside of the window to the inside of the room.

  When staying at a hotel, carry around the stationary charger 13, and when going to bed, install this monitoring device in the charger 13 and change to the monitoring mode.

  The change to the monitoring mode may be performed by the user (meaning the portable terminal owner, the user, or the operator) by operating the operation unit 22, or the portable terminal is connected to the charger 13 to start charging, or The main control unit 21 may detect when the power supply starts from the outside and change to the monitoring mode. However, the monitoring mode may be set even when the built-in battery is used.

  Conversely, the change to the normal mode may be performed by the user by operating the operation unit 22, or the main control unit 21 terminates charging when the portable terminal is disconnected from the charger 13 or ends external power supply. May be detected and changed to the normal mode. However, the normal mode may be set even when charging or when power is supplied from the outside.

  Next, the movement direction to be monitored in the monitoring mode, that is, the movement direction (specific movement direction) that triggers the start of the security function is selected. This is the right-to-left, left-to-right, top-to-bottom, bottom-to-top, top-right to bottom-left, bottom-left to top-right, top-left to bottom-right, bottom-right to top-left When there is a movement in the direction, a selection is made as to whether or not it is considered that a specific situation (in this case, a suspicious person has entered) has occurred. The specific movement direction can be designated by the user via the operation unit 22, and the data is stored in the memory 24.

  The display unit 26 displays a monitoring direction setting screen in response to a call from the user in order to perform the selection operation in the specific movement direction. FIG. 6 shows the state of the screen. When the user operates the operation unit 22 (see FIG. 1), one or more directions to be monitored are selected from the icons 91, the selected one sets the mark 92 to “◯”, and the one not selected is the mark. 92 is set to “x”. In this example, only the right-pointing arrow is “◯”. A plurality of selections can be made.

  Thereby, the specific movement direction can be arbitrarily set, and convenience is improved. In this example, it is set to monitor what moves from left to right. In addition, even if it is from left to right, some tolerances are allowed, and an angle that slightly goes from the lower left to the upper right, or an angle that goes from the upper left to a little lower right. However, it can be regarded as a specific movement direction. The allowable range can be designated in advance by the user via the operation unit 22 such as, for example, how many times up, how many times down, and the data is stored in the memory 24.

  When the monitoring device 11 determines that an abnormality, that is, a specific situation has occurred, the main control unit 21 notifies the abnormality from the speaker 34 by an alarm or the like. When an abnormality is detected, the recorded ringing tone or music can be played to intimidate alarms and intruders. In addition, a warning meaning lamp may be turned on or blinked, and this can be combined with the infrared lamp 54 in this embodiment. The user can specify in advance what kind of notification is to be performed, and the data (information on what notification is to be performed) is stored in the memory 24.

  The monitoring device 11 may be configured to set the operation time in the monitoring mode. For example, it is set such that it operates from 10 pm to 7 am. If it is considered unnecessary to monitor during normal daytime, etc., it may be set not to operate from the viewpoint of preventing malfunction. This setting may be linked with the timer setting and alarm setting of the mobile phone. This time setting can be designated in advance by the user via the operation unit 22, and the data is stored in the memory 24.

  If the monitoring device 11 determines that there is an abnormality, the monitoring device 11 records an image at the time of abnormality in the large-capacity memory 25 that is a built-in recording device under the control of the main control unit 21. Here, in addition to the method of recording after there is an abnormality, it is also possible to look back on the circumstances that led to the abnormality later by always recording a past video of a short time. For example, video for the past 5 minutes is continuously recorded, and video that has passed more than that is deleted. However, if there is an abnormality, it may be recorded as a record together with the image after the abnormality including the image for the past 5 minutes.

  Recent mobile phones have a large internal memory capacity and can be equipped with a large-capacity memory card (sold separately), which can be used. Alternatively, if a large-capacity hard disk is installed, this can also be used. Whether to record in this way can be specified in advance by the user via the operation unit 22, and the data (information on whether to record) is stored in the memory 24.

  Further, when the monitoring device 11 determines that there is an abnormality, the monitoring device 11 can report to a preset contact using the telephone function under the control of the main control unit 21. If you are on the go, contact your home contact. Also, if you are at home, calling your home phone during an abnormal situation can be a threat to intruders. Whether or not to perform this notification can be designated in advance by the user via the operation unit 22, and the data is stored in the memory 24.

  It is also possible to notify at least the contents registered in advance to the other party of the report destination when it is determined that the abnormality is described above. This may be a pre-registered message, automatic phone call or email. In the case of an emergency, it is considered that it is not a psychological state that can be transmitted calmly by telephone, so a necessary message to be transmitted is reproduced according to the content of the abnormality and notified to the connection destination. The contents of the notification can be designated in advance by the user using the operation unit 22 or the microphone 33, and the data is stored in the memory 24 or the large capacity memory 25.

  The monitoring device 11 can also send at least position information registered in advance under the control of the main control unit 21. The name contact information of the owner of the mobile terminal may be communicated, or the current location information (current location information, where the user is located) acquired by the GPS function unit 40 may be communicated. Since address information is important for reporting to the police and fire department, effective reporting is possible by adding GPS, map information, etc. to the reporting information. Whether or not to make this notification and position information can be designated in advance by the user via the operation unit 22, and the data is stored in the memory 24.

  As for the current location information, in addition to the designation from the user and adopting the latest information by GPS as described above, for example, from the RFID that provides the local location information (information indicating where it is), the RFID reader / writer You may employ | adopt the method of extract | collecting using 41. FIG. The main control unit 21 analyzes the data read from the RFID to obtain local position information, and uses it as current location information. Since RFID and its reading are well known, the description thereof is omitted.

  In addition, when the local position information is provided by a two-dimensional code such as a QR code (registered trademark), sampling by imaging such a code with the camera unit 50 may be employed. The main control unit 21 analyzes the code copied by the camera unit 50 to obtain local position information, and uses it as current location information. The QR code and its reading are well known and will not be described.

  Next, details of detection and determination performed using the above-described configuration will be described.

  FIG. 7 shows a state where the monitoring device 11 is installed in a bedroom such as a hotel. That is, as shown in FIG. 2A, a suitable table such as a table 103 is placed between the door 102 where the intruder is to be monitored and the bed 101 where the person sleeps, and the monitoring device 11 is installed thereon. As shown in FIG. 2B, the monitoring device 11 is arranged in a place where the photographing range 104 matches the range in which an intruder seems to pass between the door 102 and the bed 101. The lowermost part of the door 102 is the origin, the rightward direction in the horizontal direction (the direction from the door toward the bed) is the positive direction in the x direction, and the upward direction in the vertical direction is the positive direction in the y direction.

  FIG. 2 shows a processing flowchart when the monitoring mode is entered. In the following description of the operation, the operation of the main control unit 21 is performed unless otherwise specified. S means a step.

  First, the current image is acquired using the camera of the portable terminal (S11) and stored in the large-capacity memory 25 (S12). The image to be stored may be one screen or a plurality of screens. A screen obtained by smoothing a plurality of screens may be stored. FIG. 8A is an example thereof, and the whole body of a human (intruder) is shown at a position indicated by A.

  Next, pixel values are compared for each pixel of the current image and the stored image (S13, S14), and the difference is extracted. The pixel value is, for example, a luminance value or a gradation value. The pixel value of the corresponding pixel is subtracted between the two images (the past value is subtracted from the current value).

  The main control unit 21 compares this difference value with a preset threshold value (S15). If the difference is larger than the threshold value, the main control unit 21 determines that “change has occurred” in the pixel. The threshold can be set by the user, and the sensitivity “good” or “normal” is selected. Thereby, the main control unit 21 sets a threshold value of the pixel value. FIG. 8B is an example thereof, and pixels having pixel values larger than the threshold value are represented by rectangles. Here, for the convenience of explanation, it is drawn roughly to such an extent that the principle can be understood. That is, after an intruder appears, the pixel value of each pixel corresponding to the intruder's body is considered to be different from the pixel value before the intruder appears. What is necessary is just to set a threshold value so that a threshold value may be exceeded.

  x1 is the minimum value of the x coordinate among the pixels whose pixel values exceed the threshold value, in other words, the pixels corresponding to the body of the intruder, and corresponds to the tip of the right hand. x11 is the maximum value of the x coordinate and corresponds to the tip of the left hand.

  x6 is the x coordinate of a point corresponding to the top of the head. As will be described later, this is a portion that may be regarded as the center of the body in the x-axis direction. x3 is between x1 and x6. That is, x1 <x3 <x6 <x11.

  y1 is the y coordinate of the pixel with the smallest y coordinate among the pixels corresponding to x = x3, and y2 is the y coordinate of the pixel with the largest y coordinate among the pixels corresponding to x = x3. As shown in the figure, there may be a pixel whose pixel value does not exceed the threshold value in the range of y1 <y <y2.

  y3 is the y coordinate of the pixel with the smallest y coordinate among the pixels corresponding to x = x6, and y4 is the y coordinate of the pixel with the largest y coordinate among the pixels corresponding to x = x6.

  If there is a “changed” pixel, the changed pixel is histogrammed in the x and y directions (S16), and the respective center positions are obtained (S17). The method for obtaining the center position may be a method using the median as the center value, or a method using the maximum portion of the histogram as the center. This center position is stored in the large capacity memory 25.

That is, first, the x direction will be described. First, for each x-coordinate, the maximum value-minimum value (= H (x)) of the y-coordinate of the “changed” pixel is obtained. For example, among the pixels whose x coordinate is 10, the coordinates of the “changed” pixel are (10, 5), (10, 6), (10, 7), and H (10) becomes 7−5 = 2. Since the intruder has a width, the x coordinate of the “changed” pixel is only in a certain range. If it exists only in x = 4 to 20, H (x) is obtained one by one from x = 4 to x = 20. In the example of FIG. 8B, H (x) is obtained in the range of x = x1 to x11. From the above explanation,
H (x3) = y2-y1
H (x6) = y4-y3
It is.

  Next, as shown in FIG. 8C, a histogram can be obtained by taking the x coordinate on the horizontal axis and H (x) on the vertical axis. Hereafter, it will be simplified as shown in FIG. The center value of x is obtained from this histogram. For example, the maximum value (mode) of x can be set as the center value. In this example, x6. Alternatively, the x-coordinate is taken on the horizontal axis, the integrated value of H (x) is taken on the vertical axis instead of H (x), and the median value (median) of x can be set as the central value.

  As a result, the center position in the x-axis direction of the object considered to be an intruder is obtained.

  The same applies to the y-axis direction. For each x coordinate, the maximum value-minimum value (= W (y)) of the y coordinate of the “changed” pixel is obtained. As shown in FIG. 8E, y and W (y) are plotted to obtain a histogram, and the y coordinate of the center position is obtained. Let that value be y11.

  In addition, the size of the object can be acquired based on the amount of data to be histogrammed. This makes it possible to determine whether the moving object is a person or whether a small animal or garbage has moved.

  That is, in the x vs. H (x) histogram, the x range where H (x) is equal to or greater than a predetermined value (predetermined by the user or the device) is the length of the object in the x direction (that is, Width). For example, when the predetermined value is 0, it can be considered that the maximum value-minimum value of the x coordinate is the length in the x direction for all the pixels whose pixel value exceeds the threshold value.

  Similarly, in the y vs. W (y) histogram, the range of y such that W (y) is greater than or equal to a predetermined value (predetermined by the user or device) is the length of the object in the y direction ( In other words, if you are a human and have a full body, you can think of yourself as being tall. For example, when the predetermined value is 0, it can be considered that the maximum value-minimum value of the y coordinate is the length in the y direction for the entire pixel whose pixel value exceeds the threshold value.

  Since the x and y coordinates at which H (x) and W (y) change rapidly are considered to be the boundary position between the object and the background, that is, the coordinates of the contour of the object, the above H (x) and W ( Instead of setting a predetermined value of y), an x-coordinate / y-coordinate where the absolute value of the rate of change of H (x) or W (y) is equal to or greater than a predetermined value for the boundary position between the object and the background You may make it think.

  In this way, the current center position of the object and the size of the object are obtained.

  By continuously performing this process, the center position of the object and the size of the object at each time are obtained. Therefore, by taking the difference from the previous center position (S18), it is possible to detect the moving direction of what is reflected in the camera (S19). As a result, when it is determined that the movement direction of the object reflected in the camera is a movement in the designated direction (specific movement direction) (S20), a security function such as notification by an alarm or the like is activated. .

  As described above, for example, even when the specific movement direction is determined as “left to right”, a somewhat allowable range can be recognized. That is, the user can specify various criteria for determining whether or not the moving direction of what is reflected in the camera is the specific moving direction. For example, as the judgment criteria, perfect match, similarity, ratio, etc. can be considered, and the user can select the judgment criteria desired from them in advance. The user can specify the desired determination criterion by the operation unit 22, and the data is stored in the memory 24.

  As shown in FIG. 9A, it is assumed that the intruder's body has moved from the position indicated by A (the same position as FIG. 8A) to the position indicated by B. Here, it is assumed that the movement from A to B is large in the right direction and slight in the downward direction. The histograms in the x direction and y direction in this case are represented as shown in FIGS. 9B and 9C, respectively. The center values are x20 and y10, respectively. Since x6 <x20 and y10 <y11, it can be seen that the movement from A to B is in the lower right direction. More specifically, in this example, x20-x6 is larger than y11-y10, so the movement from A to B is large in the right direction and small in the downward direction, in other words, “almost, from left to right. It is understood that "It is a movement of". As described above, if the allowable range is appropriately set, it can be determined that the specific situation occurs.

  However, here, the size of the moving object is also taken into consideration in order to further improve the accuracy. That is, if it is determined in S20 that the movement is in the set direction and there is no movement in the reverse direction (described later) in S21, it is determined whether the moving object is larger than the specified size (S23). If the size is larger than the specified size, the security function is activated (S24). If the size is smaller than the specified size, the security function is not activated. As a result, it is possible to reduce the risk of erroneously determining that a specific situation has occurred by detecting the movement of small insects such as flies flying in the room or small animals kept as pets. The designated size can be designated in advance by the user through the operation unit 22, and the data is stored in the memory 24. Since the size of the moving object is known at the time of S17, it is determined whether or not the moving object is equal to or larger than the specified size at the time of S17. You may make it return.

  Further, consider a case where the user moves in a toilet or the like. Normally, when going to the toilet, the movement is in the direction opposite to the setting direction, but when returning, it can be considered that the direction is the same as the setting direction. In this case, when going to the toilet, it is memorized that there was a movement in the direction opposite to the direction in which the alarm is issued (S25). When returning, it is the same as the direction in which the alarm is issued (S20), but in consideration of the opposite direction (S21), the alarm is not issued.

  When returning, the memory of the previous reverse movement (S25) is erased, the movement in the same direction as the set direction is stored as the latest information, and the process returns to S11.

  If the direction is not the reverse direction in S25, that is, the direction is neither the set direction nor the reverse direction, the process returns to S11 without doing anything.

  The monitoring device 11 is a camera-equipped mobile phone in this embodiment, but can also be a PDA (Personal Digital Assistant) or a personal computer.

  Although this embodiment is an example monitored for the purpose of a crime prevention device that prevents a suspicious person from entering a house, the present invention is not limited thereto.

  A situation where a baby is about to get out of the crib alone can also be considered as an applicable case.

  In addition, as an applicable case, for example, there may be a case where another animal enters (invades) beyond the fence aiming at the shepherd, and conversely, the sheep escapes beyond the fence. It is also possible to go (escape).

  In addition, the monitoring target according to the present invention can determine the situation related to the monitoring target based on the moving direction of the monitoring target. The present invention can be applied to a case where the situation to be judged is an unfavorable situation, and can also be applied to a situation in which the situation to be judged is a favorable situation.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims. That is, embodiments obtained by combining technical means appropriately changed within the scope of the claims are also included in the technical scope of the present invention.

  Each block of the monitoring device 11, particularly the main control unit 21, may be configured by hardware logic, or may be realized by software using a CPU as follows.

  That is, the monitoring device 11 includes a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, a RAM (random access memory) that expands the program, A storage device (recording medium) such as a memory for storing the program and various data is provided. An object of the present invention is a recording medium on which a program code (execution format program, intermediate code program, source program) of a control program of the monitoring device 11 which is software that realizes the functions described above is recorded so as to be readable by a computer. This can also be achieved by supplying the portable terminal 12 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  The monitoring device 11 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  It can also be applied to uses such as security cameras.

It is a block diagram which shows one structural example of the monitoring which concerns on this invention. It is sectional drawing which shows the structural example of a camera. It is sectional drawing which shows the structural example of a camera. It is a block diagram which shows the structural example which has several cameras. It is a flowchart which shows the monitoring process. It is a figure which shows the example of the monitoring direction setting screen. (A) is a figure which shows a mode that a monitoring apparatus is installed, (b) is a figure which shows a mode at the time of seeing from the arrow A in (a). (A) is a figure which shows a mode that the monitoring target exists in an imaging | photography range, (b) is a figure which shows a mode that image processing of (a) is performed, (c) is a figure which shows (b) x-axis. It is a figure which shows a mode that a histogram is made about a direction, (d) is a figure which simplifies and shows (c), (e) is a figure which shows a mode that (b) is histogrammed about a y-axis direction. is there. (A) is a figure which shows a mode that the monitoring object moves in an imaging | photography range, (b) is a figure which shows a mode that image processing of (a) is carried out and it histogram-forms about an x-axis direction, (c) These are figures which show a mode that (a) is image-processed and it histogram-forms about a y-axis direction.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Monitoring apparatus 12 Portable terminal 13 Charger 21 Main control part (determination part)
21a Image moving direction detector (moving direction detector)
22 Operation unit 23 Program memory 24 Memory (specific movement direction storage unit, personal information storage unit, current location storage unit)
25 Large capacity memory (image storage unit)
26 Display part (specific movement direction designation part)
27 Battery 28 Charge Control Unit 29 Data Communication Interface 30 Power Supply Connection Unit 31 Radio Unit (Communication Unit)
32 Communication control unit (communication unit)
33 Microphone 34 Speaker 35 Audio processing unit 40 GPS function unit 41 RFID reader / writer 50, 50a, 50b, 50c Camera unit (shooting unit)
51 Optical System 52 Image Sensor 53 Video Signal Processing Unit 53a Camera Switching Unit 54 Infrared Lamp (Light Source)
55 Lens System 56 Lens Body 57 Infrared Shading Filter 71 Voltage Conversion Unit 72 Charging Control Unit 90 Monitoring Direction Setting Screen Display Unit 91 Icon 92 Mark 101 Bed 102 Door 103 Table 104 Shooting Range

Claims (16)

In a monitoring device that determines the status of a monitoring target,
A shooting section for shooting a fixed range;
A moving direction detection unit that detects a moving direction of a moving object within a range captured by the imaging unit;
A specific movement direction storage unit that stores in advance a movement direction of an object that is always performed when a specific situation occurs, as a specific movement direction;
A determination unit that compares the movement direction detected by the movement direction detection unit with the specific movement direction stored in the specific movement direction storage unit and determines that the specific situation has occurred; A monitoring device characterized.   The monitoring apparatus according to claim 1, wherein the monitoring apparatus is portable and has a communication function.   The determination unit determines whether or not the monitoring device is supplied with power from the outside of the device. If the monitoring device is supplied, the monitoring function is activated, and if not supplied, the monitoring function is turned off. The monitoring device according to claim 1. It has an operation time designation part that receives the designation of the monitoring time, which is the time to activate the monitoring function,
The determination unit determines whether or not the present time is the monitoring time designated by the operation time designating unit, and activates the monitoring function if it is during the monitoring time, and turns off the monitoring function if it is not during the monitoring time. The monitoring apparatus according to claim 1, wherein: The above judgment part
The monitoring apparatus according to claim 1, wherein the size of the object is checked, and it is determined that the specific situation has occurred only when the size is equal to or greater than a predetermined value.   The monitoring apparatus according to claim 1, wherein the photographing unit has sensitivity in an infrared region. The shooting section
An imaging unit having sensitivity in the infrared region is attached with an infrared light shielding filter to serve as a photographing unit for normal photography, and by removing the infrared shielding filter, the imaging unit serves as an imaging unit for infrared region photography. The monitoring device according to claim 1. The above shooting section
A first imaging unit having sensitivity in the infrared region;
In addition to the first imaging unit, the imaging unit having sensitivity in the infrared region has a second imaging unit that works for normal imaging by attaching an infrared shielding filter to the imaging unit,
The monitoring apparatus according to claim 1, further comprising a camera switching unit that switches between the first and second imaging units.   The monitoring device according to claim 6, further comprising a light source that emits at least infrared rays toward a photographing range of the photographing unit.   The monitoring apparatus according to claim 1, further comprising a specific movement direction designation unit for a user to designate the specific movement direction. An image storage unit for storing an image captured by the imaging unit;
The monitoring apparatus according to claim 1, wherein when the determination unit determines that the specific situation has occurred, the image storage unit stores the image captured by the imaging unit. A communication unit that notifies the contact information registered in advance that the specific situation has occurred,
The monitoring device according to claim 1, wherein when the determination unit determines that the specific situation has occurred, the communication unit causes the communication unit to notify that the specific situation has occurred. A personal information storage unit for storing user personal information;
13. The monitoring apparatus according to claim 12, wherein when the determination unit determines that the specific situation has occurred, the communication unit notifies the contact information of the personal information. A current location storage unit for storing the current location of the user;
13. The monitoring apparatus according to claim 12, wherein when the determination unit determines that the specific situation has occurred, the communication unit causes the communication unit to notify the current location.   15. A monitoring program for causing a computer to function as a movement direction detection unit, a specific movement direction storage unit, and a determination unit in the monitoring device according to claim 1.   A computer-readable recording medium on which the monitoring program according to claim 15 is recorded.

Images