JP4797720B2 - Monitoring device and method, image processing device and method, and program - Google Patents

Description

  The present invention relates to a monitoring apparatus and method, an image processing apparatus and method, and a program, and more particularly to a monitoring apparatus and method, an image processing apparatus and method, and an image processing apparatus and method capable of more accurately notifying a surrounding situation of an object to be monitored. Regarding the program.

  In recent years, the number of vehicle theft accidents has been increasing, and various vehicle monitoring systems have been proposed as countermeasures.

  For example, in a conventional vehicle monitoring system, when a theft preparatory action, that is, an abnormality in a vehicle, is detected in a monitoring device installed in the vehicle, the center device connected to the monitoring device via a communication network can Some mobile phones transmit warning information indicating that an abnormality has been detected in the vehicle (see, for example, Patent Document 1).

  In this vehicle monitoring system, when an abnormality is detected in the monitoring device, theft preliminary action information indicating the detected abnormality is transmitted from the monitoring device to the center device. A determination is made as to whether to send alert information to the telephone.

Japanese Patent Laid-Open No. 2002-304686

  However, in the above-described technique, a message indicating that an abnormality has been detected in the vehicle is displayed on the mobile phone owned by the user, or some images indicating the situation around the vehicle prepared in advance. Only one of them was displayed. Therefore, the user is only presented with information to the extent that a person has approached the vehicle or a person has entered the vehicle, and the user can accurately determine the situation around the vehicle being monitored. Could not know.

  Thus, for example, when a person approaches the vehicle, the user is only presented with information indicating that the approach of the person to the vehicle has been detected. It is difficult to determine whether a person approaching the vehicle is a passerby who passes near the vehicle, or a malicious suspicious person trying to enter the vehicle or steal the vehicle. There was a fear.

  In addition, in order to notify the user of the situation around the vehicle more accurately, the monitoring device can capture an image of the periphery of the vehicle and the center device can transmit the image captured on the user's mobile phone. However, in such a case, since the amount of data of the transmitted image is large, the communication fee that the user pays for the use of the mobile phone, that is, the communication between the mobile phone and the center device becomes high, which is not realistic. There wasn't.

  The present invention has been made in view of such a situation, and makes it possible to grasp the situation around the subject of monitoring more accurately.

According to a first aspect of the present invention, there is provided a monitoring device that captures an image of a monitoring area that is a surrounding area of an object to be monitored, an approaching person approaching the object, or an approach of the approaching person. Monitoring means for monitoring contact with the object, posture detection means for detecting posture of the approaching person based on a photographed image of the monitoring area, and generating posture information indicating the posture of the approaching person, Based on the monitoring result by the monitoring means and the image, the position detecting means detects the position of the approaching person relative to the object, and generates position information indicating the position, and includes the posture information and the position information. Transmitting means for transmitting detection data indicating a posture of the approaching person and a position with respect to the approaching person.

In the monitoring apparatus according to the first aspect of the present invention, a monitoring area, which is a surrounding area of an object to be monitored, is photographed, and an approaching person approaching the object approaches the object or the object of the approaching person. The approaching person's attitude is detected and the attitude information indicating the approaching person's attitude is generated based on the image of the monitored area that has been monitored, and the attitude information indicating the approaching person's attitude is generated. Based on the monitoring result and the image The position of the approaching person with respect to the object is detected and position information indicating the position is generated, and the detection data indicating the approaching person's posture and the position with respect to the object is transmitted including the posture information and the position information. The

  Therefore, it is possible to transmit detection data including the approaching person's posture and position for more accurately grasping the situation around the monitoring target.

  The imaging means of this monitoring apparatus is constituted by a camera using, for example, a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a logarithmic conversion type image sensor, or the like. Further, the monitoring means is composed of various sensors such as a Doppler sensor, an infrared sensor, an acceleration sensor, a capacitance sensor, and a radio wave sensor. Further, the posture detection means, the position detection means, and the transmission means are configured by, for example, a CPU (Central Processing Unit).

According to a second aspect of the present invention, there is provided a monitoring device for imaging a monitoring area that is a surrounding area of an object to be monitored, an approaching person approaching the object, or an approach of the approaching person. Monitoring means for monitoring contact with the object, posture detection means for detecting posture of the approaching person based on a photographed image of the monitoring area, and generating posture information indicating the posture of the approaching person, Based on the monitoring result by the monitoring means or the image, based on the position detection means for detecting the position of the approaching person relative to the object and generating position information indicating the position, the posture information and the monitoring result , An action estimation means for estimating an action performed by the approaching person and generating action information indicating the action, the posture information of the approaching person and the previous position, the posture information, the position information, and the action information. And transmitting means for transmitting the detection data indicating the position relative things.
In the monitoring device according to the second aspect of the present invention, a monitoring area, which is a surrounding area of an object to be monitored, is photographed, and an approaching person approaching the object approaches the object or the object of the approaching person. The approaching person's posture is detected on the basis of the image of the monitoring area that has been taken and the posture information indicating the approaching person's posture is generated, based on the monitoring result or the image. The position of the approaching person relative to the object is detected, position information indicating the position is generated, and the action performed by the approaching person is estimated based on the posture information and the monitoring result to indicate the action. Action information is generated, and detection data indicating the posture of the approaching person and the position with respect to the approaching object, which includes the posture information, the position information, and the action information, is transmitted.

  Thereby, the detection data including the action information for grasping the action performed by the approaching person more accurately can be transmitted.

The imaging means of this monitoring device is constituted by a camera using, for example, a CCD imaging device, a CMOS imaging device, a logarithmic conversion type imaging device, or the like. Further, the monitoring means is composed of various sensors such as a Doppler sensor, an infrared sensor, an acceleration sensor, a capacitance sensor, and a radio wave sensor. Furthermore, the posture detection unit, the position detection unit, the action estimation unit, and the transmission unit are configured by a CPU, for example.

  The monitoring apparatus further includes face recognition means for recognizing the approaching person's face using the image and specifying the approaching person, and the transmission means includes a personal ID indicating the specified approaching person The detected data can be transmitted.

  Thereby, the detection data including the personal ID for specifying the approaching person can be transmitted.

  This face recognition means is constituted by a CPU, for example.

  The monitoring apparatus further includes a face direction detection unit that detects a face direction or a line-of-sight direction of the approaching person, and the posture detection unit includes the detection result and the image based on the detection result by the face direction detection unit. The approaching person's posture can be detected.

  Thereby, the posture of the approaching person can be detected more accurately.

  This face direction detecting means is constituted by a CPU, for example.

The monitoring method or program according to the first aspect of the present invention includes an imaging step of imaging a monitoring area that is a surrounding area of an object to be monitored, and an approaching person approaching the object, or the approaching A monitoring step for monitoring a person's contact with the object, and a posture detection step for detecting posture of the approaching person and generating posture information indicating the approaching person's posture based on the captured image of the monitoring area When the approaching individual access to the ones, or monitoring the result of contact with the foregoing the approaching individual, and based on the image, a position indicating the position by detecting the position with respect to the ones of the approaching individual A position detecting step for generating information, and a transmitting step for transmitting detection data indicating the approaching person's posture and the position relative to the approaching object, comprising the posture information and the position information. Including the.

In the monitoring method or program according to the first aspect of the present invention, a monitoring area that is a surrounding area of an object to be monitored is photographed, and an approaching person approaching the object approaches the object or the approaching person's Contact with the object is monitored, and based on the captured image of the monitoring area, the attitude of the approaching person is detected and attitude information indicating the approaching person's attitude is generated, and the approaching person's attitude is generated. Based on the monitoring result of the approach of the approaching person or the approaching person to the thing, and the image, the position of the approaching person with respect to the thing is detected and position information indicating the position is generated, and the posture information and Detection data including the position information and indicating the approaching person's posture and the position of the approaching object is transmitted.

  Therefore, it is possible to transmit detection data including the approaching person's posture and position for more accurately grasping the situation around the monitoring target.

This imaging step is constituted by an imaging step for imaging a monitoring area by an imaging means such as a camera, for example, and the monitoring step is, for example, a sensor approaching an approaching person or an approaching person to the monitoring object. Alternatively, the posture detection step includes, for example, a posture detection step in which the posture of the approaching person is detected by the CPU based on the photographed image. Further, the position detection step includes, for example, a position detection step in which the position of the approaching person with respect to the monitoring target is detected by the CPU based on the monitoring result in the monitoring step and the captured image of the monitoring area. For example, it includes a transmission step in which detection data indicating the posture of the approaching person composed of posture information and position information and the position with respect to the monitoring target is transmitted by the CPU.

An image processing apparatus according to a third aspect of the present invention receives detection data including posture information indicating a posture of an approaching person approaching an object to be monitored and position information indicating a position of the approaching person with respect to the object. And generating means for generating an image of the approaching person in the posture indicated by the one and the posture information, and notifying the approaching person of the approaching to the one based on the detection data. And display means for displaying the generated image , the generating means based on the detection data including a personal ID indicating the approaching person, in the face portion of the approaching person in the image, The image for notifying the approach of the approaching person is generated so that an image of the face related to the personal ID recorded in advance is displayed .

In the image processing apparatus according to the third aspect of the present invention, detection data including posture information indicating the posture of an approaching person approaching the object to be monitored and position information indicating the position of the approaching person with respect to the object is received. Based on the detection data, an image of the approaching person in the posture indicated by the thing and the posture information, and an image notifying the approaching person of approaching to the thing is generated and generated. The image is displayed. In addition, based on the detection data including the personal ID indicating the approaching person, a face image related to the personal ID recorded in advance is displayed on the face part of the approaching person in the image. As described above, the image notifying the approach of the approaching person to the object is generated.

  Therefore, the situation around the monitoring target can be grasped more accurately.

  The receiving means and the generating means are constituted by, for example, a CPU, and the display means is constituted by, for example, an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube), a plasma display, or the like.

  The generation unit can generate the two-dimensional or three-dimensional image.

  Thereby, the image which can grasp | ascertain the condition around the monitoring object more correctly can be displayed.

  The generation means can generate the image for displaying animation of a change in the position and posture of the approaching person based on the detection data including the posture information and the position information at each time.

  Thereby, the image which can grasp | ascertain an approaching person's locus | trajectory correctly can be displayed.

  The generation unit may generate the image based on the detection data including action information indicating an action performed by the approaching person.

  Thereby, the image which can grasp | ascertain correctly the action which the approacher performed can be displayed.

According to a third aspect of the present invention, there is provided an image processing method or program comprising: detection data comprising posture information indicating a posture of an approaching person approaching the object to be monitored; and position information indicating a position of the approaching person relative to the object. Based on the receiving step of receiving and the detection data, the image of the approaching person in the posture indicated by the posture information and the posture information, the image notifying the approaching of the approaching person to the one is generated. A generation step; and a display step for displaying the generated image. In the generation step, a part of the face of the approaching person in the image based on the detection data including a personal ID indicating the approaching person The image for notifying the approach of the approaching person so that the face image associated with the personal ID recorded in advance is displayed Generated.

In the image processing method or program according to the third aspect of the present invention, detection data comprising posture information indicating the posture of an approaching person approaching the object to be monitored and position information indicating the position of the approaching person relative to the object. Is generated based on the detection data, and the image of the approaching person in the posture indicated by the posture information and the posture information, and notifying the approaching person of the approaching to the thing is generated and generated. The image thus displayed is displayed. In addition, based on the detection data including the personal ID indicating the approaching person, a face image related to the personal ID recorded in advance is displayed on the face part of the approaching person in the image. As described above, the image notifying the approach of the approaching person to the object is generated.

  Therefore, the situation around the monitoring target can be grasped more accurately.

  This reception step includes, for example, a reception step in which detection data including posture information and position information is received by the CPU, and the generation step is indicated by, for example, a monitoring target and posture information based on the received detection data. The display step includes, for example, a display step of displaying the image generated in the generation step on an LCD, a CRT, a plasma display, or the like.

According to the first aspect and the second aspect of the present invention, it is possible to detect an approaching person approaching the monitoring target. In particular, according to the first aspect and the second aspect of the present invention, it is possible to transmit detection data for more accurately grasping the situation around the monitoring target.

According to the third aspect of the present invention, an image can be displayed. In particular, according to the third aspect of the present invention, it is possible to more accurately grasp the situation around the monitoring target.

  Embodiments to which the present invention is applied will be described below with reference to the drawings.

  FIG. 1 shows a configuration example of an embodiment of a monitoring system to which the present invention is applied. This monitoring system includes a monitoring device 11, a center device 12, and a terminal device 13, and the monitoring device 11, the center device 12, and the terminal device 13 are connected to each other via a network 14.

  The monitoring device 11 is a person approaching the monitoring target (hereinafter referred to as an approaching person), monitoring in order to protect the object to be monitored (hereinafter referred to as the monitoring target) from damage such as theft, destruction, or entry. Monitor suspicious activity on the subject.

  For example, what is monitored by the monitoring device 11 can be a building, a room, an office, a store, an office, a vehicle, a warehouse, a locker, a household item, an animal, a crop, etc., regardless of whether it is movable property or real estate. In addition, the suspicious acts on the monitoring target include, for example, harming acts on human bodies, stalking acts, harassment, theft, destruction, arson, unauthorized intrusion, and the like.

  The monitoring device 11 detects an approaching person approaching the monitoring target, and identifies a detected approaching person ID (Identification), attitude information indicating the approaching person's attitude, action information indicating an action performed by the approaching person, Detection data including position information indicating the position of the approaching person with respect to the monitoring target is generated. The monitoring device 11 transmits the generated detection data to the center device 12 via the network 14 as data indicating the monitoring result.

  Here, the network 14 is configured by one or a plurality of networks made of wired or wireless, such as the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or a public network. The

  The center device 12 receives and records the detection data transmitted from the monitoring device 11. When the center device 12 receives the detection data from the monitoring device 11, the center device 12 transmits a reception notification indicating that the detection data has been received to the terminal device 13 via the network 14. Further, the center device 12 transmits the detection data received from the monitoring device 11 to the terminal device 13 via the network 14 in response to a request from the terminal device 13.

  The terminal device 13 includes an information processing terminal device such as a computer, a portable information terminal device, and a mobile phone. The terminal device 13 receives the reception notification transmitted from the center device 12, and displays the reception notification.

  In addition, when the terminal device 13 is instructed to receive the detection data in accordance with the operation of the user, the terminal device 13 receives the detection data from the center device 12, and based on the received detection data, the image of the monitoring target and the approaching person (hereinafter, referred to as the monitoring object). , Referred to as a notification image). In this notification image, the approaching person indicated by the posture information is displayed at the position indicated by the position information together with the monitoring target.

  Therefore, in the monitoring system, the user who owns the terminal device 13 can accurately grasp the situation around the monitoring target by confirming the notification image. Thereby, the user can easily determine whether the approaching person is a passerby passing near the monitoring target or a suspicious person who performs a suspicious action on the monitoring target.

  In the following, an example in which the monitoring device 11 is installed in a vehicle as a monitoring target will be described. However, as described above, the monitoring target is not limited to the vehicle.

  The monitoring device 11 is installed on, for example, a dashboard or ceiling of a vehicle and monitors an approaching person approaching the vehicle. FIG. 2 is a block diagram illustrating a configuration example of the monitoring device 11.

  The monitoring device 11 includes an imaging unit 41, a sensor unit 42, and a monitoring unit 43.

  The imaging unit 41 includes a camera using a CCD (Charge Coupled Device) imaging device, a CMOS (Complementary Metal Oxide Semiconductor) imaging device, a logarithmic conversion imaging device, or the like, and is an area around a vehicle to be monitored Is taken, and an image obtained thereby is supplied to the monitoring unit 43.

  For example, assuming that the front direction when viewed from the driver sitting in the driver's seat of the vehicle, that is, the direction from the driver's seat toward the windshield is the front, the plurality of cameras constituting the imaging unit 41 are the front, rear, and right directions, respectively. The left direction, the right oblique front, the left oblique front, the right oblique rear, and the left oblique rear are fixed in a total of eight directions, and the monitoring area in each direction is photographed.

  In addition, the camera which comprises the imaging part 41 may be one, or plural. Further, in order to expand the shooting range of the camera constituting the imaging unit 41, a wide-angle lens or a fish-eye lens may be used as the camera lens.

  The sensor unit 42 includes various sensors such as a Doppler sensor, an infrared sensor, an acceleration sensor, a capacitance sensor, and a radio wave sensor. For example, the sensor unit 42 opens and closes the doors and trunks of the vehicle, approaches or contacts the doors and trunks, approaches the vehicle (for example, people), and the direction and distance of the vehicle itself. An abnormality of the provided key cylinder, vehicle inclination, vibration, and the like are detected, and sensor data indicating the detection result is supplied to the monitoring unit 43.

  The monitoring unit 43 detects an approaching person to the vehicle based on the image supplied from the imaging unit 41 and the sensor data supplied from the sensor unit 42, and generates detection data. The monitoring unit 43 includes a position detection unit 51, a feature point extraction unit 52, a personal ID holding unit 53, a face recognition unit 54, a face direction detection unit 55, a posture detection unit 56, an action estimation unit 57, a detection data generation unit 58, and The communication unit 59 is configured.

  The position detection unit 51 detects the position of an approaching person with respect to the vehicle based on the sensor data supplied from the sensor unit 42, and supplies position information indicating the detection result to the action estimation unit 57 and the detection data generation unit 58. . For example, the position of the approaching person is a predetermined position in the vehicle or a position on the three-dimensional space with reference to the monitoring device 11.

  The feature point extraction unit 52 extracts feature points such as the body's center of gravity, the top of the head, the hands, and the toes from the image supplied from the imaging unit 41, and the extracted feature points are used as the face recognition unit 54 and the posture detection unit. 56.

  The personal ID holding unit 53 is a personal ID that identifies a pre-registered person or an approaching person detected in the past by the monitoring device 11, and the eyes, mouth, and nose of the face of the person related to the personal ID. A template indicating the position of a predetermined part such as is held.

  The face recognizing unit 54 refers to the personal ID held in the personal ID holding unit 53, and appears in the image based on the image supplied from the imaging unit 41 and the feature points supplied from the feature point extracting unit 52. Recognize the approaching person's face and identify the approaching person. When the face recognition unit 54 performs face recognition, the face recognition unit 54 supplies information indicating the result of face recognition to the face direction detection unit 55 and supplies a personal ID indicating an approaching person identified as a result of face recognition to the detection data generation unit 58. Supply.

  The face direction detection unit 55 detects the direction of the approaching person's face and the direction of the line of sight based on the information indicating the result of the face recognition supplied from the face recognition unit 54, and sends the information indicating the detection result to the posture detection unit. 56.

  The posture detection unit 56 detects the approaching posture of the approaching person based on the feature points supplied from the feature point extraction unit 52 and the detection results supplied from the face direction detection unit 55, and uses posture information indicating the detection results. It supplies to the action estimation part 57 and the detection data generation part 58.

  The action estimation unit 57 estimates the approach of the approaching person based on the sensor data supplied from the sensor unit 42, the position information supplied from the position detection unit 51, and the posture information supplied from the posture detection unit 56. Action information indicating the estimation result is supplied to the detection data generation unit 58.

  The detection data generation unit 58 includes the personal ID supplied from the face recognition unit 54, the posture information supplied from the posture detection unit 56, the action information supplied from the action estimation unit 57, and the position supplied from the position detection unit 51. Detection data is generated based on the information and supplied to the communication unit 59. The communication unit 59 transmits the detection data supplied from the detection data generation unit 58 to the center device 12 via the network 14.

  Next, FIG. 3 is a block diagram showing a configuration example of the center apparatus 12 shown in FIG.

  The center device 12 includes a communication unit 81, a control unit 82, and a recording unit 83.

  The communication unit 81 communicates with the monitoring device 11 or the terminal device 13 via the network 14 to transmit / receive various data. The controller 82 controls the center device 12 as a whole. The control unit 82 includes a notification generation unit 91. The notification generation unit 91 of the control unit 82 generates a reception notification indicating that the detection data has been received from the monitoring device 11. The recording unit 83 includes, for example, a hard disk and records various data such as detection data received from the monitoring device 11.

  FIG. 4 is a block diagram illustrating a configuration example of the terminal device 13 illustrated in FIG. 1.

  The terminal device 13 includes a communication unit 121, an input unit 122, a control unit 123, a notification image generation unit 124, and a display unit 125.

  The communication unit 121 communicates with the monitoring device 11 or the center device 12 via the network 14 to transmit / receive various data. The input unit 122 includes, for example, buttons and switches, and supplies commands to the control unit 123 according to user operations.

  The control unit 123 controls the entire terminal device 13. The notification image generation unit 124 generates a notification image of the monitoring target and the approaching person based on the detection data received from the center device 12. The display unit 125 is configured by, for example, an LCD (Liquid Crystal Display) or the like, and displays an image supplied from the control unit 123 or the notification image generation unit 124.

  By the way, when the user operates the monitoring device 11 installed in the vehicle or instructs the monitoring of the vehicle to be monitored by operating the terminal device 13, the monitoring device 11 performs a monitoring process in accordance with the instruction. To start. Hereinafter, the monitoring process by the monitoring device 11 will be described with reference to the flowchart of FIG.

  In step S11, the imaging unit 41 starts photographing around the vehicle. That is, the imaging unit 41 captures an image of the monitoring area, and supplies the captured image to the position detection unit 51, the feature point extraction unit 52, and the face recognition unit 54.

  In step S12, the sensor unit 42 starts monitoring the approach of the approaching person to the vehicle. For example, the sensor unit 42 detects the approach of the approaching person to the vehicle, the approaching person's direction and the distance from the vehicle, the approaching person's approach to and contact with each part of the vehicle, and positions sensor data indicating the result. It supplies to the detection part 51 and the action estimation part 57. FIG.

  In step S <b> 13, the position detection unit 51 determines whether the approach of a person to the vehicle is detected based on the image supplied from the imaging unit 41 and the sensor data supplied from the sensor unit 42.

  For example, the position detection unit 51 determines that the approach of a person has been detected when detection data indicating that the approach of a vehicle has been detected is supplied from the sensor unit 42. For example, in the image supplied from the imaging unit 41 to the position detection unit 51, it may be determined that the approach of a person is detected when a moving object is detected.

  If it is determined in step S13 that no human approach has been detected, the process returns to step S13, and the determination process is repeated until it is determined that a human approach has been detected.

  On the other hand, if it is determined in step S13 that the approach of a person has been detected, the process proceeds to step S14, and the feature point extraction unit 52 extracts the feature point of the approaching person from the image supplied from the imaging unit 41. The extracted feature points are supplied to the face recognition unit 54 and the posture detection unit 56.

  For example, the feature point extraction unit 52 detects moving objects from the image supplied from the imaging unit 41, and among those detected, those that include skin-colored pixels are regarded as approaching persons. Next, the feature point extraction unit 52 extracts the silhouette image of the approaching person and its outline from the image, and performs distance conversion processing etc. on the extracted silhouette image to obtain the body gravity center and upper body principal axis of the approaching person.

  Further, the feature point extraction unit 52 detects the positions of the toes, the hands, and the top of the head from the extracted outline of the approaching person, and the detected body centroid, the top of the head, the hand, and the toes are feature points. Extracted from the image. Then, the feature point extraction unit 52 supplies the feature point extracted in this way, more specifically, information indicating the position of the feature point to the face recognition unit 54 and the posture detection unit 56.

  Further, for example, an infrared camera may be included as a camera constituting the imaging unit 41, and a silhouette image of an approaching person may be extracted using a thermal image taken by the infrared camera.

  In step S <b> 15, the face recognition unit 54 recognizes the approaching person in the image based on the image supplied from the imaging unit 41 and the feature point supplied from the feature point extraction unit 52, and selects the approaching person. Identify.

  For example, the face recognizing unit 54 uses an area in the vicinity of a feature point such as the top of the image supplied from the imaging unit 41 as the area of the approaching person's face, and the approaching person's eyes, mouth, nose, etc. by template matching or the like. The position of a predetermined part of the face is detected. Then, the face recognizing unit 54 detects the position of each part of the detected approaching person's face and each part of the human face indicated by the template associated with the personal ID held in the personal ID holding part 53. The approaching person is identified by comparing with the position of.

  As a result of the comparison, if the approaching person is not specified, that is, as a result of the comparison between the position of each part of the approaching person's face and the position of each part of the person's face indicated by the template, When the person is different from the person specified by the personal ID held in the personal ID holding unit 53, the face recognition unit 54 generates a template of the approaching person, and displays the generated template and the approaching person. A new personal ID to be identified, that is, a new personal ID not held in the personal ID holding unit 53 is related and supplied to the personal ID holding unit 53 for holding.

  When the approaching person is specified, the face recognition unit 54 supplies a personal ID that specifies the approaching person to the detection data generation unit 58. In addition, the face recognition unit 54 supplies an image of the approaching person's face and information indicating the position of each part of the approaching person's face in the image to the face direction detection unit 55 as information indicating the result of face recognition.

  In step S <b> 16, the face direction detection unit 55 detects the face direction of the approaching person based on the information indicating the result of face recognition supplied from the face recognition unit 54. For example, the face direction detection unit 55 detects the face direction of the approaching person based on the number of approaching eyes indicated by the information indicating the result of face recognition, the direction and position of the nose, and the like.

  In step S <b> 17, the face direction detection unit 55 detects the direction of the approaching person's line of sight based on the information indicating the face recognition result supplied from the face recognition unit 54, and the approaching person's face direction and the direction of the line of sight Is supplied to the posture detection unit 56. For example, the face orientation detection unit 55 detects the center position of the eyeball and the center position of the pupil of the approaching eye indicated by the information indicating the result of face recognition, and connects the center position of the eyeball and the center position of the pupil. Let the direction of the vector be the direction of the line of sight of the approaching person.

  In step S18, the posture detection unit 56 detects the posture of the approaching person based on the feature point supplied from the feature point extraction unit 52 and the detection result supplied from the face direction detection unit 55, and the detection result is obtained. The attitude information shown is generated. For example, the generated posture information includes information indicating the direction of the line of sight of the approaching person. The posture detection unit 56 supplies the generated posture information to the action estimation unit 57 and the detection data generation unit 58.

  For example, the posture detection unit 56 detects the positions of the approaching elbows and knees using a genetic algorithm using the feature points and the detection result, and detects the approaching person's posture based on the detection result.

  In step S <b> 19, the position detection unit 51 detects the position of the approaching person with respect to the vehicle based on the sensor data supplied from the sensor unit 42, and uses the position information indicating the detection result as the action estimation unit 57 and the detection data generation unit. 58.

  In step S <b> 20, the action estimation unit 57 estimates the approach of the approaching person based on the sensor data from the sensor unit 42, the position information from the position detection unit 51, and the posture information from the posture detection unit 56. Action information indicating the result is supplied to the detection data generation unit 58.

  For example, the position of the approaching person indicated by the position information is a position away from the vehicle by a predetermined distance or more, the direction of the approaching person's line of sight indicated by the posture information is in a direction different from the direction of the vehicle, and When sensor data indicating that an approaching person is moving in a predetermined direction at a predetermined speed is supplied from the sensor unit 42, the action estimation unit 57 performs an action indicating that the approaching person is passing near the vehicle. Generate information.

  Further, for example, the posture of the approaching person indicated by the posture information is a posture in which the hand is reaching in the direction of the vehicle, for example, the part closest to the vehicle among the body parts of the approaching person is the hand. When sensor data indicating that the vehicle has touched the door handle of the vehicle is supplied, the action estimating unit 57 generates action information indicating that the approaching person is trying to open the door of the vehicle.

  Furthermore, for example, when the position of the approaching person indicated by the position information is a position within a predetermined distance from the vehicle, and the direction of the approaching person's face and line of sight indicated by the posture information is the direction of the vehicle, the action estimation unit 57 generates action information indicating that the approaching person is looking into the vehicle.

  In step S21, the detection data generation unit 58 is based on the position information from the position detection unit 51, the action information from the action estimation unit 57, the posture information from the posture detection unit 56, and the personal ID from the face recognition unit 54. Detection data including personal ID, position information, posture information, action information, and time when an approaching person is detected is generated and supplied to the communication unit 59.

  In step S22, the communication unit 59 transmits the detection data supplied from the detection data generation unit 58 to the center device 12 via the network 14, and the process returns to step S13. Note that this monitoring process is terminated when, for example, the monitoring device 11 is operated by the user or the terminal device 13 is operated to instruct the end of the monitoring.

  In this way, the monitoring device 11 monitors the user's vehicle and detects an approaching person to the vehicle. The monitoring device 11 transmits detection data indicating the detected position of the approaching person with respect to the vehicle, the approaching person's posture, the approaching person's action, a personal ID identifying the approaching person, and the like to the center device 12.

  As described above, since the detected data including the detected posture and position of the approaching person and the personal ID for identifying the approaching person is transmitted to the center device 12, the terminal device 13 owned by the user is more accurately transmitted. The information for grasping the situation around the vehicle can be transmitted.

  When a plurality of approaching persons are detected in step S <b> 13, the monitoring apparatus 11 generates detection data for the number of detected approaching persons and transmits the detection data to the center apparatus 12. That is, the monitoring device 11 performs the process from step S14 to step S22 on each detected approaching person.

  When the detection data is transmitted from the monitoring device 11 to the center device 12, the center device 12 receives the detection data, and transmits the received detection data to the terminal device 13 in response to a request from the terminal device 13.

  Next, detection data transmission processing by the center device 12 will be described with reference to the flowchart of FIG.

  In step S <b> 51, the control unit 82 determines whether detection data has been transmitted from the monitoring device 11. If it is determined in step S51 that the detection data has not been transmitted, the process from step S52 to step S54 is skipped and the process proceeds to step S55.

  On the other hand, if it is determined in step S51 that the detection data has been transmitted, the process proceeds to step S52 where the communication unit 81 receives the detection data transmitted from the monitoring device 11 and receives the received detection data. Is supplied to the recording unit 83 via the control unit 82. The recording unit 83 records the detection data supplied from the communication unit 81.

  For example, as shown in FIG. 7, the recording unit 83 records the detection data supplied from the monitoring device 11 together for each personal ID.

  In FIG. 7, the detection data including the personal ID “20060123001”, the detection data including the personal ID “20060123002”, the detection data including the personal ID “20060123003”, and the personal ID “20060123004” The detection data that contain is collectively recorded.

  In addition, as detection data including the personal ID “20060123001”, detection data whose detection time is “10:00:00” and detection data whose detection time is “10:00:30” are recorded. Yes. For example, the detection time “10:00:00” indicates that the time included in the received detection data is 10:10:00, and the detection data is “10:00:00”. Includes the position information, posture information, and action information of the approaching person detected at that time.

  Returning to the description of the flowchart of FIG. 6, in step S <b> 53, the notification generation unit 91 of the control unit 82 generates a reception notification indicating that the detection data has been received and supplies the reception notification to the communication unit 81. For example, the notification generation unit 91 generates, as a reception notification, an e-mail including a message indicating that an approaching person is detected at a time included in the received detection data.

  In step S <b> 54, the communication unit 81 transmits the reception notification supplied from the notification generation unit 91 to the terminal device 13 via the network 14.

  If a reception notification is transmitted in step S54 or if it is determined in step S51 that detection data has not been transmitted, in step S55, the control unit 82 determines whether transmission of detection data has been requested from the terminal device 13. Determine whether. For example, when a transmission request for requesting transmission of detection data is transmitted from the terminal device 13, the control unit 82 determines that transmission of detection data is requested.

  If it is determined in step S55 that transmission of detection data is not requested, the received detection data is not transmitted, so the process returns to step S51 and the above-described process is repeated.

  On the other hand, when it is determined in step S55 that the transmission of the detection data is requested, the communication unit 81 receives the transmission request transmitted from the terminal device 13 and supplies it to the control unit 82. When the transmission request is supplied, the control unit 82 acquires the detection data from the recording unit 83 and supplies the detection data to the communication unit 81, and the process proceeds to step S56.

  In step S56, the communication unit 81 transmits the detection data supplied from the control unit 82 to the terminal device 13 via the network 14, and the process returns to step S51.

  The detection data transmitted from the center device 12 to the terminal device 13 is the detection data last received by the center device 12 from the monitoring device 11, that is, detection data including the latest time (time close to the current time). Or all detected data that has not yet been transmitted to the terminal device 13. The detection data transmitted to the terminal device 13 is a plurality of detection data including times within a predetermined period including the time included in the last received detection data, and includes the same personal ID. It may be detected data.

  Furthermore, the control unit 82 may generate an e-mail with detection data attached, and the communication unit 81 may transmit the e-mail generated by the control unit 82.

  In this way, the center device 12 receives the detection data from the monitoring device 11 and transmits the received detection data to the terminal device 13 in response to a request from the terminal device 13.

  The detection data transmitted from the center device 12 to the terminal device 13 includes information for notifying the user of the approach or action of the approaching person such as approaching person position information, posture information, action information, and personal ID. However, since the amount of detected data is very small compared to an image obtained by photographing the monitoring area, there is no burden on the communication fee of the user terminal device 13.

  Further, since the data amount of the detection data is very small compared with the data amount of the photographed image, the center device 12 can quickly detect the detection data even when the communication speed in the network 14 is not sufficient to transmit the image. Can be transmitted, and the terminal device 13 can be reliably notified of the detection of the approaching person.

  By the way, when the user operates the monitoring device 11 installed in the vehicle or instructs the monitoring of the vehicle to be monitored by operating the terminal device 13, the monitoring device 11 starts the monitoring process and the terminal The device 13 starts notification processing, which is processing for receiving detection data from the center device 12 and displaying a notification image.

  Hereinafter, the notification process by the terminal device 13 will be described with reference to the flowchart of FIG.

  In step S81, the control unit 123 determines whether reception of detection data has been notified. For example, when a reception notification is transmitted from the center device 12, the control unit 123 determines that reception of detection data has been notified.

  If it is determined in step S81 that reception of detection data has not been notified, detection data is not received, so the processing in step S82 and the processing in step S83 are skipped, and the processing proceeds to step S84.

  On the other hand, when it is determined in step S81 that the reception of the detection data has been notified, the process proceeds to step S82, and the communication unit 121 receives the reception notification transmitted from the center device 12 and sends it to the control unit 123. Supply. The control unit 123 supplies the reception notification supplied from the communication unit 121 to the display unit 125.

  In step S83, the display unit 125 displays the reception notification supplied from the control unit 123 and notifies the user of detection data reception, that is, detection of an approaching person to the vehicle. For example, the display unit 125 displays a message included in an e-mail received as a reception notification. Note that a reception notification may be displayed on the display unit 125, and a sound may be reproduced to notify the user that an approaching vehicle has been detected.

  In step S84, the control unit 123 determines whether or not the user has requested reception of detection data. For example, when a user who has confirmed the displayed reception notification operates the input unit 122 to instruct reception of detected data, the input unit 122 supplies a command corresponding to the user operation to the control unit 123. . The control unit 123 determines that reception of the detection data is requested when an instruction for requesting reception of the detection data is supplied from the input unit 122.

  If it is determined in step S84 that reception of detection data is not requested, detection data is not received, so the process returns to step S81 and the above-described processing is repeated.

  On the other hand, when it is determined in step S84 that reception of the detection data is requested, the control unit 123 generates a transmission request for requesting transmission of the detection data and supplies the transmission request to the communication unit 121. Proceed to S85.

  In step S <b> 85, the communication unit 121 transmits the transmission request supplied from the control unit 123 to the center device 12 via the network 14.

  When the transmission request is transmitted to the center device 12, the detection data is transmitted from the center device 12 to the terminal device 13. Therefore, in step S86, the communication unit 121 transmits the detection data transmitted from the center device 12. The received detection data is supplied to the notification image generation unit 124 via the control unit 123.

  In step S <b> 87, the notification image generation unit 124 generates a notification image based on the received detection data and supplies the notification image to the display unit 125.

  For example, the notification image generation unit 124 may be an image of a person's face specified by a personal ID registered in advance, such as a user or a parking lot manager who parks the vehicle, or a vehicle in which the monitoring device 11 is installed. An image and an image of a two-dimensional or three-dimensional model of a predetermined person are recorded. Here, the notification image generation unit 124 records a vehicle image and a human model image taken from a plurality of different directions as a vehicle image and a human model image.

  The notification image generation unit 124 uses a recorded person model image, a person face image specified by the personal ID, and a vehicle image as appropriate, and performs two-dimensional or three-dimensional notification based on the detection data. Generate an image.

  More specifically, for example, the notification image generation unit 124 uses the recorded vehicle image and human model image to indicate the posture of the human model by the posture information included in the detection data. Each part of the recorded person's model such as a hand and a foot is deformed so as to obtain a posture of the person, and an image of the person's model having the posture indicated by the deformed posture information is generated. Then, the notification image generation unit 124 displays the notification image so that the image of the human model in the posture indicated by the generated posture information, that is, the image of the approaching person is displayed at the position indicated by the position information with respect to the vehicle. Generate.

  At this time, when the image of the person specified by the personal ID included in the detection data is recorded, the notification image generation unit 124 uses the personal ID in the face part of the human model of the notification image. A notification image is generated so that an image of the face of the identified person is displayed. In this way, by displaying the face image of a person registered in advance, the user can immediately determine whether or not the approaching person is a suspicious person.

  When the image of the person specified by the personal ID is not recorded, the notification image generation unit 124 always displays the color of the person's image specified by the same personal ID, for example, the color of the person's clothes. The notification image may be generated so as to be displayed in the same color, so that the user can easily determine whether the displayed approaching person is the same person as the approaching person detected before.

  Further, the notification image generation unit 124 prevents the approaching person from being hidden behind the vehicle in the notification image, that is, the approaching person is displayed on the near side of the vehicle. Is generated as a notification image.

  When the notification image is generated, in step S88, the display unit 125 displays the notification image supplied from the notification image generation unit 124, the process returns to step S81, and the above-described processing is repeated. Thereby, the notification image shown in FIG. 9 is displayed on the display unit 125, for example.

  FIG. 9 shows a display example of a two-dimensional notification image. The notification image is an image of the vehicle 151 viewed from the side. In the notification image shown in FIG. 9, an image in which the door of the vehicle 151 as the monitoring target is opened and the approaching person 152 is about to enter the vehicle 151 is displayed.

  As described above, since the notification image is generated and displayed based on the detection data, the user sees the notification image, so that the approaching person 152 is a person unknown to the user and opens the door of the vehicle 151. And that the approaching person 152 is about to enter the vehicle 151 can be grasped instantaneously. That is, the user can grasp the situation around the vehicle 151 to be monitored more quickly and accurately by looking at the notification image.

  Further, for example, a notification image shown in FIG. 10 is displayed on the display unit 125.

  FIG. 10 shows a display example of a three-dimensional notification image. The notification image is an image obtained by viewing the vehicle 151 from an oblique front. In the notification image shown in FIG. 10, an image in which the approaching person 152 is passing in front of the vehicle 151 to be monitored is displayed.

  As described above, since the notification image is generated and displayed based on the detection data, the user views the notification image, so that the approaching person 152 is a person unknown to the user, but the approaching person 152 is the vehicle. It is possible to instantly recognize that the person is a passerby who passes the vicinity of 151.

  Note that the display example of the notification image is not limited to the example illustrated in FIGS. 9 and 10. For example, the notification image is based on action information included in detection data such as “a person is about to enter a car”. A message may be displayed, or the part of the vehicle touched by the approaching person may be displayed in a color different from the color of the vehicle and highlighted or blinked.

  Also, detection data for a predetermined period is received so that a position where an approaching person was detected in the past blinks and is displayed, or a position where an approaching person is detected at each time of a predetermined period The afterimage of the approaching person may be displayed on the screen.

  Further, changes in the position and posture of the approaching person for a predetermined period, that is, past movements of the approaching person may be displayed as an animation. May be displayed repeatedly.

  Furthermore, when the action information included in the detection data is action information indicating that an approaching person has touched the door handle, the door handle is displayed in close-up, or a foreign object is detected in the key cylinder Alternatively, an image in which an approaching person holds a foreign object in his / her hand may be displayed.

  Note that the notification process ends when the user operates the input unit 122 to instruct the end of vehicle monitoring, and a command corresponding to the user's operation is supplied from the input unit 122 to the control unit 123. Moreover, the process which receives the detection data mentioned above and displays a notification image is performed using a web browser, for example.

  In this way, the terminal device 13 receives the detection data from the center device 12, and generates and displays a notification image based on the received detection data.

  In this way, by displaying the notification image of the monitoring target and the approaching person of the detected posture based on the received detection data, the user can accurately grasp the situation around the vehicle that is the monitoring target. Can do.

  As described above, since the detected data including the detected posture and position of the approaching person and the personal ID for specifying the approaching person are transmitted, the terminal device 13 owned by the user can accurately detect the surroundings of the vehicle. Information for grasping the situation can be transmitted.

  In addition, since the image of the approaching person in the posture indicated by the detection data is displayed as the notification image at the position indicated by the detection data, the user can accurately grasp the situation around the vehicle to be monitored. can do.

  In the above description, it has been described that the detection data generated in the monitoring device 11 is transmitted to the terminal device 13 via the center device 12. However, the detection data is transmitted directly from the monitoring device 11 to the terminal device 13. You may do it. Further, a display device is connected to the monitoring device 11 so that detection data is transmitted from the monitoring device 11 to the display device, and a notification image is displayed on the display device based on the received detection data. Also good.

  Furthermore, the center device 12 may generate a notification image based on the detection data, and transmit the notification image generated by the center device 12 to the terminal device 13.

  Furthermore, when a personal ID for identifying a suspicious person detected in the past is registered in the terminal device 13 in advance and detection data including the personal ID is received, the person displayed in the notification image The model may be displayed blinking, or a blinking frame surrounding the person's model may be displayed.

  Furthermore, an image of the approaching person's face photographed by the monitoring device 11 is transmitted from the center device 12 to the terminal device 13. In the terminal device 13, the approaching person's face image is a person in the notification image. It may be displayed on the face portion of the model. By doing in this way, when there are a plurality of approaching persons, the user can easily identify each of the plurality of approaching persons. In addition, when the approach of the approaching person indicated by the action information is not an action that causes harm to the vehicle, it is possible to prevent the face image of the approaching person from being transmitted to the terminal device 13. In such a case, the privacy of a non-malicious approacher can also be protected.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  FIG. 11 is a block diagram showing an example of the configuration of a personal computer that executes the above-described series of processing by a program. A CPU (Central Processing Unit) 211 of the personal computer 201 executes various processes according to a program recorded in a ROM (Read Only Memory) 212 or a recording unit 218. A RAM (Random Access Memory) 213 appropriately stores programs executed by the CPU 211 and data. These CPU 211, ROM 212, and RAM 213 are connected to each other by a bus 214.

  An input / output interface 215 is also connected to the CPU 211 via the bus 214. The input / output interface 215 is connected to an input unit 216 including a keyboard, a mouse, and a microphone, and an output unit 217 including a display and a speaker. The CPU 211 executes various processes in response to commands input from the input unit 216. Then, the CPU 211 outputs the processing result to the output unit 217.

  The recording unit 218 connected to the input / output interface 215 includes, for example, a hard disk, and records programs executed by the CPU 211 and various data. The communication unit 219 communicates with an external device via a network such as the Internet or a local area network.

  Further, the program may be acquired via the communication unit 219 and recorded in the recording unit 218.

  A drive 220 connected to the input / output interface 215 drives a removable medium 231 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives the program or data recorded therein. Get etc. The acquired program and data are transferred to the recording unit 218 and recorded as necessary.

  As shown in FIG. 11, a program recording medium that stores a program that is installed in a computer and is ready to be executed by the computer includes a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (Digital Versatile Disc) (including magneto-optical disk), or removable media 231 which is a package medium made of semiconductor memory, or ROM 212 where the program is temporarily or permanently stored, The recording unit 218 is configured by a hard disk or the like. The program is stored in the program recording medium using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication unit 219 which is an interface such as a router or a modem as necessary. Done.

  In the present specification, the step of describing the program stored in the program recording medium is not limited to the processing performed in time series in the described order, but is not necessarily performed in time series. Or the process performed separately is also included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a figure which shows the structural example of one Embodiment of the monitoring system to which this invention is applied. It is a block diagram which shows the structure of a monitoring apparatus. It is a block diagram which shows the structure of a center apparatus. It is a block diagram which shows the structure of a terminal device. It is a flowchart explaining a monitoring process. It is a flowchart explaining a detection data transmission process. It is a figure which shows an example of detection data. It is a flowchart explaining a notification process. It is a figure which shows the example of a display of a notification image. It is a figure which shows the example of a display of a notification image. It is a block diagram which shows the structure of a personal computer.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Monitoring apparatus 12 Center apparatus 13 Terminal apparatus 41 Imaging part 42 Sensor part 43 Monitoring part 51 Position detection part 52 Feature point extraction part 54 Face recognition part 55 Face direction detection part 56 Posture detection part 57 Action estimation part 58 Detection data generation part 59 Communication unit 121 Communication unit 123 Control unit 124 Notification image generation unit 125 Display unit

Claims (12)

Photographing means for photographing a monitoring area that is a surrounding area of the monitoring target;
Monitoring means for monitoring an approaching approach of the approaching person to the thing, or a contact of the approaching person to the thing;
Posture detection means for detecting the posture of the approaching person based on the captured image of the monitoring area and generating posture information indicating the posture of the approaching person;
Position detection means for detecting a position of the approaching person relative to the one based on a monitoring result by the monitoring means and the image, and generating position information indicating the position;
A monitoring device comprising: transmission means configured to transmit detection data indicating the posture of the approaching person and the position relative to the approaching object, which includes the posture information and the position information. Photographing means for photographing a monitoring area that is a surrounding area of the monitoring target;
Monitoring means for monitoring an approaching approach of the approaching person to the thing, or a contact of the approaching person to the thing;
Posture detection means for detecting the posture of the approaching person based on the captured image of the monitoring area and generating posture information indicating the posture of the approaching person;
Position detection means for detecting a position of the approaching person relative to the one based on a monitoring result by the monitoring means or the image, and generating position information indicating the position;
Based on the posture information and the monitoring result, an action estimation unit that estimates an action performed by the approaching person and generates action information indicating the action ;
Transmitting means for transmitting detection data indicating the approaching person's posture and the position with respect to the approaching object, comprising the posture information, the position information, and the action information;
A monitoring device comprising: Recognizing the approaching person's face using the image, further comprising face recognition means for identifying the approaching person,
The transmission unit, the monitoring device according to claim 1 or claim 2 transmits the detection data including the personal ID indicating the approaching individual identified. Further comprising face direction detection means for detecting the direction of the approaching person's face or the direction of the line of sight;
It said posture detecting means, the detection result of the face direction detecting means and based on the image monitoring apparatus according to claim 1 or claim 2 for detecting the posture of the approaching individual. A shooting step for shooting a monitoring area that is a surrounding area of the monitoring target;
A monitoring step of monitoring an approaching approach of the approaching person to the approaching object or an approaching person approaching the approaching object;
A posture detection step of detecting posture of the approaching person based on the image of the captured monitoring area and generating posture information indicating the posture of the approaching person;
Based on the monitoring result of the approach of the approaching person to the thing or the contact of the approaching person to the thing, and the image, position information indicating the position of the approaching person is detected and the position information is indicated. A position detection step to generate;
A monitoring method comprising: a transmission step of transmitting detection data indicating the posture of the approaching person and the position with respect to the approaching object, comprising the posture information and the position information. A shooting step for shooting a monitoring area that is a surrounding area of the monitoring target;
A monitoring step of monitoring an approaching approach of the approaching person to the approaching object or an approaching person approaching the approaching object;
A posture detection step of detecting posture of the approaching person based on the image of the captured monitoring area and generating posture information indicating the posture of the approaching person;
Based on the monitoring result of the approach of the approaching person to the thing or the contact of the approaching person to the thing, and the image, position information indicating the position of the approaching person is detected and the position information is indicated. A position detection step to generate;
A program for causing a computer to execute a transmission step for transmitting detection data indicating the posture of the approaching person and the position of the approaching person, which includes the posture information and the position information. Receiving means for receiving detection data composed of posture information indicating the posture of an approaching person approaching the object to be monitored, and position information indicating the position of the approaching person with respect to the thing;
Based on the detection data, generating means for generating an image of the approaching person in the posture indicated by the posture information and the posture information and notifying the approaching person of the approaching to the thing,
Display means for displaying the generated image;
With
The generating unit is configured to generate an image of a face related to the personal ID recorded in advance in a part of the face of the approaching person in the image based on the detection data including a personal ID indicating the approaching person. Generate the image notifying the approach of the approaching person so that is displayed
Image processing device. The image processing apparatus according to claim 7, wherein the generation unit generates the two-dimensional or three-dimensional image. The said production | generation means produces | generates the said image for carrying out the animation display of the change of the position and attitude | position of the said approaching person based on the said detection data consisting of the said attitude | position information and the said positional information at each time. Image processing device. The image processing apparatus according to claim 7, wherein the generation unit generates the image based on the detection data including action information indicating an action performed by the approaching person. A receiving step of receiving detection data composed of posture information indicating a posture of an approaching person approaching an object to be monitored, and position information indicating a position of the approaching person with respect to the thing;
Based on the detection data, a generation step of generating the image of the approaching person in the posture indicated by the posture information and the posture information, and notifying the approaching person of the approaching to the thing,
A display step for displaying the generated image;
Including
In the generating step, based on the detection data including a personal ID indicating the approaching person, an image of a face associated with the personal ID recorded in advance in the face part of the approaching person in the image Generate the image notifying the approach of the approaching person so that is displayed
Image processing method. A receiving step of receiving detection data composed of posture information indicating a posture of an approaching person approaching an object to be monitored, and position information indicating a position of the approaching person with respect to the thing;
Based on the detection data, a generation step of generating the image of the approaching person in the posture indicated by the posture information and the posture information, and notifying the approaching person of the approaching to the thing,
Causing the computer to execute a process including a display step of displaying the generated image ,
In the generating step, based on the detection data including a personal ID indicating the approaching person, an image of a face associated with the personal ID recorded in advance in the face part of the approaching person in the image Generating the image notifying the approach of the approaching person so that is displayed
program.

Images