JP2018136628A - Monitoring device, monitoring system, monitoring method, communication terminal, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To precisely detect abnormality on an object by using contribution information.SOLUTION: Receiving means receives contribution information including information on an object perceived by each user from a communication terminal 10. Calculating means calculates an index corresponding to the number of pieces of the contribution information received by the receiving means. Detecting means detects abnormality on the object depending on the index calculated by the calculating means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for monitoring a suspicious object.

  Techniques for monitoring suspicious objects are known. For example, in Patent Document 1, a person image of a suspicious candidate is distributed to a local resident based on an image photographed by a photographing camera, and a suspicious person is registered according to whether or not each resident is a suspicious person. The technology is described.

JP 2013-65187 A

In public security in events such as marathons, general spectators may witness suspicious objects before guards and event staff. In such a case, for example, if information posted by a spectator using SNS (Social Networking Service) can be used for detection of a suspicious object, the suspicious object can be discovered more quickly. On the other hand, such information includes information based on misunderstanding and erroneous information, and it cannot be said that the reliability of each piece of information is necessarily high. For this reason, if all of this information is trusted and a suspicious object is detected, the accuracy of detecting the suspicious object deteriorates.
An object of the present invention is to detect an abnormality related to an object with high accuracy using posted information.

The present invention provides a receiving means for receiving post information including information related to an object perceived by each user from a communication terminal, a calculating means for calculating an index corresponding to the number of received post information, and the calculated A monitoring device is provided that includes detection means for detecting an abnormality related to the object in accordance with the index.
Perceived by the user is witnessed by the user, listened by the user, smelled by the user, etc.

  The detection means may detect the abnormality when the index is equal to or greater than a threshold value.

  The posted information includes position information indicating a position at which the information is acquired, and the calculation means includes posted information in which the position indicated by the position information is within a predetermined range among the received posted information. An index corresponding to the number of may be calculated.

  The posting information may include attribute information indicating an attribute of the user, and the calculation unit may weight the index based on the attribute information included in the received posting information.

  The posted information includes image data indicating the target image captured by the communication terminal, first time information indicating the time when the image was captured, and a second time indicating the time when the posted information was transmitted. The calculating means may weight the indicator based on a difference between a time indicated by the first time information and a time indicated by the second time information included in the posted information. Good.

  The calculation means may weight the index based on the content of the received post information.

  The posted information includes image data indicating the target image captured by the communication terminal, first position information indicating a position where the image is captured, and a second position indicating a position where the posted information is transmitted. Information is included, and when the distance between the position indicated by the first position information included in the posted information and the position indicated by the second position information is equal to or greater than a predetermined distance May not reflect the posting information in the index.

  The posted information includes time information indicating a time at which the information was acquired, and the calculation unit includes the posted information in which the time indicated by the time information is within a predetermined period of the received posted information. An index corresponding to the number of may be calculated.

  The monitoring apparatus may further include an output unit that outputs a handling instruction for the target when the abnormality is detected.

  The present invention provides a monitoring device, a communication terminal that communicates with the monitoring device via a communication line, and posting information that is provided in the communication terminal and includes information about an object perceived by each user. Transmitting means, receiving means provided in the monitoring device for receiving the posted information transmitted from the communication terminal, calculating means for calculating an index corresponding to the number of the received posted information, and the calculation A monitoring system is provided that includes detection means for detecting an abnormality related to the object in accordance with the indicated index.

  The present invention includes a step of receiving post information including information related to an object perceived by each user from a communication terminal, a step of calculating an index corresponding to the number of post information received, and the calculated index And a step of detecting an abnormality related to the object.

  The present invention includes a generation unit that generates post information including information related to an object perceived by a user, and a transmission unit that transmits the generated post information to a monitoring device, wherein the monitoring device is configured to transmit the transmitted information. In accordance with the calculated indicator, receiving means for receiving at least one posted information including posted information from at least one communication terminal, calculating means for calculating an index corresponding to the number of received posted information, and And a communication terminal comprising a detecting means for detecting an abnormality related to the object.

  The present invention includes a step of receiving, from a communication terminal, post information including information on an object perceived by each user from a communication terminal, calculating an index corresponding to the number of the received post information, and the calculation. And a step of detecting an abnormality related to the object in accordance with the indicator.

  The present invention is a program for causing a computer to execute a step of generating post information including information related to an object perceived by a user, and a step of transmitting the generated post information to a monitoring device, The monitoring apparatus includes: a receiving unit that receives at least one post information including the transmitted post information from at least one communication terminal; a calculation unit that calculates an index corresponding to the number of the received post information; According to the calculated index, there is provided a program comprising detection means for detecting an abnormality relating to the object.

  According to the present invention, it is possible to accurately detect an abnormality related to an object using posted information.

The figure which shows an example of a structure of the monitoring system 1 which concerns on embodiment. The figure which shows an example of the hardware constitutions of the communication terminal. The figure which shows an example of the hardware constitutions of the server apparatus. The figure which shows an example of a function structure of the monitoring system. 3 is a sequence chart showing an example of the operation of the monitoring system 1. The figure which shows an example of the area | region 200 of the monitoring object of the monitoring system. The figure which shows an example of the production | generation screen 210 of posting information. The figure which shows an example of the weighting table 111. FIG. The figure which shows an example of the monitoring screen. The figure which shows an example of the instruction | indication screen 230. FIG. The figure which shows an example of the weighting table 112 which concerns on a modification. The figure which shows an example of the weighting table 113 which concerns on a modification.

Configuration FIG. 1 is a diagram illustrating an example of a configuration of a monitoring system 1 according to the present embodiment. The monitoring system 1 is used for monitoring a suspicious object in an event held in the public such as a marathon event. This suspicious object includes not only things but also people. The monitoring system 1 includes a plurality of communication terminals 10, a server device 20, and an operation terminal 30. In the example shown in FIG. 1, the number of server devices 20 and the number of operation terminals 30 are both singular, but the number of server devices 20 and the number of operation terminals 30 may be plural.

  Each communication terminal 10 and server device 20 are connected via a communication line 40. The communication line 40 transmits communication between each communication terminal 10 and the server device 20. The communication line 40 includes, for example, the Internet and a wireless communication network. A base station is connected to the wireless communication network. Each communication terminal 10 is wirelessly connected to the communication line 40 via this base station. Note that the communication line 40 is not limited to the one including the Internet and the wireless communication network, and may be configured by other communication lines.

  The communication terminal 10 is a computer that has a wireless communication function and communicates with the server device 20 via the communication line 40. The communication terminal 10 is carried and used by each user. The communication terminal 10 may be, for example, a smartphone, a mobile phone, or a tablet terminal. The users of the communication terminal 10 include, for example, event guards, event staff, and event spectators. A security guard is a person employed by a business operator who guards an event, for example. The staff is, for example, a person related to the event or a person supporting the event, and is a person other than the guard. The audience is an unspecified number of people other than guards and staff.

  The server device 20 and the operation terminal 30 are installed in the monitoring center 50. The monitoring center 50 is a facility for monitoring a suspicious object in an event, for example. The server device 20 is a computer that performs processing related to monitoring of suspicious objects. The operation terminal 30 is a computer used for inputting / outputting information to / from the server device 20. The operation terminal 30 is used by an operator who monitors a suspicious object. The operation terminal 30 may be a personal computer, for example.

  Server device 20 and operation terminal 30 are connected via communication line 60. The communication line 60 transmits communication between the server device 20 and the operation terminal 30. The communication line 60 may be a private network such as a LAN (Local Area Network).

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the communication terminal 10. The communication terminal 10 includes a processor 11, a memory 12, a communication interface 13, a storage 14, an input device 15, a display device 16, a camera 17, and a positioning sensor 18.

  The processor 11 executes various processes by reading the program into the memory 12 and executing it. As the processor 11, for example, a CPU (Central Processing Unit) may be used. The memory 12 stores a program executed by the processor 11. As the memory 12, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or a combination thereof may be used. The communication interface 13 performs data communication with the server device 20 via the communication line 40. The storage 14 stores various data and programs. As the storage 14, for example, a hard disk, a flash memory, or a combination thereof may be used.

  The input device 15 is used for inputting various information. As the input device 15, for example, a physical button, a touch sensor constituting a touch panel, or a combination thereof may be used. The display device 16 displays various information. For example, a liquid crystal display may be used as the display device 16. The camera 17 captures an image of the subject. The camera 17 includes, for example, an optical system and an image sensor, and takes an image of the subject by forming an image of the subject on the image sensor using the optical system. For example, a digital camera may be used as the camera 17. The positioning sensor 18 measures the position of the communication terminal 10. As the positioning sensor 18, for example, a GPS (Global Positioning System) receiver may be used.

  The communication terminal 10 has a time measuring function. This timing function may be realized by hardware, or may be realized by cooperation of hardware and software. For example, the communication terminal 10 may include a clock for measuring time, and the time may be measured using this clock. Further, the communication terminal 10 may store a program for realizing the timekeeping function in the memory 12 or the storage 14, and the processor 11 may execute the program to measure time.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the server device 20. The server device 20 includes a processor 21, a memory 22, a communication interface 23, and a storage 24.

  The processor 21 executes various processes by reading the program into the memory 22 and executing it. For example, a CPU is used as the processor 21. The memory 22 stores a program executed by the processor 21. As the memory 22, for example, ROM, RAM, or a combination thereof may be used. The communication interface 23 performs data communication with each communication terminal 10 via the communication line 40. The communication interface 23 performs data communication with the operation terminal 30 via the communication line 60. The storage 24 stores various data and programs. As the storage 24, for example, a hard disk, a flash memory, or a combination thereof may be used.

  The operation terminal 30 includes an input device and a display device. The input device is used for inputting information. As the input device, for example, a keyboard and mouse, physical buttons, a touch sensor constituting a touch panel, or a combination of at least two of them may be used. The display device displays various information. For example, a liquid crystal display may be used as the display device.

  FIG. 4 is a diagram illustrating an example of a functional configuration of the monitoring system 1. The monitoring system 1 functions as a generation unit 101, a transmission unit 102, a reception unit 103, a calculation unit 104, a detection unit 105, a notification unit 106, and an output unit 107. In FIG. 4, two communication terminals 10 are described, but these communication terminals 10 may be the same communication terminal 10 or different communication terminals 10.

  In this example, the generation unit 101 and the transmission unit 102 are mounted on the communication terminal 10. The generation unit 101 is realized by a combination of a program stored in the memory 12 and a processor 11 that executes the program. The transmission means 102 is realized by a combination of a program stored in the memory 12, a processor 11 that executes the program, and a communication interface 13 that operates under the control of the processor 11.

  The reception unit 103, the calculation unit 104, the detection unit 105, the notification unit 106, and the output unit 107 are mounted on the server device 20. In this case, the server device 20 functions as a monitoring device. The receiving means 103, the notification means 106, and the output means 107 are demonstrated by a combination of a program stored in the memory 22, a processor 21 that executes the program, and a communication interface 23 that operates under the control of the processor 21. . The calculation unit 104 and the detection unit 105 are realized by a combination of a program stored in the memory 22 and a processor 21 that executes the program.

  The generation unit 101 generates post information including information related to an object perceived by each user. Here, a suspicious object witnessed by the user will be described as an example of an object perceived by the user. The information regarding the target may include at least one of information indicating the fact that the target is perceived, image data indicating the target image, and characteristic information indicating the feature of the target, for example. The posted information is information that is sent spontaneously by the user, for example. The transmission unit 102 transmits the posting information generated by the generation unit 101 to the server device 20. Other examples of objects perceived by each user include information such as suspicious persons witnessed by users or fires, abnormal sounds heard by users, explosion sounds, or odors smelled by users. You may do it.

  The receiving unit 103 receives post information transmitted from the transmitting unit 102. The calculating unit 104 calculates an index corresponding to the number of post information received by the receiving unit 103. This index is, for example, a value indicating the authenticity of the posted information. As this index, for example, points are used. Further, the calculation unit 104 may weight the index with reference to the weighting table 111. The weighting table 111 is stored in the storage 24 in advance, for example.

  The detection unit 105 detects an abnormality related to the object according to the index calculated by the calculation unit 104. This abnormality is an abnormality that a suspicious object exists, for example. The notification unit 106 notifies the operation terminal 30 of the abnormality detected by the detection unit 105. The output unit 107 outputs a handling instruction for the target. This countermeasure instruction is transmitted to the communication terminal 10, for example. That is, the concept of the term “output” includes transmission.

  In the following description, when the communication terminal 10 is described as the subject of processing, this processing is specifically a combination of a program stored in the memory 12 and a processor 11 that executes the program, or these. This means that the processing is executed in combination with the communication interface 13 that operates under the control of the processor 11. The same applies to the server device 20.

Operation FIG. 5 is a sequence chart showing an example of the operation of the monitoring system 1. FIG. 6 is a diagram illustrating an example of the monitoring target area 200 of the monitoring system 1. In this example, the monitoring system 1 monitors suspicious objects in the area 200. The region 200 is divided into areas A1 to A4. These areas A1 to A4 are examples of a predetermined range. The setting of the area is not limited to the example of equally dividing as shown in FIG. 6, and the size may be appropriately set individually according to the region (commercial area, residential area), the structure, the shape of the road, and the like. Alternatively, a predetermined range including the position of the first posting may be set dynamically, for example, as an area.

  Here, it is assumed that the spectator 201 in the area A1 witnesses a suspicious object. In the following description, the communication terminal 10 used by the spectator 201 is referred to as “communication terminal 10A”. The audience 201 uses the input device 15 to perform an operation for generating post information. This operation may be performed on the posting information generation screen 210 displayed on the display device 16, for example.

  FIG. 7 is a diagram illustrating an example of the post information generation screen 210. The generation screen 210 includes a preview area 211, a text box 212, and a post button 213. In the preview area 211, an image of a suspicious object is displayed. For example, when the spectator 201 captures an image of a suspicious object with the camera 17, the captured image is displayed in the preview area 211. The text box 212 is used for inputting text information regarding the suspicious object. This text information may indicate only the fact that a suspicious object has been witnessed, or may include characteristic information indicating the characteristics of the suspicious object together with information indicating this fact. This feature information may include, for example, information indicating the size, shape, color, or movement of the suspicious object. The post button 213 is used for an operation of transmitting post information. When the generation of the posting information is completed, the spectator 201 presses the posting button 213 using the input device 15.

  When the posting button 213 is pressed, the process of step S101 shown in FIG. 5 is started. In this example, the processing of steps S101 and S102 below is performed by the communication terminal 10A.

  In step S <b> 101, the generation unit 101 generates post information related to a suspicious object in accordance with the operation of the spectator 201. In this example, the posting information includes image data indicating an image displayed in the preview area 211 shown in FIG. 7 and text information input in the text box 212. Attribute information is added to this image data. The attribute information includes position information indicating the position where the image was shot (hereinafter referred to as “shooting position”) and date information indicating the date and time when the image was shot (hereinafter referred to as “shooting date”). included. As the position information indicating the shooting position, for example, information indicating the position of the communication terminal 10 measured by the positioning sensor 18 when an image is shot is used. The position information indicating the photographing position is an example of position information indicating the position where the information regarding the suspicious object is acquired. As the date and time information indicating the shooting date and time, for example, information indicating the date and time measured by the time measuring function when an image is shot is used. The date / time information indicating the shooting date / time is an example of time information indicating a time at which information on the suspicious object is acquired.

  Note that the posting information does not necessarily include image data. When the posting information does not include image data, the posting information does not include position information indicating the shooting position and date / time information indicating the shooting date and time.

  In step S <b> 102, the transmission unit 102 transmits the posting information generated in step S <b> 101 to the server device 20. The posted information includes position information indicating the position where the posted information is transmitted (hereinafter referred to as “posted position”) and date / time information indicating the date and time when the posted information is transmitted (hereinafter referred to as “posted date”). And a user ID that uniquely identifies the communication terminal 10 </ b> A of the audience 201. As the position information indicating the posting position, for example, information indicating the position of the communication terminal 10 measured by the positioning sensor 18 when the posting information is transmitted is used. As the date / time information indicating the posting date / time, for example, information indicating the date / time measured by the time measuring function when the posting information is transmitted is used. The user ID may be stored in the storage 14 in advance. For example, the user ID may be a solid identification number of the communication terminal 10, a mail address, or the like. When the posting function of this embodiment is provided as a specific application, a user ID may be set when the application is installed in the communication terminal 10 and stored in the storage 14. The set user ID is also stored in the server device 20. When the user ID of the audience 201 is “U001”, this user ID “U001” is included in the posted information. In the server device 20, the receiving means 103 receives post information from the communication terminal 10A.

  In step S <b> 103, the server device 20 stores the received posting information in the storage 24. In this way, the post information transmitted from the plurality of communication terminals 10 is accumulated in the storage 24.

  In step S <b> 104, the calculation unit 104 calculates points corresponding to the number of post information stored in the storage 24 (hereinafter referred to as “post number”) for each area. The process of step S104 may be performed every time new post information is stored in step S103, or may be performed at a predetermined timing. The ratio between the number of posts and the points is stored in the storage 24 in advance, for example. Here, it is assumed that the point is 0 in the initial state, and the ratio between the number of posts and the point is 1: 1. In this case, when the number of posts increases by 1, 1 point is added.

  In the example shown in FIG. 6, points are calculated for each of the areas A1 to A4. The points of area A1 are calculated according to the number of pieces of post information relating to suspicious objects witnessed in area A1. In which area each piece of posted information relates to a suspicious object witnessed is determined based on, for example, position information indicating a posted position or position information indicating a shooting position included in the posted information. For example, when the posting position is a position in the area A1, the posting information may be determined to relate to a suspicious object that has been witnessed in the area A1. Further, when the shooting position is a position in the area A1, the post information may be determined to be related to a suspicious object that has been witnessed in the area A1.

  In addition, when the posting information is transmitted a plurality of times from the same person, the calculation unit 104 may calculate points by regarding the posting information as one piece of posting information. For example, it is assumed that the spectator 201 transmits post information twice. In this case, the storage 24 stores two pieces of post information including the user ID “U001” of the audience 201. These pieces of post information may be regarded as one piece of post information and points may be calculated. In other words, instead of adding 2 points to these pieces of post information, 1 may be added.

  Further, the calculation unit 104 may refer to the weighting table 111 and weight the points based on the user attributes. This user attribute may be determined based on the user ID included in the posting information. For example, for each user ID of the user, the attribute of the user may be determined in advance. In another example, a staff user ID and a security guard user ID may be registered in advance. In this case, for example, when the user ID included in the posted information is not registered, the attribute of the user who posted the posted information may be determined to be “general person”.

  FIG. 8 is a diagram illustrating an example of the weighting table 111. The weighting table 111 stores attribute information indicating user attributes and weighting factors in association with each other. User attributes include general people, staff, and security guards. An ordinary person means a person other than the staff and the guards. The general public includes the audience. The weighting factor is a positive value. For example, the higher the reliability of the user attribute, the larger the weight coefficient.

  For example, in the weighting table 111, the attribute information “general person” and the weighting coefficient “1” are stored in association with each other. This indicates that when the weighting factor is 1, no weighting is performed. For example, when one post information is posted by a general person, 1 point is added. This posting means sending posting information.

  The weighting table 111 stores attribute information “staff” and a weighting factor “2” in association with each other. This indicates that the posting information posted by the staff is weighted using the weighting factor “2”. For example, when one piece of posted information is posted by the staff, 1 point is added. That is, when posted information is posted by the staff, the value added to the points is doubled compared to when posted information is posted by a general person.

  Furthermore, the weighting table 111 stores attribute information “guard” and a weighting factor “5” in association with each other. This indicates that the posting information posted by the security guard is weighted using the weighting coefficient “5”. For example, when one piece of posted information is posted by a security guard, 5 points are added. That is, when posted information is posted by a security guard, the value added to the points is five times greater than when posted information is posted by an ordinary person.

  Returning to FIG. 5, in step S105, the detection means 105 determines whether or not the point calculated in step S104 is equal to or greater than a threshold value. For example, this threshold is set to a value corresponding to the number of posts that is considered to be credibility of the posted information. When the point calculated in step S104 is smaller than the threshold (step S105: NO), this process ends. On the other hand, when the point calculated in step S104 is equal to or greater than the threshold (step S105: YES), the process proceeds to step S106.

  In step S106, the detection means 105 detects an abnormality related to the suspicious object. For example, when the point in area A1 is equal to or greater than the threshold value, an abnormality relating to a suspicious object in area A1 is detected. In the following description, post information regarding the suspicious object is referred to as “target post information”.

  In step S <b> 107, the notification unit 106 transmits notification information notifying that an abnormality has been detected to the operation terminal 30. The notification information includes, for example, date / time information indicating the posting date / time included in the target posting information, date / time information indicating the shooting date / time, position information indicating the posting position, position information indicating the shooting position, image data, feature information, and a user At least one of the IDs may be included. Such information may be acquired from the posting information of one target, or may be acquired from the posting information of a plurality of targets. The operation terminal 30 receives notification information from the server device 20.

  In step S108, the operation terminal 30 notifies the operator that an abnormality has been detected. This notification may be performed on the monitoring screen 220 displayed on the display device of the operation terminal 30, for example.

  FIG. 9 is a diagram illustrating an example of the monitoring screen 220. The monitoring screen 220 includes a case image 221, case detailed information 222, and a countermeasure instruction button 223. The case image 221 is an image indicating a case where an abnormality has been detected. As this case image 221, for example, an image indicated by image data included in the notification information may be used. The case detailed information 222 is information indicating details of a case where an abnormality is detected. The case detailed information 222 may include, for example, information indicating a time when an abnormality has occurred, information indicating a place where the abnormality has occurred, and information indicating a contributor who has made a post regarding the abnormality. As the information indicating the time when the abnormality occurred, for example, date information indicating a posting date or date information indicating a shooting date included in the notification information may be used. For example, position information indicating a posting position included in the notification information or position information indicating a shooting position may be used as the information indicating the location where the abnormality has occurred. For example, a user ID included in the notification information may be used as the information indicating the poster.

  For example, when notification information is received, a new case occurs. At this time, a new case image 221 and case detailed information 222 corresponding to the abnormality notified by the notification information are added on the monitoring screen 220. This notifies the operator that a new abnormality has been detected. The operator refers to the monitoring screen 220 and comprehensively considers various situations, and determines whether to deal with the notified abnormality. When it is determined that a countermeasure is taken for the abnormality, the operator presses the countermeasure instruction button 223 using the input device of the operation terminal 30. In this case, the process proceeds to step S109 shown in FIG.

  In step S <b> 109, the operation terminal 30 transmits a handling instruction to the server device 20. The server device 20 receives this handling instruction.

  In step S <b> 110, the output unit 107 transmits a handling instruction for the suspicious object to the communication terminal 10 used by a person who plays a role in dealing with the suspicious object (hereinafter referred to as “coping person”). This countermeasure instruction includes, for example, image data indicating an image of a suspicious object and position information indicating the position of the suspicious object. As this image data, for example, image data included in target posting information may be used. As this position information, for example, position information indicating a posting position included in target posting information or position information indicating a shooting position may be used. Further, the handling instruction may include feature information indicating the characteristics of the suspicious object.

  The coping staff includes, for example, at least one of a guard and a staff. In the following description, the communication terminal 10 used by the coping staff is referred to as “communication terminal 10B”. The communication terminal 10B is at least one communication terminal 10 and may be a plurality of communication terminals 10. The handling instruction may be transmitted only to those who are close to the suspicious object among the handling staff. The person in the vicinity may be a person in the same area or a person in an adjacent area. In the example shown in FIG. 6, the guard 202 exists in the area A1, and the staff 203 exists in the area A3 adjacent to the area A1. In this case, an instruction to deal with a suspicious object in the area A1 may be transmitted to the communication terminal 10B of the guard 202 and the communication terminal 10B of the staff 203. The communication terminal 10 </ b> B receives a handling instruction from the server device 20.

  In step S111, the communication terminal 10B causes the display device 16 to display an instruction screen 230 corresponding to the received countermeasure instruction. FIG. 10 is a diagram illustrating an example of the instruction screen 230. The instruction screen 230 includes an image 231 of the suspicious object and information 232 indicating the position of the suspicious object, as well as text for instructing a countermeasure against the suspicious object sighted in the area A1. As the suspicious object image 231, for example, an image indicated by image data included in the handling instruction may be used. As the information 232 indicating the position of the suspicious object, for example, position information indicating the posting position included in the handling instruction or position information indicating the shooting position may be used.

  When viewing the instruction screen 230, the coping person moves to the area A1 and deals with the suspicious object. This countermeasure may include, for example, finding a suspicious object and performing a treatment so that other people do not touch the suspicious object. Further, this countermeasure may include confirming the suspicious object and taking an appropriate measure against the suspicious object.

  In the above-described example, since the audience transmits the posting information, the communication terminal 10 that transmits the posting information and the communication terminal 10 that receives the handling instruction are different communication terminals 10. However, the communication terminal 10 that transmits the posted information is not necessarily different from the communication terminal 10 that receives the handling instruction. For example, when the security guard or the staff transmits the posted information, the communication terminal 10 that transmits the posted information and the communication terminal 10 that receives the handling instruction may be the same communication terminal 10.

  According to the above-described embodiment, an abnormality relating to a suspicious object is detected in accordance with the number of posts of posting information related to a suspicious object transmitted by the user. In this way, by utilizing post information transmitted by an unspecified number of people, a suspicious object can be found more quickly. Further, when the number of pieces of posted information regarding suspicious items is large to some extent, it is considered that the credibility of the posted information is high. Therefore, it is possible to accurately detect an abnormality related to a suspicious object.

The present invention is not limited to the above-described embodiment. Various modifications may be made to the above-described embodiment. Moreover, the following modifications may be implemented in combination.

Modification 1
In the embodiment described above, the calculation unit 104 is based on the time difference between the time when the image was captured (hereinafter referred to as “imaging time”) and the time when the posting information was transmitted (hereinafter referred to as “posting time”). The points may be weighted. This shooting time is indicated by date / time information indicating the shooting date / time included in the posted information, for example. The posting time is indicated, for example, by date / time information indicating the posting date / time included in the posting information. This weighting may be performed with reference to the weighting table 112, for example. The weighting table 112 is stored in the storage 24 in advance, for example.

  FIG. 11 is a diagram illustrating an example of the weighting table 112. In the weighting table 112, the time difference between the shooting time and the posting time and the weighting coefficient are stored in association with each other. The weighting factor is a positive value. For example, the weight coefficient increases as the time difference between the shooting time and the posting time decreases.

  For example, the weighting table 112 stores a time difference “5 minutes or more” and a weighting coefficient “1” in association with each other. This indicates that weighting is not performed for posted information in which the time difference between the shooting time and the posted time is 5 minutes or more. For example, when one piece of post information whose time difference between the shooting time and the post time is 5 minutes or more is posted, one point is added.

  The weighting table 112 stores a time difference “1 minute or more and less than 5 minutes” and a weighting factor “2” in association with each other. This indicates that, for post information in which the time difference between the shooting time and the post time is 1 minute or more and less than 5 minutes, the points are weighted using the weighting coefficient “2”. For example, when one piece of posting information whose time difference between the shooting time and the posting time is 1 minute or more and less than 5 minutes is posted, 2 points are added.

  Further, the weighting table 112 stores a time difference “less than 1 minute” and a weighting factor “3” in association with each other. This indicates that for post information in which the time difference between the shooting time and the post time is less than one minute, the points are weighted using the weight coefficient “3”. For example, if one piece of posting information whose time difference between the shooting time and the posting time is less than 1 minute is posted, 3 points are added.

  When the time difference between the shooting time and the posting time is small, it means that the user has sent posting information including the image immediately after shooting the image of the suspicious object. In such a case, the urgency of dealing with suspicious objects is considered high. According to this modification, when the time difference between the shooting time corresponding to the posted information and the posted time is small, the target of the posted information is easily detected as abnormal.

Modification 2
In the embodiment described above, the calculation unit 104 may weight points based on the degree of congestion in the area 200. For example, when the congestion degree of the area A1 is equal to or less than a predetermined congestion degree, the calculation unit 104 may weight the points using the weighting factor “2” for the posted information posted from the area A1. The predetermined degree of congestion is set according to the number of people whose points are considered difficult to reach the threshold value, for example.

  For example, the population density of each area may be used as the degree of congestion. This population density may be measured, for example, by analyzing an image of each area taken from above. This measurement may be performed by the server device 20 or an external device that can communicate with the server device 20.

  In another example, the degree of congestion of a person having the communication terminal 10 in each area may be used as the congestion degree, for example. In this case, for example, the degree of congestion may be measured using the number of communication terminals 10 connected to the base station.

In another example, posting information may be transmitted only to the communication terminal 10 in which a specific application program is installed. In such a case, the degree of congestion of a person having the communication terminal 10 in which a specific application program in each area is installed may be used as the degree of congestion. Such a communication terminal 10 is connected to the server device 20 via the communication line 40 when, for example, a specific application is activated. In this case, the degree of congestion may be measured using the number of communication terminals 10 connected to the server device 20 in this way.
Alternatively, a value predicted from data obtained by counting the number of people in the past may be used as the degree of congestion. For example, it is possible to accumulate the number-of-people measurement values for each time zone measured at a plurality of locations, obtain a predicted value of the congestion status according to the position and time of each area, and use this as the congestion level.

  When the degree of congestion is low, the number of people who send the posted information is small, so that the points hardly reach the threshold value. According to this modification, in an area where the degree of congestion is low, even if the number of pieces of post information transmitted from the area is small, the target of the post information can be detected as abnormal.

Modification 3
In the embodiment described above, the calculation unit 104 may weight points based on the content of the posted information. This weighting may be performed using the weighting table 113, for example. The weighting table 113 is stored in the storage 24 in advance, for example.

  FIG. 12 is a diagram illustrating an example of the weighting table 113. In the weighting table 113, the content of the posting information and the weighting coefficient are stored in association with each other. The content of the posted information includes “not including feature information and image data”, “including image data”, and “including feature information”. The content of feature information “not including feature information and image data” indicates that the post information does not include the feature information or image data of the suspicious object. The feature information content “including image data” indicates that the post information includes image data of a suspicious object. The feature information content “includes feature information” indicates that the posted information includes the feature information of the suspicious object. The weighting factor is a positive value. For example, the weight coefficient increases as the information related to the suspicious object included in the feature information becomes more prominent.

  For example, in the weighting table 113, the content of post information “not including feature information and image data” and the weighting coefficient “1” are stored in association with each other. This indicates that the points are not weighted when the post information does not include the suspicious object characteristic information and image data. For example, when one piece of post information indicating only the fact that a suspicious object has been witnessed is posted, one point is added.

  Also, the weighting table 113 stores the contents of the posting information “including image data” and the weighting coefficient “2” in association with each other. This indicates that when the image information of the suspicious object is included in the posted information, the points are weighted using the weighting coefficient “2”. For example, when one piece of posting information including image data is posted, 2 points are added.

  Further, in the weighting table 113, the content of the posting information “including feature information” and the weighting factor “2” are stored in association with each other. This indicates that when the suspicious object feature information is included in the posted information, the points are weighted using the weighting coefficient “2”. For example, when one piece of post information including characteristic information of a suspicious object is posted, two points are added.

  When the posted information includes influential information regarding the suspicious object, the posted information is considered to be highly credible. According to this modified example, points can be calculated with emphasis on post information including influential information on suspicious objects.

  In addition, in this modification, when the same person has posted post information with different contents a plurality of times, using the post information having the largest value added to the points among these post information, May be calculated. For example, it is assumed that the spectator 201 transmits post information that includes neither suspicious object image data nor suspicious object feature information, and then transmits post information that includes suspicious object image data. In this case, the value added to the point for the first post information is 1. On the other hand, the value added to the points for the second posting information is 2. In this case, 2 points may be added using the second posting information. In this case, the first post information is not reflected in the points. According to this configuration, when the same person posts posting information with different contents a plurality of times, it is possible to prevent posting information with a large value added to the points from being reflected on the points.

Modification 4
In the above-described embodiment, the communication terminal 10 may transmit information for weighting to the server device 20. For example, when the user of the communication terminal 10 is a staff member, the weight coefficient “2” may be transmitted to the server device 20 together with the posting information. In this case, the calculation unit 104 may weight the points using the weight coefficient “2” received from the communication terminal 10. In this case, the weighting table 111 may not be stored in the storage 24. The same applies to Modifications 1 to 3 described above.

Modification 5
In the embodiment described above, when the distance between the shooting position corresponding to the posting information and the posting position is equal to or greater than a predetermined distance, the calculation unit 104 does not need to reflect the posting information on the points. This shooting position is indicated by position information indicating the shooting position added to the image data included in the posted information, for example. The posting position is indicated by position information indicating a posting position included in the posting information, for example. For example, the predetermined distance is set such that the photographer of the image and the poster of the posting information can be regarded as different people. For example, when the distance between the shooting position corresponding to the posted information and the posted position is equal to or greater than a predetermined distance, the posted information may be deleted from the storage 24. In another example, when the distance between the shooting position corresponding to the posted information and the posted position is equal to or greater than a predetermined distance, a flag indicating the prohibition of use is added to the posted information, and the posted information points. It may not be used for the calculation of.

  Further, in this modified example, each communication terminal 10 instead of the server device 20 may limit the posting information in which the distance between the shooting position and the posting position is not less than a predetermined distance from being reflected on the points. . For example, when the distance between the shooting position corresponding to the posted information and the posted position is equal to or greater than a predetermined distance, the communication terminal 10 may prohibit transmission of the posted information. Further, the interval between the shooting time and the posting time may be added to the determination condition. That is, if the shooting position and the posting position are not less than a predetermined distance and the shooting time and the posting time are within a predetermined period, it is highly likely that the photographer and the poster are different people, so the posting information is transmitted. May be prohibited.

  When the distance between the shooting position and the posting position is large, there is a possibility that the photographer of the image and the poster of the posting information are different people. Such posted information is considered to be incorrect posted information. According to this modified example, it is possible to prevent incorrect posted information from being reflected on the points, such that the photographer of the image is different from the poster of the posted information.

Modification 6
In the above-described embodiment, the calculation unit 104 does not need to reflect the posting information in the points when the number or frequency at which the same user transmits the posting information is a predetermined number or frequency. This predetermined number of times or frequency is set to a number of times or a frequency at which the posting information can be regarded as being posted due to mischief, for example. For example, when the number or frequency of posting information including the same user ID is greater than or equal to a predetermined number or frequency, the posting information including this user ID may be deleted from the storage 24. In another example, if the number or frequency of posting information including the same user ID is equal to or higher than a predetermined number or frequency, a flag indicating prohibition of use is added to the posting information including the user ID. The posted information may not be used for calculating points.

  Further, in this modified example, each communication terminal 10 instead of the server device 20 restricts the posting information whose frequency or frequency that the same user transmits the posting information from being reflected to the point is not reflected in the points. May be. For example, when the number or frequency of posting information is greater than or equal to a predetermined number or frequency, the communication terminal 10 may prohibit transmission of subsequent posting information.

  When the number or frequency of sending post information by the same user is abnormally large, the post information may have been sent due to mischief. According to this modification, it is possible to prevent post information transmitted due to mischief from being reflected in points.

Modification 7
In the above-described embodiment, the calculation unit 104 may calculate points according to the number of post information transmitted within a predetermined period of the post information received by the reception unit 103. The time at which the posting information is posted is indicated by date / time information indicating the posting date / time included in the posting information, for example. For example, when the predetermined period is 30 minutes, the number of posts is calculated based on post information transmitted from 30 minutes before the current time to the current time.

  If the posting information is transmitted at different times, the posting information may be related to different suspicious objects. According to this modification, the possibility that points are calculated based on the number of pieces of post information regarding different suspicious objects can be reduced.

Modification 8
In the embodiment described above, the calculation unit 104 may calculate points according to the number of pieces of post information related to suspicious objects having the same or similar characteristics among the post information received by the reception unit 103. In this case, the feature of the suspicious object that is the target of the posted information is extracted based on the posted information. This extraction may be performed, for example, by analyzing image data included in the posted information, or may be performed by analyzing feature information included in the posted information. For example, points may be calculated according to the number of pieces of post information whose extracted feature similarity is equal to or higher than a predetermined similarity. This predetermined similarity is set to a similarity that can be regarded as the same suspicious object, for example.

  If the characteristics of the suspicious object recognized from the posted information are greatly different, the posted information may be related to a different suspicious object. According to this modification, the possibility that points are calculated based on the number of pieces of post information regarding different suspicious objects can be reduced.

Modification 9
In the above-described embodiment, a countermeasure instruction may be output without an operator's operation. For example, when an abnormality is detected by the detection unit 105, the output unit 107 may output a countermeasure instruction for a suspicious object. According to this modification, it is possible to reduce the time and effort for performing a handling instruction.

Modification 10
In the above-described embodiment, the target for implementing the function of the monitoring system 1 is not limited to the example shown in FIG. For example, some of the functions implemented in the server device 20 may be implemented in an external device that can communicate with the server device 20.

Modification 11
The steps of processing performed in the monitoring system 1 are not limited to the example described in the above-described embodiment. The steps of this process may be interchanged as long as there is no contradiction. The present invention may be provided as a monitoring method including processing steps performed in the monitoring system 1.

Modification 12
The present invention may be provided as a program executed in the communication terminal 10, the server device 20, or the operation terminal 30. This program may be downloaded via a communication line such as the Internet. The program is provided in a state where it is recorded on a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. May be.

1: monitoring system, 10: communication terminal, 20: server device, 101: generation means, 102: transmission means, 103: reception means, 104: calculation means, 105: detection means, 106: notification means, 107: output means

Claims (14)

Receiving means for receiving from the communication terminal post information including information on the object perceived by each user;
Calculating means for calculating an index corresponding to the number of received post information;
A monitoring device comprising: a detecting unit that detects an abnormality related to the target according to the calculated index. The monitoring device according to claim 1, wherein the detection unit detects the abnormality when the index is equal to or greater than a threshold value. The posting information includes position information indicating a position where the information is acquired;
The monitoring device according to claim 1, wherein the calculation unit calculates an index corresponding to the number of pieces of post information in which the position indicated by the position information is within a predetermined range among the received post information. . The posting information includes attribute information indicating an attribute of the user,
The monitoring device according to claim 1, wherein the calculation unit weights the index based on the attribute information included in the received post information. The posted information includes image data indicating the target image captured by the communication terminal, first time information indicating the time when the image was captured, and a second time indicating the time when the posted information was transmitted. Information and
The calculation means weights the indicator based on a difference between a time indicated by the first time information and a time indicated by the second time information included in the posted information. The monitoring device according to claim 1. The monitoring device according to claim 1, wherein the calculation unit weights the index based on the content of the received post information. The posted information includes image data indicating the target image captured by the communication terminal, first position information indicating a position where the image is captured, and a second position indicating a position where the posted information is transmitted. Information and
When the distance between the position indicated by the first position information included in the posting information and the position indicated by the second position information is equal to or greater than a predetermined distance, the calculating means The monitoring device according to any one of claims 1 to 6, wherein: The posted information includes time information indicating the time when the information was acquired,
The calculation unit calculates an index corresponding to the number of pieces of post information in which the time indicated by the time information is within a predetermined period of the received post information. The monitoring device described in 1. The monitoring apparatus according to any one of claims 1 to 8, further comprising an output unit that outputs a handling instruction for the target when the abnormality is detected. A monitoring device;
A communication terminal that communicates with the monitoring device via a communication line;
Transmitting means that is provided in the communication terminal and transmits post information including information related to an object perceived by each user to the monitoring device;
A receiving means provided in the monitoring device for receiving the posted information transmitted from the communication terminal;
Calculating means for calculating an index corresponding to the number of received post information;
A monitoring system comprising: detecting means for detecting an abnormality related to the object according to the calculated index. Receiving from the communication terminal post information including information about the object perceived by each user;
Calculating an index corresponding to the number of post information received;
Detecting an abnormality related to the object according to the calculated index. Generating means for generating post information including information about the object perceived by the user;
Transmission means for transmitting the generated post information to a monitoring device,
The monitoring device
Receiving means for receiving at least one posting information including the transmitted posting information from at least one communication terminal;
Calculating means for calculating an index corresponding to the number of received post information;
A communication terminal comprising: a detecting unit that detects an abnormality related to the target according to the calculated index. On the computer,
Receiving from the communication terminal post information including information about the object perceived by each user;
Calculating an index corresponding to the number of post information received;
And a step of detecting an abnormality related to the object according to the calculated index. On the computer,
Generating post information including information about an object perceived by the user;
A program for executing the step of transmitting the generated posted information to a monitoring device,
The monitoring device
Receiving means for receiving at least one posting information including the transmitted posting information from at least one communication terminal;
Calculating means for calculating an index corresponding to the number of received post information;
A program comprising: detecting means for detecting an abnormality relating to the object according to the calculated index.

Images