US20220212631A1 - Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program - Google Patents
Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program Download PDFInfo
- Publication number
- US20220212631A1 US20220212631A1 US17/703,174 US202217703174A US2022212631A1 US 20220212631 A1 US20220212631 A1 US 20220212631A1 US 202217703174 A US202217703174 A US 202217703174A US 2022212631 A1 US2022212631 A1 US 2022212631A1
- Authority
- US
- United States
- Prior art keywords
- monitoring
- unit
- feature data
- center device
- mounting device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims description 17
- 238000012544 monitoring process Methods 0.000 title abstract description 156
- 238000003672 processing method Methods 0.000 title description 6
- 238000004891 communication Methods 0.000 claims abstract description 33
- 238000012806 monitoring device Methods 0.000 claims 2
- 238000012545 processing Methods 0.000 abstract description 79
- 230000005540 biological transmission Effects 0.000 abstract description 58
- 238000010586 diagram Methods 0.000 description 14
- 230000005856 abnormality Effects 0.000 description 8
- 238000001514 detection method Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 4
- 238000012797 qualification Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 238000011835 investigation Methods 0.000 description 2
- 238000005728 strengthening Methods 0.000 description 2
- 239000000725 suspension Substances 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/305—Detection related to theft or to other events relevant to anti-theft systems using a camera
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/10—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
- B60R25/102—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device a signal being sent to a remote location, e.g. a radio signal being transmitted to a police station, a security company or the owner
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/20—Means to switch the anti-theft system on or off
- B60R25/25—Means to switch the anti-theft system on or off using biometry
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/302—Detection related to theft or to other events relevant to anti-theft systems using recording means, e.g. black box
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R25/00—Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
- B60R25/30—Detection related to theft or to other events relevant to anti-theft systems
- B60R25/31—Detection related to theft or to other events relevant to anti-theft systems of human presence inside or outside the vehicle
Definitions
- the present invention relates to a monitoring system, a monitoring center device, a mounting device, a monitoring method, a processing method, and a program.
- Japanese Unexamined Patent Application, First Publication No. 2016-186813 discloses a technology capable of preventing theft of vehicles such as automobiles and exerting power in arresting a criminal or catching a criminal.
- An example object of the present invention is to provide a monitoring system, a monitoring center device, a mounting device, a monitoring method, a processing method, and a program which can solve the above problems.
- the mounting device includes a photographing unit configured to photograph a passenger, and a feature transmission unit configured to transmit feature data of the passenger
- the monitoring center device includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger, and the monitoring center device are connected via a communication network includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network includes a photographing unit configured to photograph a passenger, a feature transmission unit configured to transmit feature data of the passenger to the monitoring center device, and a start control unit configured to acquire, from the monitoring center device which performs monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and to control starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- a monitoring method includes determining whether the feature data is recorded in a database and performing monitoring processing on the basis of a result of the determination, by a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger, and the monitoring center device are connected via a communication network.
- a processing method includes photographing a passenger, transmitting feature data of the passenger to the monitoring center device, acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, the result of the determination, and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination, by a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network.
- a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and a monitoring center device are connected via a communication network, the processes comprising determining whether or not the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, the processes comprising photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- FIG. 1 is a schematic diagram of a monitoring system according to one embodiment of the present invention.
- FIG. 2 is a hardware configuration diagram of a mounting device according to one embodiment of the present invention.
- FIG. 3 is a functional block diagram of the mounting device and a monitoring center device according to one embodiment of the present invention.
- FIG. 4 is a first diagram which shows a processing flow of the mounting device according to one embodiment of the present invention.
- FIG. 5 is a diagram which shows a processing flow of the monitoring center device according to one embodiment of the present invention.
- FIG. 6 is a diagram which shows a minimum configuration of the mounting device according to one embodiment of the present invention.
- FIG. 7 is a diagram which shows a minimum configuration of the monitoring center device according to one embodiment of the present invention.
- FIG. 1 is a schematic diagram of a monitoring system according to the embodiment.
- a mounting device 1 mounted on a vehicle 10 and a monitoring center device 2 are connected via a communication network.
- the mounting device 1 may communicate and connect with the monitoring center device 2 using, for example, public wireless communication, and may communicate and connect with the monitoring center device 2 via a relay device by performing short-range wireless communication with the relay device wired-connected with the monitoring center device 2 installed at a roadside machine or a position close to a traveling road.
- FIG. 2 is a hardware configuration diagram of the mounting device.
- the mounting device 1 includes, for example, respective hardware constituents such as a central processing unit (CPU) 101 , a read only memory (ROM) 102 , a random access memory (RAM) 103 , a hard disk drive (HDD) 104 , a user interface 105 , a communication module 106 , a camera 107 , a Global Positioning System (GPS) receiver 108 , and the like.
- the user interface 105 is, for example, a liquid crystal touch panel or a button.
- the mounting device 1 may be configured to further include other hardware.
- FIG. 3 is a functional block diagram of the mounting device and the monitoring center device.
- the mounting device executes a program stored in the ROM 102 or the like of the mounting device, thereby including each function of a photographing unit 11 , a feature transmission unit 12 , a position information acquisition unit 13 , a monitoring unit 14 , a movement detection unit 15 , a start control unit 16 , an image transmission unit 17 , and a communication unit 18 therein.
- the photographing unit 11 included in the mounting device 1 performs photographing by controlling the camera 107 , and generates an image by this photographing.
- the photographing unit 11 is installed in a vehicle to photograph a face of a driver of the vehicle and the inside of the vehicle and can photograph moving images and still images.
- the feature transmission unit 12 recognizes the face of the driver on the basis of the image photographed by the camera 107 and obtained by the photographing unit 11 and extracts feature data of a person.
- the feature data in the present embodiment is data including at least feature information on the face of the driver.
- the feature transmission unit 12 may extract feature data of the faces of passengers boarding the vehicle in addition to the driver.
- the feature transmission unit 12 transmits monitoring data including the feature data, position information of the vehicle 10 acquired by the position information acquisition unit 13 , time measured by a timer in the mounting device 1 to the monitoring center device 2 .
- the feature transmission unit 12 may request the image transmission unit 17 to transmit the image, perform processing to alert the driver, or notify the monitoring unit 14 that the feature data cannot be generated.
- the position information acquisition unit 13 calculates a current position of the vehicle 10 on the basis of information included in a signal from a satellite obtained from the GPS receiver 108 .
- the monitoring unit 14 transmits the feature data to a predetermined service device such as the monitoring center device 2 .
- a service device in the present embodiment is the monitoring center device 2 .
- the movement detection unit 15 detects that the vehicle 10 has moved on the basis of acceleration and position information.
- the movement detection unit 15 may detect states of a vehicle such as a stopping state, a stopped state, and a traveling state.
- the movement detection unit 15 can transmit movement states (stopping, stopped, and traveling) of the vehicle 10 .
- the start control unit 16 acquires a determination result from the monitoring center device 2 according to the transmission of the feature data to the monitoring center device 2 , and controls starting of a vehicle on which the mounting device 1 is mounted on the basis of the determination result.
- the start control unit 16 may perform control to start a vehicle when two conditions such as performance of a starting operation of a vehicle using an ignition switch or a key, and acquisition of starting permission by the monitoring unit 14 are satisfied.
- the image transmission unit 17 performs processing of transmitting images acquired from the camera 107 by the photographing unit 11 .
- the communication unit 18 communicates and connects with the monitoring center device 2 .
- the monitoring center device 2 is a computer including hardware such as a CPU, a ROM, a RAM, an HDD, a user interface, and a communication module.
- the CPU of the monitoring center device 2 executes a program, and thereby the monitoring center device 2 includes each function of a monitoring processing unit 21 , a recording unit 22 , a communication unit 25 , and a notification unit 26 .
- the monitoring center device 2 includes a qualified person database 23 and a wanted person database 24 .
- the monitoring processing unit 21 in the monitoring center device 2 searches for the qualified person database 23 storing information on a driver's license possessed by a police institution or the like and the wanted person database 24 in which feature data of a wanted person such as a wanted criminal is recorded.
- the monitoring processing unit 21 collates feature data stored in these databases with feature data obtained from the mounting device 1 and determines whether they match each other.
- the monitoring processing unit 21 transmits a determination result of the collation to the mounting device 1 .
- the recording unit 22 stores monitoring data including feature data and the like of a person transmitted from the feature transmission unit 12 of the vehicle 10 .
- the qualified person database 23 holds data of a driver's license, data of a face photograph of a person on the driver's license, and personal feature data of the person.
- the wanted person database 24 holds data of a face photograph of a wanted person such as a wanted criminal and other personal feature data.
- the communication unit 25 is a processing unit which communicates and connects with the mounting device 1 .
- the notification unit 26 performs processing of notifying a predetermined transmission destination of an abnormality when it is determined that there is an abnormality on the basis of the feature data.
- the notification unit 26 may transfer the abnormality notification to the predetermined transmission destination on the basis of an abnormality notification signal from the mounting device 1 .
- the mounting device 1 and the monitoring center device 2 include such respective functions, and thereby it is possible to reliably monitor a driver of a vehicle and to accumulate monitoring information. Accordingly, this can help with investigations and search and rescue operations of police, firefighting, and the like when there are incidents, accidents, and disasters.
- FIG. 4 is a first diagram which shows a processing flow of the mounting device.
- a driver performs a staring operation of a vehicle using an ignition switch or a key in a cockpit to start the vehicle 10 .
- the camera 107 is installed to photograph the face of the driver.
- the starting operation starts the mounting device 1 .
- the photographing unit 11 controls a photographing operation of the camera 107 (step S 101 ).
- the camera 107 starts photographing and outputs photographed data to the photographing unit 11 .
- This photographed data includes data of the face of the driver.
- the photographing unit 11 generates an image on the basis of the photographed data and output the image to the feature transmission unit 12 .
- the feature transmission unit 12 acquires images (step S 102 ).
- the feature transmission unit 12 determines whether feature data of the face of the driver has been extracted from the image (step S 103 ).
- the feature transmission unit 12 determines whether the number of times it is determined that the feature data of the face of the driver cannot be extracted reaches a predetermined number (step S 104 ).
- the feature transmission unit 12 outputs alert information when No is determined in step S 104 (step S 105 ).
- a case of outputting alert information is a case in which feature data cannot be extracted when the driver's posture is bad or when the driver wears a mask or sunglasses.
- the alert information is information prompting the driver to enable personal feature data to be extracted, and is output by screen display, voice, and the like. If Yes is determined in step S 104 , the feature transmission unit 12 cannot recognize a face image or cannot extract the feature data. For this reason, the feature transmission unit 12 transmits the inability to extract the feature data to the monitoring center device 2 .
- the feature transmission unit 12 instructs the monitoring unit 14 to transmit the feature data.
- the monitoring unit 14 acquires information on a current position of the vehicle 10 from the position information acquisition unit 13 .
- the monitoring unit 14 acquires a current time.
- the monitoring unit 14 transmits monitoring data including at least the feature data, position information, and the current time to the monitoring center device 2 via the communication unit 18 (step S 106 ).
- the monitoring unit 14 determines whether monitoring data has been transmitted.
- the monitoring unit 14 outputs a signal indicating that monitoring data cannot be transmitted to the start control unit 16 when monitoring data cannot be transmitted.
- the monitoring unit 14 determines whether a determination result based on transmission of monitoring data is received from the monitoring center device 2 (step S 107 ).
- the determination result includes various information such as a qualified person flag, a wanted person flag, a still image transmission flag, and a moving image transmission flag.
- the qualified person flag is a flag indicating whether a person corresponding to the feature data has a qualification.
- the wanted person flag is a flag indicating whether a person corresponding to the feature data is a wanted person.
- the still image transmission flag is a flag indicating whether it is necessary to transmit a still image.
- the moving image transmission flag is a flag indicating whether it is necessary to transmit a moving image.
- the monitoring unit 14 analyzes the qualified person flag in analysis processing. In addition, the monitoring unit 14 analyzes the wanted person flag in the analysis processing. In addition, the monitoring unit 14 analyzes the still image transmission flag in the analysis processing. In addition, the monitoring unit 14 analyzes the moving image transmission flag in the analysis processing. The monitoring unit 14 performs processing based on a result of the analysis (step S 109 ).
- the monitoring unit 14 output starting permission to the start control unit 16 when it is determined that the qualified person flag indicates that a person has the qualification.
- the monitoring unit 14 may not output starting permission to the start control unit 16 when it is determined that a qualified person flag indicates that the person does not have the qualification.
- the monitoring unit 14 instructs the image transmission unit 17 to transmit the still image.
- the monitoring unit 14 instructs the image transmission unit 17 to transmit the moving image.
- the image transmission unit 17 sequentially inputs images from the photographing unit 11 .
- the photographing unit 11 generates the moving image on the basis of a plurality of images acquired from the camera 107 and transmits the moving image to the image transmission unit 17 .
- the image transmission unit 17 transmits the moving image to the monitoring center device 2 via the communication unit 18 when a transmission instruction of the moving image is acquired.
- the image transmission unit 17 transmits one still image in images constituting the moving image to the monitoring center device 2 via the communication unit 18 when a transmission instruction of the still image is acquired.
- the mounting device 1 receives a monitoring completion signal from the monitoring center device 2 .
- the monitoring completion signal is acquired by the monitoring unit 14 . If the monitoring unit 14 acquires the monitoring completion signal, the monitoring unit 14 outputs starting permission to the start control unit 16 .
- the start control unit 16 outputs a signal for starting a vehicle to an engine control device when two conditions such as performance of a starting operation of a vehicle using an ignition switch or a key and acquisition of starting permission by the monitoring unit 14 are satisfied (step S 110 ). This starts an engine of the vehicle 10 .
- the vehicle 10 can be started when a starting operation of a vehicle using an ignition switch and a key and monitoring are performed. Accordingly, it is possible to reliably monitor the driver when the vehicle 10 starts.
- the monitoring unit 14 may temporarily store the still image and the moving image without transmitting them to the monitoring center device 2 on the basis of a determination result obtained from the monitoring processing unit 21 .
- the monitoring unit 14 may output starting permission of the vehicle 10 to the start control unit 16 without acquiring a monitoring completion signal from the monitoring center device 2 .
- the monitoring unit 14 can send the still image and the moving image temporarily stored after the communication between the monitoring center device 2 and the mounting device 1 is restored.
- the monitoring unit 14 While the vehicle 10 moves, the monitoring unit 14 performs monitoring processing again if the operation of the vehicle 10 continues for a certain period of time.
- a monitoring processing procedure is the same as the processing shown in FIG. 4 .
- the monitoring unit 14 may not perform monitoring processing when it is determined that the vehicle 10 is started but not moving. Accordingly, it is possible to reliably monitor the driver even when the vehicle 10 is in operation.
- FIG. 5 is a diagram which shows a processing flow of the monitoring center device.
- the monitoring processing unit 21 of the monitoring center device 2 performs person authentication using monitoring data transmitted by the mounting device 1 (step S 501 ).
- the monitoring processing unit 21 collates feature data extracted from the monitoring data with feature data recorded in the qualified person database 23 (step S 502 ).
- the monitoring processing unit 21 stores the feature data and sets the qualified person flag to a value indicating that a person has a qualification.
- the monitoring processing unit 21 collates the feature data extracted from the monitoring data with feature data recorded in the wanted person database 24 (step S 503 ).
- the monitoring processing unit 21 stores the feature data and sets the wanted person flag to a value indicating that a person is the wanted person.
- the monitoring processing unit 21 sets the still image flag to a value indicating that it is necessary to transmit the still image or sets the moving image flag to a value indicating that it is necessary to transmit the moving image.
- the monitoring processing unit 21 transmits a determination result holding various types of flags to the mounting device 1 (step S 504 ).
- the qualified person flag included in the determination result is a value indicating that the person is not the qualified person
- the wanted person flag included in the determination result is a value indicating that the person is not the wanted person
- the feature data providing this determination result is feature data not held in the monitoring center device 2
- the monitoring unit 14 of the mounting device 1 transmits the still image to the monitoring center device 2 .
- the monitoring processing unit 21 of the monitoring center device 2 determines whether a still image is received (step S 505 ). When the still image is received, the monitoring processing unit 21 outputs a face image and the feature data corresponding to the face image to the recording unit 22 .
- the recording unit 22 records the face image and the feature data corresponding to the face image in a database (step S 506 ). As a result, monitoring data is stored. As described above, the monitoring unit 14 is requested to add the feature data to be monitored and the face image.
- the monitoring center device 2 can reliably monitor a driver and further store the monitoring data.
- the monitoring processing unit 21 of the monitoring center device 2 determines that it is an emergency when the inability to extract feature data is acquired by the mounting device 1 or when feature data included in monitoring data is stored in the wanted person database 24 .
- the monitoring processing unit 21 can transmit an instruction to strengthen monitoring to the mounting device 1 .
- the monitoring unit 14 of the mounting device 1 may instruct the image transmission unit 17 to deliver a moving image when information to strengthen monitoring is received. Accordingly, the monitoring center device 2 can perform real-time monitoring.
- the notification unit 26 of the monitoring center device 2 may transmit notification information including the face image and the feature data to a device at a predetermined report destination.
- the monitoring processing unit 21 may record information such as suspension of a driver's license, license invalidation, and an unauthorized vehicle in correlation with the qualified person information of the qualified person database 23 .
- this processing it is possible to detect an obvious driving violation. In this manner, this processing can be used in catching a violation.
- the monitoring center device 2 can ascertain a situation in which a driver is a learner on a temporary license, a foreigner who drives a rental car, or the like when feature information is not recorded in any database according to a result of performing collation processing using two databases of the qualified person database 23 and the wanted person database 24 .
- the monitoring center device 2 can request not only the feature data of a driver but also the face image of the driver to the mounting device 1 , and store and monitor monitoring data including the face image.
- monitoring data such as face images and stored feature data can be searched by a person and person feature information, and this can help with tracking, investigating, and searching for and rescuing persons of interest. Therefore, it is possible to detect and prevent various types of crimes in addition to theft in a moving body such as various vehicles.
- the monitoring unit 14 of the mounting device 1 may permit starting of the vehicle 10 even in a situation in which communication with the monitoring center device 2 is not possible.
- the monitoring unit 14 may request the feature transmission unit 12 to transmit personal feature data when the vehicle 10 continuously runs for a certain distance or more on the basis of state information of the vehicle 10 .
- notification that the feature transmission unit 12 cannot extract personal feature data is continuous, it is possible to determine that it is an emergency, and it is possible to notify the monitoring center device 2 that it is an emergency.
- the notification unit 26 can notify a predetermined device to that effect as an emergency.
- the monitoring processing unit 21 can instruct monitoring strengthening such as continuous photographing and transmission of moving images and transmission of still images to the mounting device 1 .
- the monitoring processing unit 21 can notify a device possessed by a predetermined institution to that effect via the notification unit 26 .
- the monitoring processing unit 21 can instruct the monitoring unit 14 to strengthen monitoring such as transmission of still images. For example, when the monitoring processing unit 21 is notified that it is an emergency by the mounting device 1 , the monitoring processing unit 21 can notify a predetermined device to that effect via the notification unit 26 . Moreover, the monitoring processing unit 21 can instruct the monitoring unit 14 to strengthen monitoring such as transmission of still images.
- FIG. 6 is a diagram which shows a minimum configuration of the mounting device.
- the mounting device 1 as shown in FIG. 6 may be a device including at least a photographing unit 11 , a feature transmission unit 12 , and a start control unit 16 .
- FIG. 7 is a diagram which shows a minimum configuration of the monitoring center device.
- the monitoring center device 2 as shown in FIG. 7 at least includes a monitoring processing unit 21 which determines whether feature data received from the mounting device 1 is recorded in a database, and performs monitoring processing on the basis of a result of the determination.
- the mounting device includes a photographing unit configured to photograph a passenger
- the monitoring center device includes a monitoring processing unit configured to determine whether the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- the monitoring system according to Supplementary note 1 in which the monitoring processing unit transmits a determination result to the mounting device on the basis of the determination result, and the mounting device includes a start control unit which controls starting of a moving body on which the mounting device is mounted on the basis of the determination result.
- the monitoring system according to Supplementary note 1 or Supplementary note 2, in which the monitoring center device includes a recording unit for recording the feature data.
- the monitoring system in which the feature transmission unit transmits a time at which the feature data is extracted from an image generated by photographing the passenger and position information of the moving body together with the feature data to the monitoring center device, and the recording unit records the feature data, the time, and the position information in correlation with each other.
- the monitoring system according to any one of Supplementary note 1 to Supplementary note 4, in which the mounting device includes a movement detection unit for detecting a movement of the moving body, and the feature transmission unit transmits the feature data to the monitoring center device on the basis of detection of a movement of the movement detection unit.
- the monitoring system according to any one of Supplementary note 1 to Supplementary note 5, in which the monitoring processing unit of the monitoring center device determines whether there is an abnormality in the monitoring processing on the basis of the determination result, and the monitoring center device further includes a notification unit for, when it is determined that there is an abnormality, notifying a predetermined transmission destination of the abnormality.
- the monitoring system in which the monitoring processing unit of the monitoring center device requests the mounting device to continuously transmit the feature data, the time, and the position information when it is determined that there is an abnormality in the monitoring processing on the basis of a result of the determination.
- a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and the monitoring center device are connected via a communication network includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- a mounting device in a monitoring system in which a mounting device of a moving body and a monitoring center device are connected via a communication network includes a photographing unit configured to photograph a passenger, a feature transmission unit configured to transmit feature data of the passenger to the monitoring center device, and a start control unit configured to acquire, from the monitoring center device which performs monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination, and to control starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- a monitoring method includes determining whether the feature data is recorded in a database and performing monitoring processing on the basis of a result of the determination, by a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and the monitoring center device are connected via a communication network.
- a processing method includes, by a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device for performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and a monitoring center device are connected via a communication network, the processes comprising determining whether or not the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, the processes comprising photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination, and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- the mounting device 1 described above has a computer system inside.
- a program for causing each device to perform the processing described above is stored in a computer readable recording medium of each of these devices and a computer of each device reads and executes this program to perform the processing described above.
- the computer readable recording medium refers to a magnetic disk, a magneto-optical disc, a CD-ROM, a DVD-ROM, a semiconductor memory, and the like.
- this computer program may be delivered to a computer via a communication line, and the computer receiving this delivery may execute the program.
- the program may realize some of functions of respective processing units described above.
- the program may be a so-called difference file (difference program) which can realize the functions described above in combination with a program already recorded in a computer system.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Alarm Systems (AREA)
- Emergency Alarm Devices (AREA)
- Closed-Circuit Television Systems (AREA)
- Burglar Alarm Systems (AREA)
Abstract
A monitoring system in which a mounting device of a moving body and a monitoring center device are connected via a communication network, wherein the mounting device includes a photographing unit configured to photograph a passenger, and a feature transmission unit configured to transmit feature data of the passenger, and the monitoring center device includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
Description
- The present application is a Continuation application of U.S. patent application Ser. No. 17/005,912 filed on Aug. 28, 2020, which is Continuation application of U.S. patent application Ser. No. 15/849,951 filed on Dec. 21, 2017, which is based upon and claims the benefit of priority from Japanese patent application No. 2017-012731 filed on Jan. 27, 2017, the disclosure of which is incorporated herein in its entirety by reference.
- The present invention relates to a monitoring system, a monitoring center device, a mounting device, a monitoring method, a processing method, and a program.
- A technology aimed at preventing crime using vehicles has been studied. For example, Japanese Unexamined Patent Application, First Publication No. 2016-186813 discloses a technology capable of preventing theft of vehicles such as automobiles and exerting power in arresting a criminal or catching a criminal.
- It is necessary to detect not only theft but various types of crimes in moving bodies such as various vehicles and to prevent crimes.
- An example object of the present invention is to provide a monitoring system, a monitoring center device, a mounting device, a monitoring method, a processing method, and a program which can solve the above problems.
- According to a first example aspect of the present invention, in a monitoring system comprising a mounting device of a moving body and a monitoring center device connected to the mounting device via a communication network, the mounting device includes a photographing unit configured to photograph a passenger, and a feature transmission unit configured to transmit feature data of the passenger, and the monitoring center device includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- According to a second example aspect of the present invention, a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger, and the monitoring center device are connected via a communication network includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- According to a third example aspect of the present invention, a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network includes a photographing unit configured to photograph a passenger, a feature transmission unit configured to transmit feature data of the passenger to the monitoring center device, and a start control unit configured to acquire, from the monitoring center device which performs monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and to control starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- According to a fourth example aspect of the present invention, a monitoring method includes determining whether the feature data is recorded in a database and performing monitoring processing on the basis of a result of the determination, by a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger, and the monitoring center device are connected via a communication network.
- According to a fifth example aspect of the present invention, a processing method includes photographing a passenger, transmitting feature data of the passenger to the monitoring center device, acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, the result of the determination, and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination, by a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network.
- According to a sixth example aspect of the present invention, a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and a monitoring center device are connected via a communication network, the processes comprising determining whether or not the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- According to a seventh example aspect of the present invention, a non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, the processes comprising photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
-
FIG. 1 is a schematic diagram of a monitoring system according to one embodiment of the present invention. -
FIG. 2 is a hardware configuration diagram of a mounting device according to one embodiment of the present invention. -
FIG. 3 is a functional block diagram of the mounting device and a monitoring center device according to one embodiment of the present invention. -
FIG. 4 is a first diagram which shows a processing flow of the mounting device according to one embodiment of the present invention. -
FIG. 5 is a diagram which shows a processing flow of the monitoring center device according to one embodiment of the present invention. -
FIG. 6 is a diagram which shows a minimum configuration of the mounting device according to one embodiment of the present invention. -
FIG. 7 is a diagram which shows a minimum configuration of the monitoring center device according to one embodiment of the present invention. - Hereinafter, a monitoring system, a monitoring center device, a mounting device, a monitoring method, a processing method, and a program according to one embodiment of the present invention will be described with reference to drawings.
-
FIG. 1 is a schematic diagram of a monitoring system according to the embodiment. - In a
monitoring system 100 as shown inFIG. 1 , a mounting device 1 mounted on avehicle 10 and amonitoring center device 2 are connected via a communication network. The mounting device 1 may communicate and connect with themonitoring center device 2 using, for example, public wireless communication, and may communicate and connect with themonitoring center device 2 via a relay device by performing short-range wireless communication with the relay device wired-connected with themonitoring center device 2 installed at a roadside machine or a position close to a traveling road. -
FIG. 2 is a hardware configuration diagram of the mounting device. As shown inFIG. 2 , the mounting device 1 includes, for example, respective hardware constituents such as a central processing unit (CPU) 101, a read only memory (ROM) 102, a random access memory (RAM) 103, a hard disk drive (HDD) 104, auser interface 105, acommunication module 106, acamera 107, a Global Positioning System (GPS)receiver 108, and the like. Theuser interface 105 is, for example, a liquid crystal touch panel or a button. The mounting device 1 may be configured to further include other hardware. -
FIG. 3 is a functional block diagram of the mounting device and the monitoring center device. - The mounting device executes a program stored in the
ROM 102 or the like of the mounting device, thereby including each function of a photographing unit 11, afeature transmission unit 12, a positioninformation acquisition unit 13, amonitoring unit 14, amovement detection unit 15, astart control unit 16, an image transmission unit 17, and a communication unit 18 therein. - The photographing unit 11 included in the mounting device 1 performs photographing by controlling the
camera 107, and generates an image by this photographing. The photographing unit 11 is installed in a vehicle to photograph a face of a driver of the vehicle and the inside of the vehicle and can photograph moving images and still images. - The
feature transmission unit 12 recognizes the face of the driver on the basis of the image photographed by thecamera 107 and obtained by the photographing unit 11 and extracts feature data of a person. The feature data in the present embodiment is data including at least feature information on the face of the driver. Thefeature transmission unit 12 may extract feature data of the faces of passengers boarding the vehicle in addition to the driver. Thefeature transmission unit 12 transmits monitoring data including the feature data, position information of thevehicle 10 acquired by the positioninformation acquisition unit 13, time measured by a timer in the mounting device 1 to themonitoring center device 2. When the feature data cannot be generated from an image, thefeature transmission unit 12 may request the image transmission unit 17 to transmit the image, perform processing to alert the driver, or notify themonitoring unit 14 that the feature data cannot be generated. - The position
information acquisition unit 13 calculates a current position of thevehicle 10 on the basis of information included in a signal from a satellite obtained from theGPS receiver 108. - The
monitoring unit 14 transmits the feature data to a predetermined service device such as themonitoring center device 2. A service device in the present embodiment is themonitoring center device 2. - The
movement detection unit 15 detects that thevehicle 10 has moved on the basis of acceleration and position information. Themovement detection unit 15 may detect states of a vehicle such as a stopping state, a stopped state, and a traveling state. Themovement detection unit 15 can transmit movement states (stopping, stopped, and traveling) of thevehicle 10. - The
start control unit 16 acquires a determination result from themonitoring center device 2 according to the transmission of the feature data to themonitoring center device 2, and controls starting of a vehicle on which the mounting device 1 is mounted on the basis of the determination result. Thestart control unit 16, as an example, may perform control to start a vehicle when two conditions such as performance of a starting operation of a vehicle using an ignition switch or a key, and acquisition of starting permission by themonitoring unit 14 are satisfied. - The image transmission unit 17 performs processing of transmitting images acquired from the
camera 107 by the photographing unit 11. The communication unit 18 communicates and connects with themonitoring center device 2. - The
monitoring center device 2, like the mounting device 1, is a computer including hardware such as a CPU, a ROM, a RAM, an HDD, a user interface, and a communication module. The CPU of themonitoring center device 2 executes a program, and thereby themonitoring center device 2 includes each function of amonitoring processing unit 21, arecording unit 22, acommunication unit 25, and anotification unit 26. In addition, themonitoring center device 2 includes aqualified person database 23 and a wantedperson database 24. - The
monitoring processing unit 21 in themonitoring center device 2 searches for thequalified person database 23 storing information on a driver's license possessed by a police institution or the like and the wantedperson database 24 in which feature data of a wanted person such as a wanted criminal is recorded. Themonitoring processing unit 21 collates feature data stored in these databases with feature data obtained from the mounting device 1 and determines whether they match each other. Themonitoring processing unit 21 transmits a determination result of the collation to the mounting device 1. - The
recording unit 22 stores monitoring data including feature data and the like of a person transmitted from thefeature transmission unit 12 of thevehicle 10. - The
qualified person database 23 holds data of a driver's license, data of a face photograph of a person on the driver's license, and personal feature data of the person. - The wanted
person database 24 holds data of a face photograph of a wanted person such as a wanted criminal and other personal feature data. - The
communication unit 25 is a processing unit which communicates and connects with the mounting device 1. - The
notification unit 26 performs processing of notifying a predetermined transmission destination of an abnormality when it is determined that there is an abnormality on the basis of the feature data. Thenotification unit 26 may transfer the abnormality notification to the predetermined transmission destination on the basis of an abnormality notification signal from the mounting device 1. - The mounting device 1 and the
monitoring center device 2 include such respective functions, and thereby it is possible to reliably monitor a driver of a vehicle and to accumulate monitoring information. Accordingly, this can help with investigations and search and rescue operations of police, firefighting, and the like when there are incidents, accidents, and disasters. -
FIG. 4 is a first diagram which shows a processing flow of the mounting device. - Next, processing of the embodiment of the present invention will be described in order.
- First, a driver performs a staring operation of a vehicle using an ignition switch or a key in a cockpit to start the
vehicle 10. Thecamera 107 is installed to photograph the face of the driver. The starting operation starts the mounting device 1. The photographing unit 11 controls a photographing operation of the camera 107 (step S101). Then, thecamera 107 starts photographing and outputs photographed data to the photographing unit 11. This photographed data includes data of the face of the driver. The photographing unit 11 generates an image on the basis of the photographed data and output the image to thefeature transmission unit 12. - The
feature transmission unit 12 acquires images (step S102). Thefeature transmission unit 12 determines whether feature data of the face of the driver has been extracted from the image (step S103). Thefeature transmission unit 12 determines whether the number of times it is determined that the feature data of the face of the driver cannot be extracted reaches a predetermined number (step S104). Thefeature transmission unit 12 outputs alert information when No is determined in step S104 (step S105). A case of outputting alert information is a case in which feature data cannot be extracted when the driver's posture is bad or when the driver wears a mask or sunglasses. In addition, the alert information is information prompting the driver to enable personal feature data to be extracted, and is output by screen display, voice, and the like. If Yes is determined in step S104, thefeature transmission unit 12 cannot recognize a face image or cannot extract the feature data. For this reason, thefeature transmission unit 12 transmits the inability to extract the feature data to themonitoring center device 2. - If the feature data has been extracted, the
feature transmission unit 12 instructs themonitoring unit 14 to transmit the feature data. Themonitoring unit 14 acquires information on a current position of thevehicle 10 from the positioninformation acquisition unit 13. Themonitoring unit 14 acquires a current time. Themonitoring unit 14 transmits monitoring data including at least the feature data, position information, and the current time to themonitoring center device 2 via the communication unit 18 (step S106). Themonitoring unit 14 determines whether monitoring data has been transmitted. Themonitoring unit 14 outputs a signal indicating that monitoring data cannot be transmitted to thestart control unit 16 when monitoring data cannot be transmitted. - The
monitoring unit 14 determines whether a determination result based on transmission of monitoring data is received from the monitoring center device 2 (step S107). The determination result includes various information such as a qualified person flag, a wanted person flag, a still image transmission flag, and a moving image transmission flag. The qualified person flag is a flag indicating whether a person corresponding to the feature data has a qualification. The wanted person flag is a flag indicating whether a person corresponding to the feature data is a wanted person. The still image transmission flag is a flag indicating whether it is necessary to transmit a still image. The moving image transmission flag is a flag indicating whether it is necessary to transmit a moving image. When Yes is determined in step S107, themonitoring unit 14 analyzes the determination result (step S108). - The
monitoring unit 14 analyzes the qualified person flag in analysis processing. In addition, themonitoring unit 14 analyzes the wanted person flag in the analysis processing. In addition, themonitoring unit 14 analyzes the still image transmission flag in the analysis processing. In addition, themonitoring unit 14 analyzes the moving image transmission flag in the analysis processing. Themonitoring unit 14 performs processing based on a result of the analysis (step S109). - Specifically, the
monitoring unit 14 output starting permission to thestart control unit 16 when it is determined that the qualified person flag indicates that a person has the qualification. Themonitoring unit 14 may not output starting permission to thestart control unit 16 when it is determined that a qualified person flag indicates that the person does not have the qualification. - When the still image flag is a value indicating that it is necessary to transmit the still image, the
monitoring unit 14 instructs the image transmission unit 17 to transmit the still image. When the moving image transmission flag is a value indicating that it is necessary to transmit the moving image, themonitoring unit 14 instructs the image transmission unit 17 to transmit the moving image. The image transmission unit 17 sequentially inputs images from the photographing unit 11. The photographing unit 11 generates the moving image on the basis of a plurality of images acquired from thecamera 107 and transmits the moving image to the image transmission unit 17. The image transmission unit 17 transmits the moving image to themonitoring center device 2 via the communication unit 18 when a transmission instruction of the moving image is acquired. The image transmission unit 17 transmits one still image in images constituting the moving image to themonitoring center device 2 via the communication unit 18 when a transmission instruction of the still image is acquired. - After the moving image or the still image is transmitted in accordance with a determination result from the
monitoring center device 2, the mounting device 1 receives a monitoring completion signal from themonitoring center device 2. The monitoring completion signal is acquired by themonitoring unit 14. If themonitoring unit 14 acquires the monitoring completion signal, themonitoring unit 14 outputs starting permission to thestart control unit 16. Thestart control unit 16 outputs a signal for starting a vehicle to an engine control device when two conditions such as performance of a starting operation of a vehicle using an ignition switch or a key and acquisition of starting permission by themonitoring unit 14 are satisfied (step S110). This starts an engine of thevehicle 10. - As described above, the
vehicle 10 can be started when a starting operation of a vehicle using an ignition switch and a key and monitoring are performed. Accordingly, it is possible to reliably monitor the driver when thevehicle 10 starts. - When communication between the mounting device 1 and the
monitoring center device 2 cannot be performed for any reason, themonitoring unit 14 may temporarily store the still image and the moving image without transmitting them to themonitoring center device 2 on the basis of a determination result obtained from themonitoring processing unit 21. In this case, themonitoring unit 14 may output starting permission of thevehicle 10 to thestart control unit 16 without acquiring a monitoring completion signal from themonitoring center device 2. Themonitoring unit 14 can send the still image and the moving image temporarily stored after the communication between themonitoring center device 2 and the mounting device 1 is restored. - While the
vehicle 10 moves, themonitoring unit 14 performs monitoring processing again if the operation of thevehicle 10 continues for a certain period of time. A monitoring processing procedure is the same as the processing shown inFIG. 4 . Themonitoring unit 14 may not perform monitoring processing when it is determined that thevehicle 10 is started but not moving. Accordingly, it is possible to reliably monitor the driver even when thevehicle 10 is in operation. -
FIG. 5 is a diagram which shows a processing flow of the monitoring center device. - The
monitoring processing unit 21 of themonitoring center device 2 performs person authentication using monitoring data transmitted by the mounting device 1 (step S501). Themonitoring processing unit 21 collates feature data extracted from the monitoring data with feature data recorded in the qualified person database 23 (step S502). When matching feature data is detected in the collation processing of step S502, themonitoring processing unit 21 stores the feature data and sets the qualified person flag to a value indicating that a person has a qualification. - In addition, the
monitoring processing unit 21 collates the feature data extracted from the monitoring data with feature data recorded in the wanted person database 24 (step S503). When matching feature data is detected in the collation processing of step S503, themonitoring processing unit 21 stores the feature data and sets the wanted person flag to a value indicating that a person is the wanted person. - If the wanted person flag is set to the value indicating that the person is the wanted person, the
monitoring processing unit 21 sets the still image flag to a value indicating that it is necessary to transmit the still image or sets the moving image flag to a value indicating that it is necessary to transmit the moving image. Themonitoring processing unit 21 transmits a determination result holding various types of flags to the mounting device 1 (step S504). - When the qualified person flag included in the determination result is a value indicating that the person is not the qualified person, and the wanted person flag included in the determination result is a value indicating that the person is not the wanted person, this indicates that no feature data is recorded in both the
qualified person database 23 and the wantedperson database 24. In this case, the feature data providing this determination result is feature data not held in themonitoring center device 2, and themonitoring unit 14 of the mounting device 1 transmits the still image to themonitoring center device 2. Themonitoring processing unit 21 of themonitoring center device 2 determines whether a still image is received (step S505). When the still image is received, themonitoring processing unit 21 outputs a face image and the feature data corresponding to the face image to therecording unit 22. Therecording unit 22 records the face image and the feature data corresponding to the face image in a database (step S506). As a result, monitoring data is stored. As described above, themonitoring unit 14 is requested to add the feature data to be monitored and the face image. Themonitoring center device 2 can reliably monitor a driver and further store the monitoring data. - The
monitoring processing unit 21 of themonitoring center device 2 determines that it is an emergency when the inability to extract feature data is acquired by the mounting device 1 or when feature data included in monitoring data is stored in the wantedperson database 24. When the feature data cannot be extracted, there is a possibility that a driver maliciously refuses monitoring and authentication, and themonitoring processing unit 21 can transmit an instruction to strengthen monitoring to the mounting device 1. Themonitoring unit 14 of the mounting device 1 may instruct the image transmission unit 17 to deliver a moving image when information to strengthen monitoring is received. Accordingly, themonitoring center device 2 can perform real-time monitoring. In addition, when the inability to extract the feature data is received by themonitoring processing unit 21, thenotification unit 26 of themonitoring center device 2 may transmit notification information including the face image and the feature data to a device at a predetermined report destination. - By performing such monitoring of a driver, it is possible to expect a crime suppression effect such as hesitation of a crime by a person who drives. When it can be confirmed by notification information that a person is a wanted person, it is possible to contribute to the arrests of wanted persons by notifying an investigation institution and strengthening monitoring on the
vehicle 10 as described above. - In addition, when feature data is recorded in the
qualified person database 23 by collation processing, themonitoring processing unit 21 may record information such as suspension of a driver's license, license invalidation, and an unauthorized vehicle in correlation with the qualified person information of thequalified person database 23. With this processing, it is possible to detect an obvious driving violation. In this manner, this processing can be used in catching a violation. - The
monitoring center device 2 can ascertain a situation in which a driver is a learner on a temporary license, a foreigner who drives a rental car, or the like when feature information is not recorded in any database according to a result of performing collation processing using two databases of thequalified person database 23 and the wantedperson database 24. In this case, themonitoring center device 2 can request not only the feature data of a driver but also the face image of the driver to the mounting device 1, and store and monitor monitoring data including the face image. - By constructing a monitoring system with the mounting device 1 and the
monitoring center device 2, it is possible to expect an effect of crime prevention. In addition, monitoring data such as face images and stored feature data can be searched by a person and person feature information, and this can help with tracking, investigating, and searching for and rescuing persons of interest. Therefore, it is possible to detect and prevent various types of crimes in addition to theft in a moving body such as various vehicles. - The
monitoring unit 14 of the mounting device 1 may permit starting of thevehicle 10 even in a situation in which communication with themonitoring center device 2 is not possible. In addition, themonitoring unit 14 may request thefeature transmission unit 12 to transmit personal feature data when thevehicle 10 continuously runs for a certain distance or more on the basis of state information of thevehicle 10. Moreover, when notification that thefeature transmission unit 12 cannot extract personal feature data is continuous, it is possible to determine that it is an emergency, and it is possible to notify themonitoring center device 2 that it is an emergency. - When feature data of a driver is recorded in the wanted
person database 24, thenotification unit 26 can notify a predetermined device to that effect as an emergency. In addition, themonitoring processing unit 21 can instruct monitoring strengthening such as continuous photographing and transmission of moving images and transmission of still images to the mounting device 1. For example, when feature data of a driver is recorded in thequalified person database 23 and the feature data of the driver is recorded in thequalified person database 23 in accordance with information on license suspension, themonitoring processing unit 21 can notify a device possessed by a predetermined institution to that effect via thenotification unit 26. - In addition, the
monitoring processing unit 21 can instruct themonitoring unit 14 to strengthen monitoring such as transmission of still images. For example, when themonitoring processing unit 21 is notified that it is an emergency by the mounting device 1, themonitoring processing unit 21 can notify a predetermined device to that effect via thenotification unit 26. Moreover, themonitoring processing unit 21 can instruct themonitoring unit 14 to strengthen monitoring such as transmission of still images. -
FIG. 6 is a diagram which shows a minimum configuration of the mounting device. - The mounting device 1 as shown in
FIG. 6 may be a device including at least a photographing unit 11, afeature transmission unit 12, and astart control unit 16. -
FIG. 7 is a diagram which shows a minimum configuration of the monitoring center device. - The
monitoring center device 2 as shown inFIG. 7 at least includes amonitoring processing unit 21 which determines whether feature data received from the mounting device 1 is recorded in a database, and performs monitoring processing on the basis of a result of the determination. - The whole or part of the example embodiments disclosed above can be described as, but not limited to, the following supplementary notes.
- In a monitoring system comprising a mounting device of a moving body and a monitoring center device connected to the mounting device via a communication network, the mounting device includes a photographing unit configured to photograph a passenger, and
- a feature transmission unit configured to transmit feature data of the passenger, and the monitoring center device includes a monitoring processing unit configured to determine whether the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- The monitoring system according to Supplementary note 1 in which the monitoring processing unit transmits a determination result to the mounting device on the basis of the determination result, and the mounting device includes a start control unit which controls starting of a moving body on which the mounting device is mounted on the basis of the determination result.
- (Supplementary note 3)
- The monitoring system according to Supplementary note 1 or
Supplementary note 2, in which the monitoring center device includes a recording unit for recording the feature data. - (Supplementary note 4)
- The monitoring system according to Supplementary note 3, in which the feature transmission unit transmits a time at which the feature data is extracted from an image generated by photographing the passenger and position information of the moving body together with the feature data to the monitoring center device, and the recording unit records the feature data, the time, and the position information in correlation with each other.
- The monitoring system according to any one of Supplementary note 1 to Supplementary note 4, in which the mounting device includes a movement detection unit for detecting a movement of the moving body, and the feature transmission unit transmits the feature data to the monitoring center device on the basis of detection of a movement of the movement detection unit.
- (Supplementary note 6)
- The monitoring system according to any one of Supplementary note 1 to Supplementary note 5, in which the monitoring processing unit of the monitoring center device determines whether there is an abnormality in the monitoring processing on the basis of the determination result, and the monitoring center device further includes a notification unit for, when it is determined that there is an abnormality, notifying a predetermined transmission destination of the abnormality.
- The monitoring system according to Supplementary note 4, in which the monitoring processing unit of the monitoring center device requests the mounting device to continuously transmit the feature data, the time, and the position information when it is determined that there is an abnormality in the monitoring processing on the basis of a result of the determination.
- A monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and the monitoring center device are connected via a communication network includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.
- A mounting device in a monitoring system in which a mounting device of a moving body and a monitoring center device are connected via a communication network includes a photographing unit configured to photograph a passenger, a feature transmission unit configured to transmit feature data of the passenger to the monitoring center device, and a start control unit configured to acquire, from the monitoring center device which performs monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination, and to control starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- A monitoring method includes determining whether the feature data is recorded in a database and performing monitoring processing on the basis of a result of the determination, by a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and the monitoring center device are connected via a communication network.
- A processing method includes, by a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device for performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- A non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a monitoring center device in a monitoring system in which a mounting device of a moving body including a photographing unit for photographing a passenger and a feature transmission unit for transmitting feature data of the passenger and a monitoring center device are connected via a communication network, the processes comprising determining whether or not the feature data is recorded in a database and to perform monitoring processing on the basis of a result of the determination.
- A non-transitory computer-readable recording medium storing a program which causes a computer to perform processes of a mounting device in a monitoring system in which the mounting device of a moving body and a monitoring center device are connected via a communication network, the processes comprising photographing a passenger, transmitting feature data of the passenger to the monitoring center device, and acquiring, from the monitoring center device performing monitoring processing on the basis of a result of determining whether the feature data is recorded in a database, a result of the determination, and controlling starting of a moving body on which the mounting device is mounted on the basis of the result of the determination.
- The mounting device 1 described above has a computer system inside. A program for causing each device to perform the processing described above is stored in a computer readable recording medium of each of these devices and a computer of each device reads and executes this program to perform the processing described above. Here, the computer readable recording medium refers to a magnetic disk, a magneto-optical disc, a CD-ROM, a DVD-ROM, a semiconductor memory, and the like. In addition, this computer program may be delivered to a computer via a communication line, and the computer receiving this delivery may execute the program.
- In addition, the program may realize some of functions of respective processing units described above. Further, the program may be a so-called difference file (difference program) which can realize the functions described above in combination with a program already recorded in a computer system.
- While preferred embodiments of the invention have been described and illustrated above, it should be understood that these are exemplary of the invention and are not to be considered as limiting. Additions, omissions, substitutions, and other modifications can be made without departing from the spirit or scope of the present invention. Accordingly, the invention is not to be considered as being limited by the foregoing description, and is only limited by the scope of the appended claims.
Claims (9)
1. A control device for a moving body, the control device comprising:
a first starting means for controlling starting the moving body based on a predetermined input; and
a second starting means for controlling the starting the moving body based on the predetermined input and authentication using a captured image.
2. The control device according to claim 1 , wherein the captured image is acquired from a photographing device installed on the moving body.
3. The control device according to claim 2 , wherein the photographing device is installed at a position where an inside of the moving body is captured.
4. The control device according to claim 1 , wherein the authentication is performed based on feature information of a person in the captured image.
5. The control device according to claim 1 , wherein the starting of the moving body by the first starting means is permitted when predetermined condition is satisfied.
6. The control device according to claim 5 , wherein the predetermined condition is a case where the authentication using the captured image cannot be performed.
7. The control device according to claim 6 , wherein
the authentication using the captured image is performed through communication with an external device, and
the predetermined condition is satisfied when the communication with the external device is not possible.
8. A control system comprising:
a control device for a moving body; and
a monitoring device,
wherein the control device includes:
a first starting means for controlling starting the moving body based on a predetermined input; and
a second starting means for controlling the starting the moving body based on the predetermined input and authentication using a captured image in the monitoring device.
9. A control method for a moving body, the control method comprising:
controlling starting the moving body based on a predetermined input; and
controlling the starting the moving body based on the predetermined input and authentication using a captured image.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/703,174 US20220212631A1 (en) | 2017-01-27 | 2022-03-24 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017-012731 | 2017-01-27 | ||
JP2017012731A JP6402787B2 (en) | 2017-01-27 | 2017-01-27 | Monitoring system, monitoring center device, mounted device, monitoring method, processing method, program |
US15/849,951 US20180215348A1 (en) | 2017-01-27 | 2017-12-21 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US17/005,912 US11318912B2 (en) | 2017-01-27 | 2020-08-28 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US17/703,174 US20220212631A1 (en) | 2017-01-27 | 2022-03-24 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/005,912 Continuation US11318912B2 (en) | 2017-01-27 | 2020-08-28 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220212631A1 true US20220212631A1 (en) | 2022-07-07 |
Family
ID=62977053
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/849,951 Abandoned US20180215348A1 (en) | 2017-01-27 | 2017-12-21 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,704 Active US10647301B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,662 Active US10618499B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,685 Active US10611341B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US17/005,912 Active US11318912B2 (en) | 2017-01-27 | 2020-08-28 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US17/703,174 Abandoned US20220212631A1 (en) | 2017-01-27 | 2022-03-24 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
Family Applications Before (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/849,951 Abandoned US20180215348A1 (en) | 2017-01-27 | 2017-12-21 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,704 Active US10647301B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,662 Active US10618499B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US16/351,685 Active US10611341B2 (en) | 2017-01-27 | 2019-03-13 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
US17/005,912 Active US11318912B2 (en) | 2017-01-27 | 2020-08-28 | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program |
Country Status (2)
Country | Link |
---|---|
US (6) | US20180215348A1 (en) |
JP (1) | JP6402787B2 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6402787B2 (en) * | 2017-01-27 | 2018-10-10 | 日本電気株式会社 | Monitoring system, monitoring center device, mounted device, monitoring method, processing method, program |
CN110379126B (en) * | 2019-07-31 | 2020-11-06 | 刘建飞 | Passenger carrying operation vehicle monitoring system, device and medium |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010056544A1 (en) * | 1998-06-18 | 2001-12-27 | Walker Richard C. | Electrically controlled automated devices to operate, slow, guide, stop and secure, equipment and machinery for the purpose of controlling their unsafe, unattended, unauthorized, unlawful hazardous and/or legal use, with remote control and accountability worldwide |
US6748301B1 (en) * | 1999-07-24 | 2004-06-08 | Ryu Jae-Chun | Apparatus and method for prevention of driving of motor vehicle under the influence of alcohol and prevention of vehicle theft |
US20040188164A1 (en) * | 2003-03-26 | 2004-09-30 | Fujitsu Ten Limited | Vehicle anti theft system, vehicle anti theft method, and computer program |
US20050062602A1 (en) * | 2002-01-16 | 2005-03-24 | Omron Corporation | Security arrangement with in-vehicle mounted terminal |
US20080297330A1 (en) * | 2007-06-01 | 2008-12-04 | Jeon Byong-Hoon | Vehicle emergency preventive terminal device and internet system using facial recognition technology |
US8469134B2 (en) * | 2008-08-07 | 2013-06-25 | Denso Corporation | Engine starting controller |
US20160132673A1 (en) * | 2014-11-12 | 2016-05-12 | International Business Machines Corporation | Variable image presentation for authenticating a user |
US20170001598A1 (en) * | 2015-07-01 | 2017-01-05 | Lear Corporation | Vehicle authentication system |
US9928353B2 (en) * | 2015-08-03 | 2018-03-27 | International Business Machines Corporation | Vehicle authorization based on near field communication |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020097145A1 (en) * | 1997-11-06 | 2002-07-25 | David M. Tumey | Integrated vehicle security system utilizing facial image verification |
JP3726695B2 (en) * | 2001-04-03 | 2005-12-14 | オムロン株式会社 | Vehicle theft monitoring system, vehicle mounted device, vehicle abnormality monitoring method, vehicle theft monitoring method, vehicle theft monitoring program, and computer-readable recording medium recording the same |
JP2004314906A (en) * | 2003-04-18 | 2004-11-11 | Nec Fielding Ltd | Vehicle control system, vehicle control method, managing device, and program |
US20040257208A1 (en) * | 2003-06-18 | 2004-12-23 | Szuchao Huang | Remotely controllable and configurable vehicle security system |
JP4713932B2 (en) | 2005-04-25 | 2011-06-29 | 株式会社東海理化電機製作所 | Vehicle security device and vehicle security system |
JP2009059259A (en) * | 2007-09-03 | 2009-03-19 | Masahiro Watanabe | Vehicle operation management system |
US8831677B2 (en) * | 2010-11-17 | 2014-09-09 | Antony-Euclid C. Villa-Real | Customer-controlled instant-response anti-fraud/anti-identity theft devices (with true-personal identity verification), method and systems for secured global applications in personal/business e-banking, e-commerce, e-medical/health insurance checker, e-education/research/invention, e-disaster advisor, e-immigration, e-airport/aircraft security, e-military/e-law enforcement, with or without NFC component and system, with cellular/satellite phone/internet/multi-media functions |
US9235750B1 (en) * | 2011-09-16 | 2016-01-12 | Lytx, Inc. | Using passive driver identification and other input for providing real-time alerts or actions |
JP6052062B2 (en) * | 2013-05-29 | 2016-12-27 | 株式会社デンソー | Person search system |
WO2015056530A1 (en) | 2013-10-17 | 2015-04-23 | みこらった株式会社 | Automatic driving vehicle, anti-theft system of automatic driving vehicle, anti-theft program of automatic driving vehicle, terminal control program, and rental method of automatic driving vehicle |
US9870706B2 (en) * | 2014-09-11 | 2018-01-16 | Lukus Sampson Alderman | Mobile alert system |
US10196036B2 (en) * | 2014-09-11 | 2019-02-05 | Child Adult Pet Safety Llc | Mobile alert and security system |
CN105243838B (en) * | 2015-11-09 | 2018-05-04 | 北京奇虎科技有限公司 | Vehicle driving safety monitoring method and device, system |
US20180072270A1 (en) * | 2016-09-09 | 2018-03-15 | Magna Electronics Inc. | Vehicle surround security system |
JP6402787B2 (en) * | 2017-01-27 | 2018-10-10 | 日本電気株式会社 | Monitoring system, monitoring center device, mounted device, monitoring method, processing method, program |
-
2017
- 2017-01-27 JP JP2017012731A patent/JP6402787B2/en active Active
- 2017-12-21 US US15/849,951 patent/US20180215348A1/en not_active Abandoned
-
2019
- 2019-03-13 US US16/351,704 patent/US10647301B2/en active Active
- 2019-03-13 US US16/351,662 patent/US10618499B2/en active Active
- 2019-03-13 US US16/351,685 patent/US10611341B2/en active Active
-
2020
- 2020-08-28 US US17/005,912 patent/US11318912B2/en active Active
-
2022
- 2022-03-24 US US17/703,174 patent/US20220212631A1/en not_active Abandoned
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010056544A1 (en) * | 1998-06-18 | 2001-12-27 | Walker Richard C. | Electrically controlled automated devices to operate, slow, guide, stop and secure, equipment and machinery for the purpose of controlling their unsafe, unattended, unauthorized, unlawful hazardous and/or legal use, with remote control and accountability worldwide |
US6748301B1 (en) * | 1999-07-24 | 2004-06-08 | Ryu Jae-Chun | Apparatus and method for prevention of driving of motor vehicle under the influence of alcohol and prevention of vehicle theft |
US20050062602A1 (en) * | 2002-01-16 | 2005-03-24 | Omron Corporation | Security arrangement with in-vehicle mounted terminal |
US20040188164A1 (en) * | 2003-03-26 | 2004-09-30 | Fujitsu Ten Limited | Vehicle anti theft system, vehicle anti theft method, and computer program |
US20080297330A1 (en) * | 2007-06-01 | 2008-12-04 | Jeon Byong-Hoon | Vehicle emergency preventive terminal device and internet system using facial recognition technology |
US8469134B2 (en) * | 2008-08-07 | 2013-06-25 | Denso Corporation | Engine starting controller |
US20160132673A1 (en) * | 2014-11-12 | 2016-05-12 | International Business Machines Corporation | Variable image presentation for authenticating a user |
US20170001598A1 (en) * | 2015-07-01 | 2017-01-05 | Lear Corporation | Vehicle authentication system |
US9928353B2 (en) * | 2015-08-03 | 2018-03-27 | International Business Machines Corporation | Vehicle authorization based on near field communication |
Non-Patent Citations (2)
Title |
---|
_ Automatic detection of vehicle occupants - the imaging problems and solution; 2000. (Year: 2000) * |
_ Real Time Vehicle Security System through face recognition; 2014. (Year: 2014) * |
Also Published As
Publication number | Publication date |
---|---|
US20190210566A1 (en) | 2019-07-11 |
US20180215348A1 (en) | 2018-08-02 |
US10611341B2 (en) | 2020-04-07 |
JP6402787B2 (en) | 2018-10-10 |
US20190210565A1 (en) | 2019-07-11 |
US20190202406A1 (en) | 2019-07-04 |
US20200384954A1 (en) | 2020-12-10 |
US10647301B2 (en) | 2020-05-12 |
JP2018120501A (en) | 2018-08-02 |
US10618499B2 (en) | 2020-04-14 |
US11318912B2 (en) | 2022-05-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11210873B2 (en) | Safety for vehicle users | |
JP6882809B2 (en) | Self-driving car and self-driving car anti-theft program | |
US20200001892A1 (en) | Passenger assisting apparatus, method, and program | |
US20220212631A1 (en) | Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program | |
JP2006120137A (en) | Image information reporting system | |
JP2017211888A (en) | Image information authentification system | |
Lupinska-Dubicka et al. | In-car ecall device for automatic accident detection, passengers counting and alarming | |
KR20160028542A (en) | an emergency management and crime prevention system for cars and the method thereof | |
CN112583885A (en) | Emergency system for a vehicle and method for providing a rescue means for a user of a vehicle | |
KR101437406B1 (en) | an emergency management and crime prevention system for cars and the method thereof | |
JP7244354B2 (en) | In-vehicle device and operation management system | |
JP2016004496A (en) | Operation recording device | |
US12033446B2 (en) | Safety for vehicle users | |
US10093236B2 (en) | Apparatus and method for safeguarding vehicles | |
KR101022544B1 (en) | Video recording system for a vehicle | |
JP2019219796A (en) | Vehicle travel control server, vehicle travel control method, and vehicle control device | |
JP2022051383A (en) | Vehicle management device, vehicle management system, and vehicle management program | |
Begum et al. | Vehicle black box system | |
Sajitha et al. | Wireless Black Box using MEMS Accelerometer and GPS Tracking for Accidental Monitoring of Vehicle | |
JP2019215733A (en) | Vehicle driving restriction system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |