JP2021026687A - Inappropriate behavior detection system and inappropriate behavior detection method - Google Patents

Abstract

To acquire evidence information of a detected inappropriate behavior of a driver to efficiently support regulation of the inappropriate behavior.SOLUTION: In an inappropriate behavior detection system, an on-vehicle camera having a front side camera and a rear side camera is communicably connected with an image processor, the on-vehicle camera transmits a first image obtained by imaging the front side including a driver of another vehicle to the image processor, the image processor transmits a control signal for instructing imaging of the rear side of the other vehicle when a predetermined behavior during driving of the driver of the other vehicle is detected on the basis of the first image, the on-vehicle camera transmits a second image obtained by imaging the rear side of the other vehicle to the image processor on the basis of the control signal, and the image processor detects number plate information of the other vehicle on the basis of the second image, and associates the first image, the second image and the number plate information with one another to be stored.SELECTED DRAWING: Figure 2

Description

The present disclosure relates to an inappropriate behavior detection system and an inappropriate behavior detection method.

Patent Document 1 discloses a warning device provided in a vehicle. The warning device is measured by an infrared sensor that measures the heat distribution in the vehicle interior, a shift sensor that detects a shift position, and an infrared sensor. When it is determined that the driver is using the portable device based on the heat distribution and the shift position detected by the shift sensor is other than the parking range, the control unit that outputs the command signal and the command signal It is provided with a warning means for giving a warning to the driver when input.

Japanese Unexamined Patent Publication No. 2018-156539

However, in the configuration of Patent Document 1 described above, only a warning is given to the driver for inappropriate behavior during driving such as use of a portable device in an environment closed in the vehicle, and the driver is inappropriate during driving. The action was not a so-called legal crackdown. In addition, since definitive evidence (for example, captured image) that the driver has performed inappropriate behavior while driving is not recorded, it is possible to tell a third party whether or not the driver has performed inappropriate behavior while driving. I couldn't prove it.

The present disclosure has been devised in view of the above-mentioned conventional circumstances, obtains useful evidence information that inappropriate behavior of the driver while driving in the vehicle has been detected, and controls inappropriate behavior while driving. It is an object of the present invention to provide an inappropriate behavior detection system and an inappropriate behavior detection method that efficiently support the above.

According to the present disclosure, an image processing device can communicate with an in-vehicle camera having a front camera that captures one of the front and rear sides of another vehicle and a rear camera that captures the other of the front and rear sides of the other vehicle. The in-vehicle camera is an inappropriate behavior detection system connected to the above, and the in-vehicle camera transmits a first image of the front side including the driver of the other vehicle to the image processing device, and the image processing device is the first. When a predetermined action during driving of the driver of the other vehicle is detected based on the image, a control signal instructing the rear side of the other vehicle to be imaged is transmitted, and the in-vehicle camera is based on the control signal. , The second image of the rear side of the other vehicle is transmitted to the image processing device, and the image processing device detects the number plate information of the other vehicle based on the second image, and the first Provided is an inappropriate behavior detection system that stores an image, the second image, and the number plate information in association with each other.

Further, the present disclosure is an inappropriate behavior detection system in which a vehicle photographing camera that images the front side of the vehicle and a server are communicably connected, and the vehicle photographing camera is a front side image that images the front side of the vehicle. When a predetermined action during driving of the driver of the vehicle is detected, the license plate information of the vehicle is detected, the front side image and the license plate information are associated with each other and transmitted to the server, and the server is transmitted. Provides an inappropriate behavior detection system that associates and stores the front side image transmitted from the vehicle photographing camera with the license plate information.

Further, in the present disclosure, an in-vehicle camera having a front camera that images one of the front side and the rear side of another vehicle and a rear camera that images the other side of the front side and the rear side of the other vehicle, and an image processing device. It is an inappropriate behavior detection method executed by an inappropriate behavior detection system connected communicably, and is being driven by the driver of the other vehicle based on the first image of the front side including the driver of the other vehicle. When the predetermined behavior of the other vehicle is detected, a control signal for instructing the rear side of the other vehicle to be imaged is generated, and based on the control signal, a second image of the rear side of the other vehicle is transmitted, and the above-mentioned Provided is an inappropriate behavior detection method for detecting license plate information of the other vehicle based on the second image and storing the first image, the second image and the license plate information in association with each other.

Further, the present disclosure is an inappropriate behavior detection method in which a vehicle photographing camera that captures the front side of a vehicle and a server are communicably connected, and is based on a front side image that captures the front side including the driver of the vehicle. Provided is an inappropriate behavior detection method for detecting a predetermined behavior of the driver of the vehicle during driving, detecting the license plate information of the vehicle, and storing the front image and the license plate information in association with each other. ..

According to the present disclosure, it is possible to acquire useful evidence information that an inappropriate behavior of a driver while driving in a vehicle has been detected, and to efficiently support the crackdown on inappropriate behavior while driving.

The figure which shows the configuration example of the inappropriate behavior detection system which concerns on Embodiment 1. The figure which shows the installation example of each of the front side camera and the rear side camera which concerns on Embodiment 1. The figure which shows the internal structure example of the vehicle which concerns on Embodiment 1. The figure which shows the internal structure example of the evidence management server which concerns on Embodiment 1. A sequence diagram illustrating an example of an operation procedure related to detection of an inappropriate behavior detection system according to the first embodiment. Explanatory drawing which shows example of inappropriate detection situation which concerns on Embodiment 1. A sequence diagram illustrating an example of an operation procedure relating to display of list information of the inappropriate behavior detection system according to the first embodiment. Diagram showing an example of detection data Diagram showing an example of license data Diagram showing an example of inappropriate behavior detection driver data The figure which shows the configuration example of the inappropriate behavior detection system which concerns on Embodiment 2. The figure which shows the installation example of the vehicle photography camera which concerns on Embodiment 2. The figure which shows the internal structure example of the vehicle photography camera which concerns on Embodiment 2. A flowchart showing an example of an operation procedure related to imaging of the vehicle photographing camera according to the second embodiment. A flowchart showing an example of an operation procedure relating to data transmission of the vehicle photographing camera according to the second embodiment. A flowchart showing an example of an operation procedure related to lighting control of the vehicle photographing camera according to the second embodiment. A sequence diagram illustrating an example of an operation procedure related to detection of an inappropriate behavior detection system according to the second embodiment.

(Background to the contents of the embodiment)
Conventionally, there is a warning device that warns a driver who is using a portable device while driving. This warning device is used when it is determined that the driver is using a portable device based on the heat distribution in the vehicle measured by the infrared sensor when the shift position detected by the shift sensor is outside the parking range. Warn. However, the above-mentioned warning device only warns the driver of inappropriate behavior during driving such as the use of a portable device in a closed environment in the vehicle, and the inappropriate behavior during driving of the driver is so-called. It was not legally cracked down. In addition, since definitive evidence (for example, captured image) that the driver has performed inappropriate behavior while driving is not recorded, it is possible to tell a third party whether or not the driver has performed inappropriate behavior while driving. I couldn't prove it.

Therefore, in each of the following embodiments, useful evidence information that the driver's inappropriate behavior during driving in the vehicle is detected is acquired, and the control of inappropriate behavior during driving is efficiently supported. An example of an inappropriate behavior detection system and an inappropriate behavior detection method will be described.

Hereinafter, each embodiment in which the configuration and operation of the inappropriate behavior detection system and the inappropriate behavior detection method according to the present disclosure are specifically disclosed will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment 1)
In the first embodiment, an example will be described in which a front camera CA1 and a rear camera CA2 are provided, and an inappropriate behavior of a driver of a surrounding vehicle is detected by a running or stopped vehicle C1. FIG. 1 is a diagram showing a configuration example of an inappropriate behavior detection system according to the first embodiment. The improper behavior detection system detects improper behavior of the driver (for example, use of a mobile phone or smartphone while driving (call / operation), etc.) and captures an image of the driver and the vehicle driven by the driver. Based on this, it is a system that acquires a list of similar candidates and identifies the owner (driver) of the vehicle. The improper behavior detection system includes a vehicle C1, networks NW1 and NW2, an evidence management server S1, an administrator PC (Personal Computer) P2, and an LPR (License Plate Recognition) server S2.

Vehicle C1 as an example of a patrol vehicle is a security vehicle or a police vehicle, which is a vehicle used by law enforcement agencies. The vehicle C1 detects whether or not the driver of the vehicle traveling around the vehicle C1 is acting improperly. The vehicle C1 includes an in-vehicle camera system CS, an in-vehicle PCP1, and a wireless communication device 30.

The vehicle-mounted camera system CS includes a front-side camera CA1, a rear-side camera CA2, a side-side camera CA3, and a vehicle-mounted recorder RD1. The in-vehicle camera system CS captures and stores other vehicles traveling around the vehicle C1, drivers of other vehicles, license plates of other vehicles, and the like. The side camera CA3 is not an essential configuration and may be omitted. The in-vehicle camera system CS is provided in the vehicle C1 and is communicably connected to the in-vehicle PCP1.

The front camera CA1 as an example of the vehicle-mounted camera is wiredly connected to the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1 so as to be able to communicate with each other. The front camera CA1 is installed in the vehicle C1 so that the front side or the diagonal front side of the vehicle C1 can be imaged. The front camera CA1 images the front side or the rear side of the front side vehicle of the oncoming vehicle traveling on the front side or the diagonally front side of the vehicle C1 and the drivers of these vehicles. The front camera CA1 is not limited to the above-mentioned example, and may be installed so as to be able to image a license plate provided on, for example, an oncoming vehicle or a front vehicle. The front camera CA1 stores the captured image in the vehicle-mounted recorder RD1 and transmits it to the vehicle-mounted PCP1.

The rear camera CA2 as an example of the vehicle-mounted camera is wiredly connected to the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1 so as to be able to communicate with each other. The rear camera CA2 is installed in the vehicle C1 so as to be able to image the rear side or the diagonally rear side of the vehicle C1. The rear camera CA2 images the rear side of the oncoming vehicle or the front side of the rear vehicle traveling diagonally to the rear side of the vehicle C1 and the license plates provided on these vehicles. The rear camera CA2 is not limited to the above-mentioned example, and may be installed so that, for example, the driver and license plate of the rear vehicle can be imaged. The rear camera CA2 stores the captured image in the vehicle-mounted recorder RD1 and transmits the captured image to the vehicle-mounted PCP1.

The side camera CA3 is wiredly connected to the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1 so as to be able to communicate with each other. The side camera CA3 is installed in the vehicle C1 so that the side of the vehicle C1 can be imaged. The side camera CA3 images an oncoming vehicle or a parallel vehicle traveling on the side of the vehicle C1. The side camera CA3 stores the captured image in the vehicle-mounted recorder RD1 and transmits the captured image to the vehicle-mounted PCP1.

The in-vehicle recorder RD1 is wiredly connected to the front side camera CA1, the rear side camera CA2, the side camera CA3, and the in-vehicle PCP1 so as to be able to communicate with each other. The in-vehicle recorder RD1 stores the captured images captured by the front side camera CA1, the rear side camera CA2, and the side camera CA3. Further, the in-vehicle recorder RD1 is controlled by the in-vehicle PCP1 and transmits the requested captured image to the in-vehicle PCP1 based on the input operation of the user.

An in-vehicle PCP1 as an example of an image processing device is a PC provided in the vehicle C1 and operated by a user. The in-vehicle PCP1 may be a terminal device such as a tablet. The in-vehicle PCP1 is connected to the in-vehicle camera system CS and the wireless communication device 30 so as to be capable of wired communication (for example, LAN communication). The in-vehicle PCP1 is not limited to the wired connection, and may be connected to the evidence management server S1 via the network NW1 so as to be wirelessly communicable. In such a case, the in-vehicle PCP1 is connected to the evidence management server S1 by using a device having a tethering function such as a smartphone or a tablet. When the vehicle-mounted PCP1 is a tablet having a wireless communication capability, the device having a tethering function may be omitted, and the vehicle-mounted PCP1 may be directly connected to the evidence management server S1 so as to be capable of wireless communication.

The in-vehicle PCP1 controls the operations of the front camera CA1, the rear camera CA2, the side camera CA3, and the in-vehicle recorder RD1 based on the input operation of the user. The in-vehicle PCP1 determines whether or not the driver reflected in the captured image (first image, an example of the front image) of the other vehicle C2 captured by the front camera CA1 or the rear camera CA2 is performing inappropriate behavior. judge. When there is inappropriate behavior, the in-vehicle PCP1 further determines whether or not the characteristics of other vehicles reflected in each of the plurality of captured images captured by the front camera CA1, the rear camera CA2, and the side camera CA3 match. To do. When the characteristics of the other vehicle reflected in each of the plurality of captured images match, the in-vehicle PCP1 obtains the license plate information of the other vehicle from the captured image (second image, an example of the rear side image) of the rear side of the other vehicle C2. Is detected, and an identification key for associating each of the plurality of captured images used for each determination with the license plate information is assigned and stored. Further, the in-vehicle PCP1 transmits each of the plurality of captured images used for each determination, the license plate information, and the identification key to the evidence management server S1.

Each determination (determination of inappropriate behavior, determination of characteristics of other vehicles reflected in each of the plurality of captured images) and detection of license plate information executed by the above-mentioned in-vehicle PCP1 are executed by the evidence management server S1. Good.

The wireless communication device 30 is, for example, an in-vehicle wireless LAN (for example, Wi-fi (registered trademark)), and is connected to the in-vehicle camera system CS and the in-vehicle PCP1 in a wired or wireless manner. Further, the wireless communication device 30 is connected to the evidence management server S1 via the network NW1 so as to be capable of wireless communication.

Each of the plurality of networks NW1 and NW2 is a wireless network conforming to any of wireless LAN (Local Area Network) such as Wi-fi (registered trademark), Bluetooth (registered trademark) and WiGig (Wireless Gigabit). , It does not have to be limited to these. The in-vehicle camera system CS and the in-vehicle PCP1 may have a USB (Universal Social Bus) connector. In this case, the in-vehicle camera system CS and the in-vehicle PCP1 may be connected to each other by a USB cable so as to enable wired communication. Good.

The network NW1 is communicably connected between the vehicle-mounted PCP1 or the wireless communication device 30 and the evidence management server S1.

The network NW2 is communicably connected to the evidence management server S1 and the LPR server S2.

The evidence management server S1 as an example of the server is a front camera CA1 received from the in-vehicle PCP1, a captured image captured by the rear camera CA2 and the side camera CA3, and a license plate of another vehicle detected based on the captured image. The information and the identification key that associates these captured images with the number plate are stored.

Further, the evidence management server S1 transmits the received license plate information to the LPR server S2, and also transmits a control signal requesting the LPR server S2 for a number similarity candidate list similar to the license plate information number. When the evidence management server S1 receives the number-like candidate list from the LPR server S2, it stores the received number-like candidate list and transmits it to the administrator PCP2.

The number-similar candidate list referred to here is information about the owner of a vehicle having a number similar to the predetermined license plate information.

The LPR server S2 as an example of the second server is based on the license plate information such as the license plate information, the owner of the vehicle in which the license plate information is registered, the address of the owner, and the telephone number of the owner. Memorize information that can identify the owner of the server. The LPR server S2 generates a number similarity candidate list similar to the license plate information number based on the license plate information received from the evidence management server S1. The LPR server S2 transmits the number-like candidate list to the evidence management server S1.

The administrator PCP2 is connected to the evidence management server S1 via wireless communication or wired communication, and displays a list of received number-like candidates. The administrator PCP2 is provided in a law enforcement agency such as a security company or a police station, and is operated by a security guard or a police officer.

FIG. 2 is a diagram showing an installation example of each of the front side camera CA1 and the rear side camera CA2 according to the first embodiment. The front camera CA1 and the rear camera CA2 are installed in the vehicle C1. The installation example shown in FIG. 2 is an example, and the installation location is not limited to this. For example, the front camera CA1 may be installed at the center position of the windshield of the vehicle C1. In FIG. 2, the side camera CA3 is not shown.

The front camera CA1 has an angle of view Ang1 and is installed so that the front side and the diagonal front side of the vehicle C1 can be imaged. The angle of view Ang1 shown in FIG. 2 is installed so that the diagonally left front side of the vehicle C1 can be imaged, but it may be installed so that the diagonally right front side can be imaged.

The rear camera CA2 has an angle of view Ang2 and is installed so that the rear side and the oblique rear side of the vehicle C1 can be imaged. The angle of view Ang2 shown in FIG. 2 is installed so that the diagonally left rear side of the vehicle C1 can be imaged, but it may be installed so that the diagonally right rear side can be imaged.

FIG. 3 is a diagram showing an example of internal configuration of the vehicle C1 according to the first embodiment. The front camera CA1, the rear camera CA2, and the side camera CA3 are configured to include the same internal configuration.

First, an internal configuration example of the front side camera CA1, the rear side camera CA2, and the side camera CA3 will be described. The front side camera CA1, the rear side camera CA2, and the side camera CA3 are configured to include a communication unit 10, a processor 11, a memory 12, and an imaging unit 13.

The communication unit 10 is configured by using a communication interface circuit for transmitting / receiving data or information between the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1. The communication unit 10 transmits the captured image captured by the imaging unit 13 to the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1. Further, the communication unit 10 receives control signals for each of the front camera CA1, the rear camera CA2, and the side camera CA3. When the evidence management server S1 determines the inappropriate behavior of the driver while driving another vehicle, the communication unit 10 is connected to the wireless communication device 30 and communicates with the evidence management server S1 via the network NW1. It may be connected as possible. In such a case, the communication unit 10 further transmits / receives data or information to / from the evidence management server S1.

The processor 11 is configured by using, for example, a CPU (Central Processing unit) or an FPGA (Field Programmable Gate Array), and performs various processes and controls in cooperation with the memory 12. Specifically, the processor 11 refers to the program and data held in the memory 12 and executes the program to realize the function of the imaging unit 13.

The processor 11 adds the time information in which the captured image is captured to the captured image input from the imaging unit 13, and transmits the captured image to the vehicle-mounted recorder RD1 and the vehicle-mounted PCP1.

The memory 12 includes, for example, a RAM (Random Access Memory) as a work memory used when executing each process of the processor 11 and a ROM (Read Only Memory) for storing a program and data defining the operation of the processor 11. Have. Data or information generated or acquired by the processor 11 is temporarily stored in the RAM. A program that defines the operation of the processor 11 is written in the ROM.

The image pickup unit 13 includes at least a lens (not shown) and an image sensor (not shown). The image sensor is, for example, a solid-state image sensor of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and converts an optical image formed on an imaging surface into an electric signal. The image pickup unit 13 includes a focus lens whose focal length can be adjusted, a zoom lens whose zoom magnification can be changed, and a gain adjustment unit whose sensitivity of the image pickup element can be adjusted. The imaging unit 13 images another vehicle traveling around the vehicle C1 and outputs the captured image to the processor 11.

Next, an example of the internal configuration of the in-vehicle PCP1 will be described. The in-vehicle PCP1 includes a communication unit 20, a processor 21, a memory 22, and an operation unit 25.

The communication unit 20 transmits / receives data or information between the vehicle-mounted camera system CS (specifically, the front-side camera CA1, the rear-side camera CA2, the side-side camera CA3, and the vehicle-mounted recorder RD1) and the evidence management server S1. It is configured using the communication interface circuit of.

The processor 21 is configured by using, for example, a CPU or an FPGA, and cooperates with the memory 22 to perform various processes and controls. Specifically, the processor 21 refers to the program and data held in the memory 22 and executes the program to realize the functions of each part. Each unit is an image analysis unit 23 and an ID (Identification) assigning unit 24.

The memory 22 has, for example, a RAM as a work memory used when executing each process of the processor 21, and a ROM for storing a program and data defining the operation of the processor 21. Data or information generated or acquired by the processor 21 is temporarily stored in the RAM. A program that defines the operation of the processor 21 is written in the ROM. The memory 22 is information for detecting inappropriate behavior of the driver while driving based on the captured image captured by the front camera CA1 or the rear camera CA2 (for example, when the driver uses a mobile phone or a smartphone). Memorize movements, poses, etc.).

The image analysis unit 23 analyzes the captured image captured by the front camera CA1 or the rear camera CA2, and detects the driver of the other vehicle and the characteristics (for example, color, size, shape, etc.) of the other vehicle. The image analysis unit 23 determines whether or not the detected driver of another vehicle is performing inappropriate behavior based on the information stored in the memory 22 for detecting the inappropriate behavior of the driver during driving. .. When the image analysis unit 23 determines that the driver is performing inappropriate behavior, the image analysis unit 23 is different from the camera (front camera CA1 or rear camera CA2) that captures the captured image in which the driver's inappropriate behavior is detected while driving. It analyzes other captured images captured by the camera and detects the characteristics of other vehicles reflected in the other captured images. The other camera referred to here is at least one of the front camera CA1, the rear camera CA2, and the side camera CA3.

The image analysis unit 23 determines whether or not the characteristics of the other vehicle appearing in at least two captured images match, and if the characteristics of the other vehicle match, the license plate information of the other vehicle is detected from the captured images. In the image analysis unit 23, the license plate information is not reflected in the captured image used for determining the inappropriate behavior of the driver of the other vehicle, and the captured image used for determining the characteristics of the other vehicle is the side camera CA3. In the case of the captured image captured by, the license plate information is detected from the captured image captured by another camera.

On the other hand, when the image analysis unit 23 determines that the driver is not performing inappropriate behavior, or when the characteristics of the other vehicle shown in at least two captured images do not match, the image analysis unit 23 returns to the standby state and returns to the standby state of the vehicle C1. Continue imaging of other vehicles traveling around.

When the image analysis unit 23 determines that the driver is performing inappropriate behavior, the in-vehicle recorder records an image captured for each of the plurality of captured images used for each determination, including the time before and after the captured image is captured. A control signal to be output to RD1 is generated. The image analysis unit 23 transmits each of the plurality of captured images received from the vehicle-mounted recorder RD1 to the ID giving unit 24.

The image analysis unit 23 further acquires the current position information of the vehicle C1 (in other words, the position information when each of the plurality of captured images used for each determination is captured). The image analysis unit 23 includes each of the plurality of captured images used for each determination, the detection time when the inappropriate behavior is detected, the license plate information of the detected other vehicle, and the position information of the vehicle C1. Each of the plurality of captured images including the time before and after each of the captured images is captured, and the detection information (an example of a data set) including the captured images is output to the ID giving unit 24.

It should be noted that the processing such as determination of inappropriate behavior of the driver of another vehicle, determination of matching of features of other vehicles reflected in each of the plurality of captured images, detection of license plate information, etc., executed by the image analysis unit 23 described above is evidence. It may be executed in the management server S1.

The ID assigning unit 24 uses various information included in the input detection information (that is, each of the plurality of captured images used for each determination, the detection time at which inappropriate behavior is detected, and the license plate of another vehicle that is detected. An identification key for associating information, position information of the vehicle C1, and each of the plurality of captured images including the time before and after each of the plurality of captured images was captured) is generated and assigned. The ID assigning unit 24 transmits the detection information to which the identification key is assigned to the evidence management server S1 via the wireless communication device 30 and the network NW1.

The operation unit 25 is a user interface that accepts input operations of a person who uses the in-vehicle PCP1, such as a security guard or a police officer who operates the in-vehicle PCP1 in the vehicle C1, and is a pointing device such as a mouse, a keyboard, a touch panel, and a stylus pen. Is. Further, the in-vehicle PCP1 may be remotely controlled by a security guard or a police officer in a law enforcement agency such as a security company or a police station. The operation unit 25 outputs a control signal based on the input operation to the processor 11. As a result, a security guard or a police officer, for example, views the captured images captured by the front camera CA1, the rear camera CA2, and the side camera CA3 stored in the vehicle recorder RD1 on the monitor (not shown) of the vehicle PCP1. be able to.

FIG. 4 is a diagram showing an example of the internal configuration of the evidence management server S1 according to the first embodiment. The evidence management server S1 includes a communication unit 60, a processor 61, a memory 62, and a storage 63.

The communication unit 60 is configured by using a communication interface circuit for transmitting / receiving data or information between the vehicle-mounted PCP1, the administrator PCP2, and the LPR server S2. The communication unit 60 is communicably connected to the vehicle-mounted PCP1 via the network NW1 and communicably connected to the LPR server S2 via the network NW2. The communication unit 60 may be configured by using a communication interface circuit for transmitting / receiving data or information to / from the in-vehicle camera system CS via the wireless communication device 30.

The processor 61 is configured by using, for example, a CPU or an FPGA, and cooperates with the memory 62 to perform various processes and controls. Specifically, the processor 61 refers to the program and data held in the memory 62, and by executing the program, the storage 63 and other functions (for example, a driver who has performed inappropriate actions on the LPR server S2). A function of generating a control signal requesting a number similarity candidate list similar to the license plate information of the vehicle (another vehicle), and a function of transmitting the number similarity candidate list to the administrator PCP2) are realized.

The processor 61 may be capable of performing processing such as determination of inappropriate behavior of the driver of another vehicle, determination of matching of features of other vehicles reflected in each of a plurality of captured images, detection of license plate information, and the like.

The processor 61 outputs the license plate information, the position information of the vehicle C1, and the detection time at which inappropriate behavior is detected to the storage 63, respectively, of the plurality of captured images received from the in-vehicle camera system CS via the communication unit 60. , Remember. The processor 61 generates a control signal for requesting a number similarity candidate list for the license plate information of another vehicle in which the driver has performed inappropriate behavior, and the generated control signal and the license plate information are LPRed via the network NW2. Send to server S2.

When the processor 61 receives the number similarity candidate list from the LPR server S2 via the communication unit 60, the processor 61 administers the detection information and the number similarity candidate list assigned the same identification key as the identification key assigned to the license plate information. Send to PCP2.

The processor 61 receives from the administrator PCP2 the number information that matches the license plate information in which the inappropriate behavior is detected in the number similarity candidate list. The inquiry of the license plate information to the number-similar candidate list is confirmed by a security guard or a police officer who uses the administrator PCP2, and the result is input. Based on the number information received from the administrator PCP2, the processor 61 is assigned to the license plate information in which inappropriate behavior is detected with respect to the information about the owner of the vehicle having this number information in the number similarity candidate list. The same identification key as the identification key is assigned, the association is executed, and the identification key is stored in the storage 63.

Further, when information such as a comment is added later by a security guard or a police officer, the processor 61 assigns the same identification key as the identification key given to the related detection information and executes the association.

As a result, the inappropriate behavior detection system according to the first embodiment assigns an identification key for associating each of the detected evidence information of the driver's inappropriate behavior, and a comment added by a security guard or a police officer at a later date. It is possible to assign the same identification key to such information and associate it. Therefore, the inappropriate behavior detection system can acquire useful evidence information that the inappropriate behavior of the driver while driving in the vehicle is detected, and can efficiently support the crackdown or investigation of the inappropriate behavior.

The memory 62 has, for example, a RAM as a work memory used when executing each process of the processor 61, and a ROM for storing a program and data defining the operation of the processor 61. Data or information generated or acquired by the processor 61 is temporarily stored in the RAM. A program that defines the operation of the processor 61 is written in the ROM. The memory 62 contains information for detecting inappropriate behavior of the driver while driving (for example, the driver uses a mobile phone or a smartphone) based on an image captured by the front camera CA1 or the rear camera CA2. You may memorize the motion, pose, etc.).

The storage 63 stores the detection information received from the vehicle-mounted PCP1. Further, when the storage 63 receives the number information that matches the license plate information from the number similarity candidate list from the administrator PCP2, the storage 63 stores the information about the owner of the vehicle after being given the identification key by the processor 61.

An example of the operation procedure and an example of the detection status of the inappropriate behavior detection system will be described with reference to FIGS. 5 and 6. FIG. 5 is a sequence diagram illustrating an example of an operation procedure related to detection of the inappropriate behavior detection system according to the first embodiment. FIG. 6 is an explanatory diagram showing an example of an inappropriate detection situation according to the first embodiment. As the other vehicle, an example of the other vehicle C2 traveling in the oncoming lane of the vehicle C1 will be described. Further, in the operation procedure example described with reference to FIG. 5, an example in which the side camera CA3 is not installed will be described. Needless to say, the operation procedure example of the inappropriate behavior detection system is not limited to this example.

The explanatory diagram shown in FIG. 6 is a situation explanatory diagram showing an example of an operation procedure example of the inappropriate behavior detection system described with reference to FIG. The vehicle C1 includes a front camera CA1 having an angle of view Ang1 and a rear camera CA2 having an angle of view Ang2 in the vehicle C1, and travels in the direction indicated by the arrow (left direction) in FIG. The other vehicle C2 is traveling in the oncoming lane of the vehicle C1 in the direction indicated by the arrow (right direction) in FIG. In addition, the driver H1 of the other vehicle C2 is operating the smartphone.

The front camera CA1 images the front side of another vehicle C2 traveling in the oncoming lane of the vehicle C1 (St1).

The front camera CA1 transmits a front image of the front side of the other vehicle C2 to the vehicle-mounted PCP1 (St2).

The in-vehicle PCP1 analyzes the received front image and detects the characteristics of the other vehicle C2 and the driver H1 (St3).

The in-vehicle PCP1 determines whether or not the detected driver is performing inappropriate behavior (St4).

When the in-vehicle PCP1 determines in the process of step St4 that the driver is performing an inappropriate action, the in-vehicle PCP1 generates a control signal for requesting a rear side image of the rear side of the other vehicle C2 by the rear camera CA2. It is transmitted to the rear camera CA2 (St5).

The rear camera CA2 images the rear side of the other vehicle C2 (St6). The rear camera CA2 may transmit an captured image (rear image) of another vehicle traveling behind the vehicle C1 regardless of the control signal received from the vehicle-mounted PCP1.

The rear camera CA2 transmits the front image of the other vehicle C2 to the vehicle-mounted PCP1 (St7).

The in-vehicle PCP1 analyzes the received rear side image and detects the characteristics of the other vehicle C2. The in-vehicle PCP1 determines whether or not the characteristics of the other vehicle C2 detected from the front image and the characteristics of the other vehicle C2 detected from the rear image match (St8).

When it is determined in the process of step St8 that the characteristics of the other vehicle C2 detected from the front image and the characteristics of the other vehicle C2 detected from the rear image match, the in-vehicle PCP1 further increases from the rear image. The license plate information of the vehicle C2 is detected (St9).

The vehicle-mounted PCP1 assigns an identification key for associating the front image, the rear image, and the license plate information, and stores these (St10).

The vehicle-mounted PCP1 transmits the front image, the rear image, and the license plate information to which the identification key is attached to the evidence management server S1 via the network NW1 (St11).

The evidence management server S1 stores the front image, the rear image, and the license plate information received from the vehicle-mounted PCP1 (St12).

As described above, the inappropriate behavior detection system according to the first embodiment can acquire evidence information of the detected inappropriate behavior of the driver and efficiently support the crackdown on the inappropriate behavior.

In the above-mentioned operation procedure example, in order to avoid duplication of the document, in the procedure after step St9, the detection time when the inappropriate behavior is detected, the position information of the vehicle C1, and each of the plurality of captured images are captured. The description of other detection information such as each of the plurality of captured images including the time before and after the time is omitted.

An operation procedure example, an operation procedure example, and a detection status example relating to the display of the list information of the inappropriate behavior detection system will be described with reference to FIG. 7. FIG. 7 is a sequence diagram illustrating an example of an operation procedure relating to display of list information of the inappropriate behavior detection system according to the first embodiment. In the description of FIG. 7, the same processing already described in the operation procedure example of FIG. 5 will be omitted by assigning the same reference numerals.

The evidence management server S1 transmits the license plate information M1 (see FIG. 8) received from the vehicle-mounted PCP1 to the LPR server S2, and requests information on a number similar to the license plate information M1 and its owner (St13).

Based on the license plate information M1 received from the evidence management server S1, the LPR server S2 generates a number-similar candidate list consisting of numbers similar to the license plate information numbers and candidates for the owner of the vehicle (St14). ..

The LPR server S2 transmits the generated number-like candidate list to the evidence management server S1 (St15).

The evidence management server S1 transmits the received number-like candidate list, the front image, and the rear image to the administrator PCP2 (St16).

The administrator PCP2 displays the received number-like candidate list, front-side image, and rear-side image on a monitor (not shown) (St17).

A security guard or police officer who operates the administrator PCP2 inquires about a number that matches the number of the license plate information M1 in which inappropriate behavior is detected in the number-like candidate list displayed on the monitor of the administrator PCP2. I do. A security guard or a police officer selects a number M2 (see FIG. 9) that matches the license plate information M1 and inputs it to the administrator PCP2 as an inquiry result. The administrator PCP2 identifies the owner of the other vehicle C2 based on this input operation (St18).

As described above, the inappropriate behavior detection system according to the first embodiment identifies the driver who has performed inappropriate behavior based on the evidence information of the detected inappropriate behavior of the driver, and efficiently cracks down on the inappropriate behavior. I can help.

FIG. 8 is a diagram showing an example of the detection data D1. The detection data D1 shown in FIG. 8 is detection information received from the vehicle-mounted PCP1 and stored in the storage 63 in the evidence management server S1.

The detection data D1 includes a date time, position information, a front image, a rear image, and evidence information, and is stored for each identification key. The information included in the detection data D1 is not limited to the example shown in FIG. 8, and includes, for example, a side image, an imaging time in which each of the plurality of captured images is captured, and a time before and after the captured image is captured. Images, features of another vehicle C2 (eg, color, size, vehicle type), etc. may be included.

The Date time is the detection time when the driver's inappropriate behavior is detected, such as "2019-06-01 13:05:38", "2019-06-01 13:24:10", etc. Date and time information is stored. The date time shown in FIG. 8 is composed of dates and times in the order of "year-month-day hour: minute: second", but it goes without saying that the date time is not limited to this.

In the position information, the position information of the vehicle C1 when the inappropriate behavior of the driver is detected is stored. The position information is stored as coordinate information consisting of latitude and longitude such as "40.7409233-74.165561" and "40.731718, -74.203394", but the position information is not limited to this, and inappropriate behavior is caused. It suffices if the detected position can be specified.

The front side image is an image of the front side of the other vehicle C2, and stores an image of the driver performing inappropriate behavior. In the operation procedure example shown in FIG. 5, the front image is captured by the front camera CA1. However, when another vehicle is located behind the vehicle C1, the captured image captured by the rear camera CA2. It may be. The front image shown in FIG. 8 shows an example of an image cut out centering on the driver of the other vehicle C2. For example, the front image may be an image of the entire front side of the other vehicle C2.

The image of the license plate of another vehicle driven by the driver is stored in the rear image. In the operation procedure example shown in FIG. 5, the rear side image is captured by the rear side camera CA2, but the other vehicle is provided on the rear side of the vehicle C1 and the license plate is provided on the front side of the other vehicle. In this case, it may be an captured image captured by the front camera CA1. Further, the rear side image shown in FIG. 8 shows an example of an image cut out centering on the license plate number of the other vehicle C2. For example, the rear side image is an image of the entire rear side of the other vehicle C2. You may.

As the evidence information, the identification key given by the ID giving unit 24 is stored. The evidence information is different for each detected detection information such as "ABC00001_20190601130000" and "ABC01001_2019601132000", and each of the plurality of detection information is identifiable.

FIG. 9 is a diagram showing an example of license data D2. The license data D2 is stored in the LPR server S2 and is information about the license plate information and the owner of each of the plurality of vehicles. Needless to say, the information stored in the LPR server S2 is not limited to the information shown in the license data D2.

The license data D2 includes a License Plate Number, an Owner, an Addless, and a Phone Number.

As shown in FIG. 9, the license plate information registered for each vehicle such as "6GIH461" and "14L8405" is stored in the License Plate Number.

In the Owner, the name information of the owner for each vehicle such as "Mike Williams" and "Jane Smith" is stored.

The address information of the vehicle owner is stored in the address, such as "XXX Street, Hackensack, NJ" and "XXX Ave, Rutherford, NJ".

In the Pone Number, the telephone number information of the owner's home, mobile phone, etc. is "+ 1-000-000-0000" and "+ 1-111-111-1111". The telephone number information shown in FIG. 9 is an example, and it is needless to say that the information is not limited to this and may differ depending on the country / region.

FIG. 10 is a diagram showing an example of inappropriate behavior detection driver data D3. The inappropriate behavior detection driver data D3 is configured to include the inquiry result of a guard or a police officer, and is stored in the evidence management server S1. In the description of FIG. 10 shown below, the same information already described in FIGS. 8 and 9 will not be described.

The inappropriate behavior detection driver data D3 is composed of a Date time, a Location, a License, a License, a Driver image, a Vehicle Owner, an Addless, and a Playback. The inappropriate behavior detection driver data D3 shown in FIG. 10 is an example, and is not limited thereto. For example, although not shown in the inappropriate behavior detection driver data D3, each of a plurality of captured images such as a front image, a side image, and a rear image may include comments from a guard or a police officer.

Map information based on the position information in which the inappropriate behavior shown in FIG. 8 is detected is stored in the location.

The license (text) stores the text information of the numbers included in the number similarity candidate list received from the LPR server S2. The License (text) may be text information obtained by image analysis of license plate information.

The driver image is an image in which a part of the captured image captured by the front camera CA1 or the rear camera CA2, including the driver, is partially cut out.

In the Vehicle Owner, the address information of the owner (driver) who has performed an inappropriate action included in the number-like candidate list received from the LPR server S2 is stored.

In the Playback, the captured image including the time before and after the captured image stored in the Driver image is stored is stored. As the captured image stored in the Playback, each of the plurality of captured images including the time before and after each of the front image, the rear image, and the side image is captured may be stored.

As described above, the inappropriate behavior detection system according to the first embodiment is the front camera CA1 that captures one of the front and rear sides of the other vehicle C2 and the rear camera that captures the other of the front and rear sides of the other vehicle. This is an inappropriate behavior detection system in which an in-vehicle camera having CA2 and an image processing device are communicably connected. In the improper behavior detection system, the in-vehicle cameras CA1 and CA2 transmit a first image of the front side including the driver of the other vehicle C2 to the image processing device, and the image processing device is based on the received first image. When a predetermined action during driving of the driver of the other vehicle C2 is detected, a control signal instructing the image rear side of the other vehicle C2 is transmitted. The in-vehicle cameras CA1 and CA2 transmit a second image of the rear side of the other vehicle to the image processing device based on the control signal, and the image processing device uses the number plate of the other vehicle C2 based on the second image. The information is detected, and the first image, the second image, and the number plate information are associated and stored.

As a result, the inappropriate behavior detection system according to the first embodiment can detect the inappropriate behavior of the driver while driving in the vehicle, and is based on each of a plurality of captured images of the front side and the rear side of the other vehicle C2. , The driver and license plate information can obtain evidence information associated with each other, and can efficiently support the crackdown on inappropriate behavior of the driver while driving in another vehicle C2.

Further, as described above, the image processing device P1 in the inappropriate behavior detection system according to the first embodiment determines whether or not the characteristics of the other vehicle C2 reflected in each of the first image and the second image match. The inappropriate behavior detection system detects the license plate information of the other vehicle C2 based on the second image when the features match. As a result, the inappropriate behavior detection system according to the first embodiment can detect the inappropriate behavior of the driver while driving in the other vehicle C2, and also captures a plurality of captured images of the front side and the rear side of the other vehicle C2. As a result, it is possible to acquire evidence information in which the other vehicle C2, the driver, and the license plate information are associated with each other, and it is possible to efficiently support the crackdown on inappropriate behavior of the driver while driving in the other vehicle C2.

Further, as described above, the inappropriate behavior detection system according to the first embodiment further includes a server S1 that is communicably connected to the image processing device P1. The image processing device P1 in the improper behavior detection system uses an identification key that associates the first image, the second image, and the license plate information to server a data set including the first image, the second image, and the license plate information. Store in S1. As a result, in the inappropriate behavior detection system according to the first embodiment, even if the data set (evidence information) is transmitted from the image processing device P1 to another device (for example, the server S1), the identification key impairs the relevance. Can be memorized without. Therefore, a guard or a police officer can obtain relevant evidence information and can efficiently crack down on inappropriate behavior of a driver while driving in another vehicle C2.

Further, as described above, the inappropriate behavior detection system according to the first embodiment is communicably connected to the server S1 and stores the license plate information of each of the plurality of vehicles and the owner information thereof in association with each other. The second server S2 is further provided. The server S1 transmits the license plate information to the second server S2, and the second server S2 executes a similarity determination between the license plate information transmitted from the server S1 and the license plate information of each of the plurality of vehicles, and the number The license plate information similar to the license plate information and the list information regarding the owner information thereof are generated and transmitted to the server S1, and the server S1 displays the list information transmitted from the second server S2 on the monitor. As a result, the inappropriate behavior detection system according to the first embodiment can provide owner information of another vehicle C2 having similar license plate information based on the evidence information of the detected inappropriate behavior of the driver. It can effectively support the crackdown on inappropriate behavior. Therefore, a security guard or a police officer can acquire relevant evidence information and can efficiently crack down on inappropriate behavior while driving in another vehicle C2.

Further, as described above, the predetermined behavior detected by the inappropriate behavior detection system according to the first embodiment is a manual operation of the driver's mobile phone while driving in the other vehicle C2. As a result, the inappropriate behavior detection system according to the first embodiment can detect inappropriate behavior related to manual operation of the driver's mobile phone while driving, and can efficiently support the crackdown on inappropriate behavior.

Further, as described above, the predetermined behavior detected by the inappropriate behavior detection system according to the first embodiment is a call operation using the mobile phone of the driver while driving in the other vehicle C2. As a result, the inappropriate behavior detection system according to the first embodiment can detect inappropriate behavior related to a call operation using the driver's mobile phone while driving, and can efficiently support the crackdown on inappropriate behavior.

Further, as described above, the vehicle-mounted cameras CA1 and CA2 in the inappropriate behavior detection system according to the first embodiment image the other vehicle C2 while the patrol vehicle C1 provided with the vehicle-mounted cameras CA1 and CA2 is stopped. As a result, the inappropriate behavior detection system according to the first embodiment can detect the inappropriate behavior of the driver while driving in the other vehicle C2 from a place suitable for imaging the other vehicle C2 such as the side of the road, and the inappropriate behavior can be detected. You can efficiently support the crackdown. Further, the inappropriate behavior detection system can detect inappropriate behavior of a driver while driving in another vehicle C2 not only while the patrol vehicle C1 is running, but also, for example, in a traffic jam or waiting time due to a signal. ..

Further, as described above, the vehicle-mounted cameras CA1 and CA2 in the inappropriate behavior detection system according to the first embodiment image the other vehicle C2 while the patrol vehicle C1 provided with the vehicle-mounted cameras CA1 and CA2 is running. As a result, the inappropriate behavior detection system according to the first embodiment can detect inappropriate behavior of the driver while driving in parallel with the patrol work, and can efficiently support the crackdown on inappropriate behavior.

Further, as described above, the image processing device P1 in the inappropriate behavior detection system according to the first embodiment acquires the position information of the patrol vehicle C1 provided with the in-vehicle cameras CA1 and CA2, and obtains the position information of the patrol vehicle C1. It is transmitted to the server S1 in association with the 1st image, the 2nd image and the license plate information. As a result, the inappropriate behavior detection system according to the first embodiment can further acquire evidence information regarding the position information in which the inappropriate behavior of the driver while driving in the other vehicle C2 is detected, and the crackdown on the inappropriate behavior is efficient. Can be supported.

(Embodiment 2)
The inappropriate behavior detection system according to the first embodiment is based on the images captured by the front camera CA1 and the rear camera CA2 provided in the vehicle C1, and the driver of another vehicle traveling around the vehicle C1 is unable to perform. An example of detecting appropriate behavior is shown. The inappropriate behavior detection system according to the second embodiment is a vehicle photographing camera CCA fixedly installed, for example, by attaching it to a pole installed on the side of a general road or hanging it from a gantry installed on an expressway. An example of detecting inappropriate behavior of a driver of another vehicle traveling around the vehicle C1 based on the captured image captured by the vehicle C1 will be described.

FIG. 11 is a diagram showing a configuration example of the inappropriate behavior detection system according to the second embodiment. FIG. 12 is a diagram showing an installation example of the vehicle photographing camera CCA according to the second embodiment. The internal configuration example of the inappropriate behavior detection system according to the first embodiment has substantially the same configuration as the internal configuration example of the inappropriate behavior detection system according to the first embodiment. The same components as those in the first embodiment are used with the same reference numerals, and the description thereof will be omitted. Although only one vehicle photographing camera CCA is shown in FIGS. 11 and 12, the present invention is not limited to this, and a plurality of vehicle photographing cameras CCA may be provided.

The vehicle photographing camera CCA as an example of the image processing device is fixedly installed, for example, by attaching it to a pole installed on the side of a general road or suspending it from a gantry installed on a highway. As shown in FIG. 12, the vehicle photographing camera CCA images the driver and the license plate of the vehicle C3 having an angle of view of a predetermined width and entering an imaging region (for example, a road) within the angle of view. In the following description, the captured image of the driver captured by the vehicle photographing camera CCA may be referred to as "in-vehicle face image". Similarly, in the following description, the captured image of the license plate captured by the vehicle photographing camera CCA may be simply referred to as a "license plate image".

The vehicle photographing camera CCA determines whether or not the driver is performing inappropriate behavior based on the captured image of the driver of the vehicle C3. When the vehicle photographing camera CCA determines that the driver is performing inappropriate behavior, the vehicle photographing camera CCA detects the license plate information of the vehicle C3 from the captured image of the license plate.

The vehicle photographing camera CCA includes an image captured by the driver of the vehicle C3, an image captured by the license plate of the vehicle C3, the detected license plate information, and identification information (for example, a serial number) given to each vehicle photographing camera CCA. Etc.), and the detection information including the imaging time of each of the plurality of captured images is transmitted to the evidence management server S1 via the network NW1.

Based on the received detection information, the evidence management server S1 captures the position information in which these captured images are captured (in other words, information on the installation position of the vehicle photographing camera CCA that captures the inappropriate behavior of the driver of the vehicle C3). To identify. The evidence management server S1 assigns an identification key that associates the received detection information with the specified location information, and stores the identification key in the storage 63. The above-mentioned determination of the presence or absence of inappropriate behavior may be executed by the evidence management server S1.

Next, an example of the internal configuration of the vehicle photographing camera CCA will be described with reference to FIG. FIG. 13 is a diagram showing an example of the internal configuration of the vehicle photographing camera CCA according to the second embodiment.

The vehicle photography camera CCA includes a communication unit 70, a processor 71, a memory 72, an image sensor 73, an illumination driver 74, a short-wavelength illumination 75 for nighttime, a lens block 76, a lens driver 77, and an in-lens filter. It includes a switching module 78, an in-lens filter switching driver 79, a front filter switching module 80, a front filter switching driver 81, a polarization filter turning driver 82, and an illuminance sensor SS1.

The processor 71 is configured by using, for example, a CPU, DSP or FPGA. The processor 71 functions as a controller that controls the overall operation of the vehicle photography camera CCA, controls processing for controlling the operation of each part of the vehicle photography camera CCA, and input / output of data to and from each part of the vehicle photography camera CCA. Performs processing, data arithmetic processing, and data storage processing. The processor 71 operates according to the program stored in the memory 72. The processor 71 uses the memory 72 during operation, and temporarily stores the data or information generated or acquired by the processor 71 in the memory 72.

The memory 72 is configured by using, for example, a RAM and a ROM, and temporarily holds a program necessary for executing the operation of the vehicle photographing camera CCA, and data or information generated during the operation. The RAM is, for example, a work memory used when the vehicle photographing camera CCA is operated. The ROM stores, for example, a program for controlling the vehicle photographing camera CCA in advance.

The communication unit 70 can communicate with the administrator PCP2 via a wired communication line or a network NW1 (for example, a wireless LAN such as Wifi (registered trademark), Bluetooth (registered trademark), or WiGig). The communication unit 70 transmits, for example, an image captured under the first imaging condition suitable for imaging the license plate of the vehicle C3 (sometimes referred to as a “license plate image”) to the evidence management server S1 as channel 1. .. The transmitted captured image is distributed (transmitted) to the administrator PCP2 by the evidence management server S1. In addition, the communication unit 70 manages the image captured under the second imaging condition (which may also be referred to as “face image in the vehicle” or “image captured by the driver”) suitable for the driver of the vehicle C3 as channel 2. Deliver (send) to PCP2.

Further, the communication unit 70 receives the external input signal transmitted from the administrator PCP2 and outputs it to the processor 71. This external input signal is, for example, a command for changing the camera parameters of the vehicle shooting camera CCA by the operation of a worker who browses the installation settings displayed on the administrator PCP2. Here, the camera parameters may include, for example, the exposure time by the electronic shutter, the gain for amplifying the electric signal of the image captured by the image sensor 73, and the intensity of the illumination from the short-wavelength illumination 75 for nighttime, and are limited thereto. Not done. The processor 71 changes and sets the value of the corresponding camera parameter according to the external input signal. The set camera parameters are set in the image sensor 73 or the nighttime short wavelength illumination 75 according to the contents thereof.

The image sensor 73 is an image sensor capable of capturing high-definition images such as 2K, 4K, and 8K, and is composed of a solid-state image sensor such as a CCD (Charged Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). .. This solid-state image sensor generates an electric signal of the captured image corresponding to the optical image based on the photoelectric conversion of the optical image formed on the imaging surface. Further, the image sensor 73 includes the above-mentioned solid-state image sensor, an amplifier for amplifying an electric signal output from the solid-state image sensor, a gain adjustment unit capable of adjusting the gain (sensitivity) of the amplifier, and an imaging time (imaging time). It may be composed of an integrated circuit board on which an electronic shutter (sometimes referred to simply as a “shutter”) capable of controlling (so-called exposure time) and an exposure control circuit for controlling the exposure time of the electronic shutter are mounted. The output of the image sensor 73 may be input to the processor 71 to perform predetermined signal processing, and then the data of the captured image may be generated, or the image sensor 73 executes the predetermined signal processing described above. A control circuit for generating the data of the captured image may be provided.

The lighting driver 74 is configured by using a switching circuit or the like for switching on or off of each of the plurality of nighttime short wavelength illuminations 75. The lighting driver 74 switches each of the plurality of nighttime short wavelength illuminations 75 on or off based on the control instruction from the processor 71. Further, the illumination driver 74 may further have a variable amplifier circuit or the like capable of adjusting the light emission amount (intensity) of the nighttime short wavelength illumination 75. In such a case, the illumination driver 74 enables dimming by adjusting the light emission amount (intensity) of the nighttime short wavelength illumination 75 based on the control instruction from the processor 71.

The nighttime short wavelength illumination 75 as an example of the IR illumination unit is configured by using, for example, an LED (Light Mission Diode), and a plurality (for example, about 10 to 20) are arranged. The nighttime short-wavelength illumination 75 is an illumination light having an intensity corresponding to a control instruction of the illumination driver 74 so that a subject (for example, a vehicle) within an angle of view can be imaged while the operation mode of the vehicle photography camera CCA is the night mode. IR light (near infrared light) is irradiated.

The lens block 76 is a focus lens that forms an optical image of the subject on the imaging surface of the imaging element 73 by focusing (that is, focusing) according to the distance from the vehicle photographing camera CCA to the subject, and from telephoto to wide angle. Includes a zoomable zoom lens. The position of the focus lens and the position of the zoom lens in the lens block 76 are included as examples of camera parameters, and both are stored in the memory 72. The position of the focus lens and the position of the zoom lens are calculated by the processor 71 using the information sent from the administrator PCP2 when the vehicle photographing camera CCA is installed. Further, different values are used for the position of the focus lens depending on the operation mode (specifically, the day mode or the night mode) of the vehicle photographing camera CCA.

The lens driver 77 is configured by using an electric circuit for adjusting the position of a lens (for example, a focus lens or a zoom lens) constituting the lens block 76. The lens driver 77 adjusts the position of the focus lens in the lens block 76 according to the control instruction from the processor 71. The lens driver 77 may adjust the position of the zoom lens to change the zoom magnification according to the control instruction from the processor 71.

The in-lens filter switching module 78 is arranged on the rear side (that is, the opposite object side) of the lens block 76 and on the front side (that is, the objective side) of the image sensor 73. The in-lens filter switching module 78 is arranged so that the IR cut filter (not shown) and the raw glass (not shown) can be switched, and the IR cut filter and the raw glass are alternately switched and arranged on the optical axis of the optical system. To do. The in-lens filter switching module 78 arranges an IR cut filter on the optical axis, for example, in the daytime mode. As a result, during the daytime mode, the image sensor 73 receives RGB (Red Green Blue) light in which the components of the IR band are blocked, and a visible light image having good image quality can be obtained. On the other hand, the in-lens filter switching module 78 arranges the bare glass on the optical axis, for example, in the night mode. As a result, during the night mode, the image sensor 73 receives the incident light that has passed through the bare glass without blocking the components of the IR band by the IR cut filter, and the brightness is constant based on the received incident light. An IR image with a glass (in other words, not too dark) is obtained.

The in-lens filter switching driver 79 is configured by using an electric circuit for driving the in-lens filter switching module 78. The in-lens filter switching driver 79 drives the in-lens filter switching module 78 in accordance with the control instruction from the processor 71, and arranges either the IR cut filter or the bare glass on the optical axis.

The front filter switching module 80 alternately switches the bandpass filter and the polarizing filter (for example, slides them in the left-right direction) to arrange the bandpass filter or the polarizing filter on the optical axis. By arranging the front filter switching module 80 on the subject side (that is, the objective side) on the optical axis of the lens block 76, mechanical adjustment (for example, maintenance) of the front filter switching module 80 becomes easy.

The front filter switching driver 81 is configured by using an electric circuit for driving a motor for the front filter switching module (not shown). The front filter switching driver 81 moves the front filter switching module 80 by driving a motor for the front filter switching module (not shown) based on a control instruction from the processor 71, and causes a bandpass filter or polarization on the optical axis. Place the filter.

The polarizing filter swivel driver 82 is configured by using an electric circuit for driving a polarizing filter rotation motor (not shown). The polarizing filter swivel driver 82 drives a polarizing filter rotation motor (not shown) based on a control instruction from the processor 71, and determines the polarizing axis of the polarizing filter arranged on the optical axis around the optical axis. Rotate by the angle. The polarization axis of the polarizing filter is rotated (tilted) to limit the amount of light that passes through the polarizing filter.

The polarizing filter is rotatable within a mechanical rotation range (ie, mechanical stroke). When the rotation of the polarizing filter rotation motor (not shown) is accelerated after the polarization filter rotation motor (not shown) is started, the angular velocity of the polarizing filter rotation motor (not shown) gradually increases and reaches a constant angular velocity. .. In such a case, the polarizing filter shifts from acceleration to a possible range (that is, soft stroke) of rotation at a constant speed.

On the other hand, in the polarizing filter, when the rotation of the polarizing filter rotation motor (not shown) is decelerated, the angular velocity of the polarizing filter rotation motor (not shown) gradually decreases to 0 (zero). The polarizing filter rotates from a constant speed to a deceleration. The range in which the polarizing filter can rotate at a constant speed (that is, soft stroke) can be arbitrarily adjusted by the torque of the polarizing filter rotation motor (not shown). Further, in the range in which the polarizing filter can rotate at a constant speed, the angle (deviation angle) of the polarizing axis of the polarizing filter depends on the amount of rotation of the polarizing filter from the origin detected by the origin sensor for rotating the polarizing filter (not shown). Be adjusted. The declination of the polarizing filter is included as an example of camera parameters and is stored in the memory 72. The declination angle of the polarizing filter is calculated by the processor 71 using the information sent from the administrator PCP2 when the vehicle photographing camera CCA is installed.

The illuminance sensor SS1 detects the illuminance of light from the surroundings of the vehicle photographing camera CCA. For the illuminance sensor SS1, for example, a photodiode or a phototransistor is used. The illuminance sensor SS1 is attached to the front surface of the housing of the vehicle photography camera CCA so that the illuminance of light in the direction in which the vehicle exists as the subject of the vehicle photography camera CCA can be detected. The illuminance information (specifically, the illuminance value data) detected by the illuminance sensor SS1 is input to the processor 71. Based on the illuminance information, the processor 71 determines whether the current operation mode of the vehicle photographing camera CCA is the day mode or the night mode.

For example, when the processor 71 determines that the illuminance information is higher than the predetermined threshold value (in other words, the surroundings are bright), the processor 71 sets the operation mode of the vehicle photographing camera CCA to shift to the day mode. Further, when the processor 71 determines that the illuminance information is lower than the predetermined threshold value (in other words, the surroundings are dark), the processor 71 sets the operation mode of the vehicle photographing camera CCA to shift to the night mode. If the current illuminance information does not become higher or lower than the predetermined threshold value, the current operation mode is maintained. In addition, information (for example, a flag) indicating the day mode or the night mode is temporarily held in the memory 72, for example.

FIG. 14 is a flowchart showing an example of an operation procedure related to imaging of the vehicle photographing camera CCA according to the second embodiment. The process shown in FIG. 14 is repeatedly executed, for example, until the power of the vehicle photographing camera CCA is turned on and the power is turned off.

Based on the external input signal from the communication unit 70, the processor 71 has an image parameter of the first imaging condition suitable for imaging the license plate of the vehicle C3, or an image of the second imaging condition suitable for imaging the driver of the vehicle C3. Calculate the parameters (St31). The processor 71 sets the calculation result (image parameter) in the memory 72. The vehicle photographing camera CCA captures images while switching between the license plate image and the vehicle interior face image (driver's image) in a time division manner (for example, frame by frame). At this time, the processor 71 captures the captured image of the license plate in the odd-numbered frame (captured image) and the vehicle interior face image (captured image of the driver) in the even-numbered frame (captured image).

After the processing in step St31, the processor 71 determines whether the exposure time of the electronic shutter of the image sensor 73 is "Long" or "Short" (St32).

In the process of step St32, when the even-th frame is imaged, the processor 71 determines that the exposure time of the electronic shutter corresponding to the vehicle interior face image (driver's image) is "Long" (St32, Long). , Image parameters (for example, exposure time and gain of the electronic shutter) suitable for capturing an in-vehicle face image (driver's captured image) are set in the imaging element 73 (St33).

The image sensor 73 transfers the data of the vehicle interior face image (image captured by the driver) to the processor 71 based on the image parameters set in the process of step St33 (St34).

The processor 71 executes predetermined signal processing (for example, noise removal, white balance, image compression) on the data of the vehicle interior face image from the image sensor 73 (St35). As a result, the security guard or police officer who operates the administrator PCP2 can easily determine whether or not there is inappropriate behavior of the driver while driving in the vehicle C3 reflected in the vehicle interior face image (driver's image).

The processor 71 temporarily stores the signal-processed vehicle interior face image data in the memory 72 (St36). After the process of step St36, the process of the vehicle photographing camera CCA returns to the process of step St31.

On the other hand, in the process of step St32, when the odd-th frame is imaged, the processor 71 determines that the exposure time of the electronic shutter corresponding to the number plate image is "Short" (St32, Short), and the number plate image. Image parameters suitable for imaging (for example, exposure time and gain of an electronic shutter) are set in the image sensor 73 (St37).

The image sensor 73 transfers the license plate image data to the processor 71 based on the image parameters set in the process of step St37 (St38).

The processor 71 executes predetermined signal processing (for example, noise removal, white balance, image compression) on the data of the image captured by the license plate from the image sensor 73 (St39). As a result, the guard or police officer who operates the administrator PCP2 can easily confirm the license plate information of the vehicle C3 reflected in the captured image of the license plate.

The processor 71 temporarily stores the data of the captured image of the license plate subjected to the signal processing in the memory 72 (St36). As a result, the vehicle photography camera CCA switches between the image parameters for the in-vehicle face image and the image parameters for the number plate image for each frame, and the inside of the vehicle is imaged under the image parameters suitable for the image of the driver of the vehicle C3. A face image (image captured by the driver) can be generated, and an image captured by the license plate captured under image parameters suitable for imaging the license plate can be generated.

FIG. 15 is a flowchart showing an example of an operation procedure related to data transmission of the vehicle photographing camera CCA according to the second embodiment. The process shown in FIG. 15 is repeatedly executed, for example, until the power of the vehicle photographing camera CCA is turned on and the power is turned off.

The processor 71 reads out and acquires the data of the in-vehicle face image (image captured by the driver) or the data of the image captured by the license plate temporarily accumulated in the process of step St36 shown in FIG. 14 (St41).

The processor 71 determines whether the exposure time of the electronic shutter of the image pickup device 73 corresponding to the data of the captured image acquired in the process of step St41 is "Long" or "Short" (St42).

When the processor 71 determines in the process of step 42 that the exposure time is "Long" (St42, Long), the processor 71 performs an encoding process (that is, a coding process) suitable for the exposure time (St43). .. For example, when the processor 71 acquires the driver's face through the windshield of the vehicle C3 as a clear captured image, the processor 71 performs an encoding process at a low compression rate.

The processor 71 distributes (transmits) the data of the in-vehicle face image (image captured by the driver) encoded in the process of step St43 to the network NW1 as a stream 1, and the processor 71 is a destination server (for example, evidence) via the communication unit 70. Deliver (transmit) to the management server S1) (St44). After the processing in step St44, the processing of the vehicle photographing camera CCA returns to the processing in step St41.

On the other hand, when the processor 71 determines that the exposure time is "Shutter" in the process of step St43 (St42, Shutter), the processor 71 performs an encoding process (that is, a coding process) suitable for the exposure time (St45). ). For example, when the processor 71 acquires the captured image of the license plate, the processor 71 may perform the encoding process at a high compression rate.

The processor 71 distributes (transmits) the captured image data of the license plate encoded in the process of step St45 to the network NW1 as a stream 2, and the destination server (for example, the evidence management server S1) via the communication unit 70. (Send) to (St46).

After the process of step St46, the process of the vehicle photographing camera CCA returns to the process of step St41. As a result, the vehicle photography camera CCA performs encoding processing at a compression rate according to the data of the vehicle interior face image (driver's image) or the data of the license plate image according to the exposure time of the electronic shutter of the image element 73. It can be delivered to the destination server (not shown).

FIG. 16 is a flowchart showing an example of an operation procedure related to lighting control of the vehicle photographing camera CCA according to the second embodiment. The process shown in FIG. 16 is repeatedly executed, for example, until the power of the vehicle photographing camera CCA is turned on and the power is turned off.

The processor 71 acquires the ambient illuminance information detected by the illuminance sensor SS1 (St51).

Based on the illuminance information acquired in the process of step St51, the processor 71 determines whether the current time is daytime (for example, morning or daytime) or nighttime (for example, evening or midnight) (St52).

The processor 71 determines whether to set the operation mode of the vehicle photographing camera CCA to the day mode or the night mode based on the determination result in the process of step St52 (St53). For example, the memory 72 stores and holds a threshold value related to a predetermined illuminance, and is set to the day mode if it is higher than this threshold value and set to the night mode if it is lower than this threshold value by control based on the determination result of the processor 71. ..

In the daytime mode (St53, daytime mode), the processor 71 generates a control instruction for executing the processing in the daytime mode, sends it to the front filter switching driver 81, and switches the front filter via the front filter switching driver 81. Drive the module 80 (St54). In the daytime mode, the front filter switching module 80 moves so that the polarizing filter (not shown) is located on the optical axis.

The processor 71 sends the above-mentioned control instruction for the day mode to the in-lens filter switching driver 79, and drives the in-lens filter switching module 78 via the in-lens filter switching driver 79 (St55). In the daytime mode, the in-lens filter switching module 78 moves so that the IR cut filter is located on the optical axis in order to sharpen the RGB image captured by the image sensor 73.

Similarly, the processor 71 sends the above-mentioned control instruction for the day mode to the lighting driver 74, and turns off the plurality of short wavelength illuminations 75 for nighttime via the lighting driver 74 (St56). After the process of step St56, the process of the vehicle photographing camera CCA returns to the process of step S51.

On the other hand, in the case of the night mode (St53, night mode), the processor 71 generates a control instruction for executing the processing in the night mode, sends it to the front filter switching driver 81, and sends the control instruction to the front filter switching driver 81 via the front filter switching driver 81. The filter switching module 80 is driven (St57). In the night mode, the front filter switching module 80 moves so that the bandpass filter (not shown) is located on the optical axis.

The processor 71 sends the above-mentioned control instruction for the night mode to the in-lens filter switching driver 79, and drives the in-lens filter switching module 78 via the in-lens filter switching driver 79 (St58). In the night mode, the in-lens filter switching module 78 moves so that the bare glass is located on the optical axis so as not to block the IR light incident on the vehicle photographing camera CCA.

The processor 71 determines whether the exposure time of the electronic shutter of the image sensor 73 at the time of imaging is either “Long” or “Short” (St59).

When capturing an even-th frame, the processor 71 determines that the exposure time of the electronic shutter corresponding to the vehicle interior face image (driver's image) is "Long" (St59, Long), and the interior of the vehicle is in the night mode. A control instruction of image parameters (for example, the intensity of IR light from the nighttime short wavelength illumination 75) suitable for capturing a face image (driver's image) is sent to the illumination driver 74, and the illumination driver 74 is under this control instruction. A plurality of nighttime short-wavelength illuminations 75 are pulse-lit via (St60). After the process of step St60, the process of the vehicle photographing camera CCA returns to the process of step St51.

On the other hand, when imaging the odd-th frame, the processor 71 determines that the exposure time of the electronic shutter corresponding to the captured image of the license plate is "Short" (St59, Short, imaging of the license plate in the night mode). A control instruction of an image parameter (for example, the intensity of IR light from the nighttime short wavelength illumination 75) suitable for capturing an image is sent to the illumination driver 74, and under this control instruction, a plurality of nighttime applications are sent via the illumination driver 74. The short wavelength illumination 75 is pulse-lit (St61). After the process of step St61, the process of the vehicle photographing camera CCA returns to the process of step St51.

As a result, the vehicle photographing camera CCA adaptively switches the front filter switching module 80, the in-lens filter switching module 78, and the nighttime short wavelength illumination 75 on and off according to the day mode or the night mode. Therefore, the vehicle photographing camera CCA can realize high-precision imaging in both the day mode and the night mode, and can generate the captured image of the vehicle interior face (driver) of the vehicle C3 as the subject and the captured image of the license plate.

Next, with reference to FIG. 17, an operation procedure example of an inappropriate behavior detection system using the vehicle photographing camera CCA will be described. FIG. 17 is a sequence diagram illustrating an example of an operation procedure related to detection of the inappropriate behavior detection system according to the second embodiment.

The vehicle photography camera CCA images a driver and a license plate that can be imaged from the front side of the vehicle C3 entering an imaging region (for example, a road) within the angle of view of the vehicle photography camera CCA (St21).

The vehicle photographing camera CCA detects the features of the vehicle C3 and the driver from the front side image including the captured vehicle interior face image (driver's captured image) and the license plate captured image (St22).

The vehicle photographing camera CCA analyzes the inside face image (image captured by the driver) of the front side images and determines whether or not the driver is acting inappropriately (St23).

When the vehicle photographing camera CCA determines in the process of step St23 that the driver is acting inappropriately, the vehicle photographing camera CCA detects the license plate information of the vehicle C3 from the captured image of the license plate in the front image (St24).

The vehicle photographing camera CCA assigns and stores an identification key for associating the license plate information with the front side image composed of the captured vehicle interior face image (driver's captured image) and the license plate captured image (St25). The identification key is given in addition to the above-mentioned front image and license plate information. For example, the identification information (for example, serial number) given to each vehicle photographing camera CCA and each of a plurality of captured images are captured. It is also added to other detection information such as the imaging time.

The vehicle photographing camera CCA transmits the front side image and the license plate information including the captured vehicle interior face image (driver's captured image) and the license plate captured image to which the identification key is attached to the evidence management server S1 (St26).

The evidence management server S1 stores the front side image and the license plate information including the captured vehicle interior face image (driver's captured image) and the license plate captured image to which the received identification key is attached in the storage 63 (St27). ..

As described above, the inappropriate behavior detection system according to the second embodiment can acquire evidence information of the detected inappropriate behavior of the driver and efficiently support the crackdown on the inappropriate behavior.

As described above, the inappropriate behavior detection system according to the second embodiment is an inappropriate behavior detection system in which the vehicle photographing camera CCA that images the front side of the vehicle C3 and the server S1 are communicably connected, and the vehicle photographing. When the camera CCA detects a predetermined action of the driver of the vehicle C3 during driving based on the front image of the front side of the vehicle C3 (that is, the image captured by the driver and the image captured by the license plate), the camera CCA of the vehicle C3 The license plate information is detected, the front image and the license plate information are associated and transmitted to the server S1, and the server S1 stores the front image and the license plate information transmitted from the vehicle photographing camera in association with each other.

As a result, the inappropriate behavior detection system according to the second embodiment can detect the inappropriate behavior of the driver while driving, and is based on the front side image of the vehicle C3 (that is, the captured image of the driver and the captured image of the license plate). Therefore, since the driver and license plate information can obtain useful evidence information associated with each other, it is possible to efficiently support the crackdown on inappropriate behavior of the driver while driving in the vehicle C3.

Further, as described above, the inappropriate behavior detection system according to the second embodiment is communicably connected to the server S1 and stores the license plate information of each of the plurality of vehicles and the owner information thereof in association with each other. The second server S2 is further provided. The server S1 transmits the license plate information to the second server S2, and the second server S2 executes a similarity determination between the license plate information transmitted from the server S1 and the license plate information of each of the plurality of vehicles, and the number The license plate information similar to the license plate information and the list information regarding the owner information thereof are generated and transmitted to the server S1, and the server S1 displays the list information transmitted from the second server S2 on the monitor. Thereby, the inappropriate behavior detection system according to the second embodiment can provide the owner information of the vehicle C3 having similar license plate information based on the detected evidence information of the inappropriate behavior of the driver. , It is possible to efficiently support the crackdown on inappropriate behavior of the driver while driving in the vehicle C3.

Further, as described above, the vehicle photography camera CCA in the inappropriate behavior detection system according to the second embodiment acquires the position information of the point where the vehicle photography camera CCA is installed, and obtains the position information of the vehicle photography camera CCA as the front image and the position information of the vehicle photography camera CCA. It is associated with the license plate information and sent to the server. As a result, the inappropriate behavior detection system according to the second embodiment can further acquire evidence information regarding the position information in which the inappropriate behavior of the driver while driving in the vehicle C3 is detected, and can efficiently control the inappropriate behavior. Can help.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications, modifications, substitutions, additions, deletions, and equality examples within the scope of the claims. It is understood that it naturally belongs to the technical scope of the present disclosure. In addition, each component in the various embodiments described above may be arbitrarily combined as long as the gist of the invention is not deviated.

The present disclosure is an inappropriate behavior detection system that obtains useful evidence information that an inappropriate behavior while driving a driver in a vehicle is detected, and efficiently supports the crackdown on inappropriate behavior while driving. It is useful as a method for detecting inappropriate behavior.

10, 20, 60, 70 Communication unit 11,21,61,71 Processor 12,22,62,72 Memory 13 Imaging unit 23 Image analysis unit 24 ID assignment unit 63 Storage 73 Image sensor C1, C3 Vehicle C2 Other vehicle CA1 Front side Camera CA2 Rear camera CCA Vehicle photography camera CS In-vehicle camera system NW1, NW2 Network P1 In-vehicle PC
P2 administrator PC
RD1 In-vehicle recorder S1 Evidence management server S2 LPR server

Claims (13)

An in-vehicle camera having a front-side camera that captures one of the front and rear sides of the other vehicle and a rear-side camera that captures the other of the front and rear sides of the other vehicle is communicably connected to the image processing device. It is an inappropriate behavior detection system
The in-vehicle camera
A first image of the front side including the driver of the other vehicle is transmitted to the image processing device.
The image processing device is
When a predetermined action during driving of the driver of the other vehicle is detected based on the first image, a control signal instructing the rear side of the other vehicle to be imaged is transmitted.
The in-vehicle camera
Based on the control signal, a second image of the rear side of the other vehicle is transmitted to the image processing device.
The image processing device is
Based on the second image, the license plate information of the other vehicle is detected, and the first image, the second image and the license plate information are associated and stored.
Inappropriate behavior detection system. The image processing device is
It is determined whether or not the characteristics of the other vehicle shown in each of the first image and the second image match.
When the features match, the license plate information of the other vehicle is detected based on the second image.
The inappropriate behavior detection system according to claim 1. A server, which is communicably connected to the image processing device, is further provided.
The image processing device is
A data set including the first image, the second image, and the license plate information is stored in the server by using the identification key that associates the first image, the second image, and the license plate information.
The inappropriate behavior detection system according to claim 1. It is an inappropriate behavior detection system in which a vehicle photography camera that captures the front side of the vehicle and a server are communicably connected.
The vehicle shooting camera
When a predetermined action during driving of the driver of the vehicle is detected based on the front image of the front side including the driver of the vehicle, the license plate information of the vehicle is detected.
The front image and the license plate information are associated with each other and transmitted to the server.
The server
The front image transmitted from the vehicle photographing camera and the license plate information are associated and stored.
Inappropriate behavior detection system. A second server, which is communicably connected to the server and stores the license plate information of each of the plurality of vehicles and the owner information thereof in association with each other, is further provided.
The server
The license plate information is transmitted to the second server,
The second server
The similarity determination between the license plate information transmitted from the server and the license plate information of each of the plurality of vehicles is executed.
The license plate information similar to the license plate information and the list information regarding the owner information thereof are generated and transmitted to the server.
The server
The list information transmitted from the second server is displayed on the monitor.
The inappropriate behavior detection system according to claim 3 or 4. The predetermined action is a manual operation of the driver on the mobile phone while driving.
The inappropriate behavior detection system according to claim 1. The predetermined action is a call operation using the mobile phone while the driver is driving.
The inappropriate behavior detection system according to claim 1. The in-vehicle camera captures the other vehicle while the patrol vehicle equipped with the in-vehicle camera is stopped.
The inappropriate behavior detection system according to claim 1. The in-vehicle camera captures the other vehicle while the patrol vehicle equipped with the in-vehicle camera is running.
The inappropriate behavior detection system according to claim 1. The image processing device is
Acquire the position information of the patrol vehicle equipped with the in-vehicle camera,
The position information of the patrol vehicle is associated with the first image, the second image, and the license plate information, and transmitted to the server.
The inappropriate behavior detection system according to claim 3. The vehicle photography camera acquires the position information of the point where the vehicle photography camera is installed, and obtains the position information.
The position information of the vehicle photographing camera is associated with the front image and the license plate information and transmitted to the server.
The inappropriate behavior detection system according to claim 4. An in-vehicle camera having a front-side camera that captures one of the front and rear sides of the other vehicle and a rear-side camera that captures the other of the front and rear sides of the other vehicle is communicably connected to the image processing device. It is an inappropriate behavior detection method executed by the inappropriate behavior detection system.
When a predetermined action during driving of the driver of the other vehicle is detected based on the first image of the front side including the driver of the other vehicle, a control signal instructing the image of the rear side of the other vehicle is generated. And
Based on the control signal, a second image of the rear side of the other vehicle is transmitted.
Based on the second image, the license plate information of the other vehicle is detected,
The first image, the second image, and the license plate information are associated and stored.
Inappropriate behavior detection method. It is an inappropriate behavior detection method executed by an inappropriate behavior detection system in which a vehicle photographing camera that captures the front side of the vehicle and a server are communicably connected.
When a predetermined action during driving of the driver of the vehicle is detected based on the front image of the front side including the driver of the vehicle, the license plate information of the vehicle is detected.
The front image and the license plate information are associated and stored.
Inappropriate behavior detection method.

Images