JP2015215905A - Information management device, data analysis device, server, information management system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information management device, data analysis device, server, information management system and program that acquire information about a vehicle and the like in an image photographed in an area around a traffic signal.SOLUTION: An information management system 100 comprises: a determination unit that determines at least one of a category of an analysis object, attribute thereof, and quantity thereof on the basis of photographed image data acquired by an imaging device mounted to traffic signals 1_1, 1_2...1_n; a data analysis unit that prepares analysis result information on the basis of determination result information indicative of a result determined by the determination unit as to at least one of the category of the analysis object, attribute thereof and quantity thereof; and an output unit that outputs the analysis result information prepared by the data analysis unit to other devices 5_1...5_m (mobile communication devices) loaded to vehicles 4_1...4_m traveling in a location where the traffic signal is installed.

Description

  The present invention relates to an information management device, a data analysis device, a server, an information management system, and a program.

  For example, there is a traffic monitoring television camera device that mounts a camera on a traffic light, captures the vicinity of an intersection, and monitors traffic conditions using the captured images (see, for example, Patent Document 1).

JP 11-261990 A

  However, the traffic monitoring television camera device of Patent Document 1 displays a captured video on a monitor. For example, when it is desired to obtain information about a vehicle in a captured video, a video captured by a person is displayed. It is necessary to check and confirm. When a person extracts information on a vehicle or the like in the captured video based on an image captured by a traffic light, there is a problem that enormous time and labor are required.

  The present invention has been made in view of the above points, and is an information management device, a data analysis device, a server, an information management system, and an information management device capable of acquiring information on a vehicle or the like in an image photographed in the vicinity of a traffic light. The purpose is to provide a program.

  One aspect of the present invention is a determination unit that determines at least one of a type, an attribute, and a number of analysis targets based on captured image data acquired by an imaging device attached to a traffic light, the type of the analysis target, A data analysis unit for creating analysis result information based on determination result information indicating a result of determination by the determination unit for at least one of the attribute and the number of pieces, and the analysis result information generated by the data analysis unit, An information management device comprising: an output unit that outputs to another device mounted on a vehicle traveling in a place where the vehicle is installed.

  One embodiment of the present invention shows a result of determination by a determination unit that determines at least one of the type, attribute, and number of analysis targets based on captured image data acquired by an imaging device attached to a traffic light. The determination result information is connected to an output unit that outputs the signal identification information for identifying the traffic signal in association with each other, and based on the determination result information, the other device mounted on the vehicle traveling in the place where the signal is installed. A data analysis apparatus including a data analysis unit that creates output analysis result information.

  Another embodiment of the present invention is a server including the information management device described above.

  One embodiment of the present invention includes a plurality of traffic lights each including the information management device described above, and a data analysis device described above, and includes the plurality of traffic lights and a server that communicates. It is a featured information management system.

  According to another aspect of the present invention, a determination unit that determines at least one of a type, an attribute, and a number of analysis targets based on captured image data acquired by an imaging device having a computer attached to a traffic light, the analysis target Data analysis means for creating analysis result information based on determination result information indicating a result determined by the determination means for at least one of the type, attribute, and number of the analysis result information created by the data analysis means, It is a program for functioning as an output means for outputting to another device mounted on a vehicle traveling in a place where the traffic light is installed.

  According to the present invention, it is possible to acquire information relating to a vehicle or the like in an image photographed near a traffic light.

It is the schematic which shows the structure of the information management system which concerns on embodiment of this invention. It is a block diagram which shows each structure of the information management system which concerns on embodiment of this invention. It is a figure which shows an example of the traffic signal periphery information table which concerns on embodiment of this invention. It is a figure which shows an example of the vehicle attribute information table which concerns on embodiment of this invention. It is a figure which shows an example of the person attribute information table which concerns on embodiment of this invention. It is a flowchart for demonstrating the processing flow by the traffic signal information management apparatus which concerns on embodiment of this invention. It is a flowchart for demonstrating the processing flow by the traffic signal information management server which concerns on embodiment of this invention. It is a flowchart for demonstrating the processing flow by the mobile communication apparatus which concerns on embodiment of this invention.

Embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram illustrating a configuration of an information management system according to the present embodiment.
As shown in FIG. 1, the information management system 100 includes a plurality of traffic signal information management devices 2_1, 2_2,..., 2_n mounted on a plurality of traffic signals 1_1, 1_2,. 3 is provided. The plurality of traffic signal information management devices 2_1, 2_2,..., 2_n and the traffic signal information management server 3 are communicably connected via a network NW.
In addition, the plurality of traffic signal information management devices 2_1, 2_2,..., 2_n and the traffic signal information management server 3 are connected to the plurality of vehicles 4_1,. It is possible to communicate with the body communication devices 5_1, ..., 5_m. Here, the mobile communication devices 5_1,..., 5_m will be described by taking communication devices having a car navigation function or the like mounted on the vehicle as an example, but the present invention is not limited to this, and the mobile communication devices 5_1,. It may be a personal computer of a certain user.

Next, referring to FIG. 2, a plurality of traffic signals 1_1, 1_2,..., 1_n, a plurality of traffic signal information management devices 2_1, 2_2, ..., 2_n, and mobile communication devices 5_1,. , 5_m will be described. FIG. 2 is a block diagram showing an example of these configurations.
For convenience of explanation, an example of a traffic signal applicable to a plurality of traffic signals 1_1, 1_2,..., 1_n is a traffic signal 1, and a traffic signal applicable to a plurality of traffic signal information management devices 2_1, 2_2,. An example of the information management device will be described below as an example of the mobile communication device 5 that can be applied to the traffic signal information management device 2 and the plurality of mobile communication devices 5_1,.

As shown in FIG. 2, a traffic light information management device 2 and an imaging device 6 are attached to the traffic light 1. The traffic signal 1 and the traffic signal information management device 2 are connected via an I / F (interface) 71. The traffic signal information management device 2 and the imaging device 6 are connected via an I / F 72.
The traffic light 1 includes a signal display unit 11 and a control device 12. The signal display unit 11 includes a plurality of light emitting units that emit blue, red, yellow, and the like, and is controlled by the control device 12 so that each color light emitting unit emits light at a predetermined timing. The control device 12 controls the light emitting units of the respective colors of the signal display unit 11 to perform predetermined signal display. The control device 12 may control the light emitting units of each color to emit light according to a predetermined timing, and control the light emitting units of each color to emit light according to a control signal input from the traffic light information management device 2. You may do.

The imaging device 6 includes an imaging unit 61 that is, for example, a camera that can capture moving images and videos. The imaging unit 61 captures an image or video near the intersection where the traffic signal 1 is attached, and outputs captured image data obtained by the imaging to the traffic signal information management device 2 via the I / F 72. Further, when the analysis target is a vehicle, the imaging device 6 uses a high-resolution camera to such an extent that detailed features indicating the number, the vehicle type, and the like can be detected by image processing. Further, the imaging device 6 is sensitive enough to detect the detailed characteristics of the analysis target even at night imaging, and can detect the detailed characteristics of a vehicle traveling at high speed. A highly sensitive camera is preferable.
For example, the imaging unit 61 acquires and outputs captured image data at 1/60 second intervals.

  The traffic signal information management device 2 includes an image processing unit 21, a determination unit 22, a traffic signal peripheral information creation unit 23, a storage unit 24, a control unit 25, a communication unit 26, a temperature sensor 27, and a time measuring unit 28. And a microphone 29. The traffic signal information management apparatus 2 is assigned a traffic signal ID (Identification), which is a unique identification number. The traffic signal ID is information for identifying each traffic signal information management device 2 and information associated with a position where the traffic signal information management device 2 is installed.

The temperature sensor 27 is mounted on the traffic signal 1 with a sensor portion for detecting the temperature exposed to the outside of the traffic signal 1, detects the temperature in the vicinity of the traffic signal 1, and provides temperature information indicating this temperature to the periphery of the traffic signal The data is output to the information creation unit 23.
The timer unit 28 measures the date and time, and outputs information indicating the dated time to the traffic signal peripheral information creation unit 23.
The microphone 29 is mounted on the traffic signal 1 in a state of being exposed to the outside of the traffic signal 1, detects a voice in the vicinity of the traffic signal 1, and outputs voice information indicating the voice to the traffic signal peripheral information creation unit 23.

The image processing unit 21 inputs the captured image data acquired by the imaging device 6 via the I / F 72 and detects an analysis target existing in the image of the captured image data. For example, the image processing unit 21 detects a moving object (moving body) such as a vehicle or a person as an analysis target.
In addition, the image processing unit 21 calculates a movement vector of captured image data that is continuous in time series, detects an image region corresponding to the moving object based on the movement vector, and determines the moving speed of the moving object that is the analysis target. To detect.
The image processing unit 21 assigns a unique image ID to each of the input captured image data, and associates the captured image data with the image ID and information indicating the detected moving speed, The signal is output to the traffic signal peripheral information creation unit 23. Note that the information that is output from the image processing unit 21 and that associates the captured image data, the image ID, and the information indicating the moving speed is hereinafter referred to as image processing result information.

The determination unit 22 receives image region data corresponding to an analysis target (here, a moving body) from the image processing unit 21, and performs pattern recognition on the image region data, thereby including the image region data in the image region. Information on the moving object to be determined is determined, and determination result information indicating the determination result is output.
For example, the determination unit 22 determines the number of moving objects, the type of moving object (vehicle or person), and the attributes of the moving object based on the data of the image area corresponding to the analysis target (moving object) detected by the image processing unit 21. And the determination result information indicating the number, type, and attributes of these moving objects is output.

That is, when the type of the analysis target is a vehicle, the determination unit 22 is, for example, any of the vehicle types (bicycle, large motorcycle, scooter, sedan type vehicle, one box type vehicle, small truck, large truck). ), Body color, number, number of passengers, driver sex, driver age, and other attributes are obtained by pattern recognition. When the type of the analysis target is a person, the determination unit 22 determines, for example, the person's gender, age, height, clothes, movement method (walking, bicycle, or motorcycle), and portable items (such as a baby carriage or a cane). Attributes), etc. are obtained by pattern recognition.
The determination unit 22 analyzes the captured image data input from the image processing unit 21 and determines the weather at the time of imaging. For example, the determination unit 22 determines the weather at the time of imaging from clear, cloudy, rainy, snowy, or the like based on the brightness of the captured image data, the sky color, the presence or absence of rain, snow, or the like.

The traffic signal peripheral information creating unit 23 is stored in advance in the storage unit 24, for example, in the traffic signal peripheral information table shown in FIG. 3, the vehicle attribute information table shown in FIG. 4, and the person attribute information table shown in FIG. Write the information to be entered.
The traffic signal peripheral information creation unit 23 inputs the image processing result information obtained by the image processing unit 21 and the determination result information obtained by the determination unit 22, and associates them with each other so that the traffic signal peripheral information table, the vehicle Write to the attribute information table and the person attribute information table.
In addition, the traffic signal peripheral information creation unit 23 uses, for each captured image data, the temperature information indicating the temperature around the traffic signal 1 detected by the temperature sensor 27, the time information indicating the time measured by the clock unit 28, and the microphone 29. The acquired voice information indicating the voice in the vicinity of the traffic signal 1 is associated and written in the traffic signal peripheral information table, the vehicle attribute information table, and the person attribute information table.

  Here, the traffic signal peripheral information table will be described with reference to FIG. Here, an example of information based on captured image data acquired at intervals of 5 minutes among captured image data continuously acquired at 1/60 second intervals by the imaging device 6 is shown. The present invention is not limited to the above configuration, and image processing result information and determination result information based on all captured image data may be associated with a traffic signal peripheral information table, a vehicle attribute information table, and a person attribute information table. Good. In addition, information based on captured image data acquired at a certain time interval may be associated with each table, and based on captured image data acquired when a moving object is detected by the image processing unit 21. Only acquired information may be associated with each table.

As shown in FIG. 3, the traffic signal peripheral information table includes an image ID, a date and time, the number of vehicles, the number of persons, vehicle attribute information, person attribute information, weather, temperature, noise level, and signal lighting. It is a table that associates colors with each other.
The date and time is information indicating the date and time when the captured image data of the corresponding image ID is acquired by the imaging device 6. Note that the date and time may be the date and time when the captured image data is input from the imaging device 6 to the traffic signal information management device 2 via the I / F 72 as the imaging timing. This date and time is the date and time measured by the time measuring unit 28.
The number of vehicles is the number of vehicles included in the captured image data of the corresponding image ID.
The number of persons is the number of persons included in the captured image data of the corresponding image ID.

The vehicle attribute information includes the vehicle ID of each vehicle included in the captured image data of the corresponding image ID. This vehicle ID is unique information assigned to each vehicle in the image, and is an identifier for associating each vehicle with its attribute information with reference to the vehicle attribute information table shown in FIG.
The person attribute information includes the person ID of each person included in the captured image data of the corresponding image ID. This person ID is unique information assigned to each person in the image, and is an identifier for associating each person with their attribute information with reference to the person attribute information table shown in FIG.
The weather is information indicating the weather determined by the determination unit 22. In addition, when the communication part 26 receives the information which shows the weather of the area where the signal apparatus 1 is installed from the external server connected with the network NW, the information which shows this weather may be sufficient.
The temperature is information indicating the temperature detected when the captured image data is captured by the imaging device 6 by the temperature sensor 27.
The noise level is information representing the volume of the sound information determined by the traffic signal information management device 2 based on the sound information acquired by the microphone 29.
The traffic light lighting color indicates the color (blue, red, yellow) that is turned on by the signal display unit 11 of the traffic signal 1 when the captured image data of the corresponding image ID is captured. The information indicating the traffic light lighting color is included in the control signal output from the control unit 25 to the traffic signal 1, output from the control unit 25 to the determination unit 22, and traffic signal peripheral information is created from the determination unit 22 together with the determination result information. Input to the unit 23.

Next, the vehicle attribute information table will be described with reference to FIG.
As shown in FIG. 4, the vehicle attribute information table is a table that associates a vehicle ID, a number, a vehicle type, a vehicle body color, the number of passengers, a driver sex, a driver age, and a traveling speed. .
The vehicle ID is information that identifies each vehicle included in the captured image data of the corresponding image ID.
The number, vehicle type, body color, number of passengers, driver sex, driver age, and traveling speed are information indicating the attributes of the vehicle indicated by the vehicle ID.

Next, the person attribute information table will be described with reference to FIG.
As shown in FIG. 5, the person attribute information table includes a person ID, gender, age, height, clothes, movement method (walking, bicycle or motorcycle), and portable items (prams, walking sticks, etc.). Is a table that associates walking speed with each other.
The person ID is information for specifying each person included in the captured image data of the corresponding image ID.
Age, sex, height, clothes, movement method, portable goods, and walking speed are information indicating the attributes of the person indicated by the person ID.

Returning to FIG. 2, the storage unit 24 stores a traffic signal peripheral information table, a vehicle attribute information table, a person attribute information table, and captured image data associated therewith. In addition, the storage unit 24 stores a traffic signal ID assigned in advance to each traffic signal information management device 2.
The control unit 25 generates a control signal for controlling the lighting timing of the light emitting units of the respective colors of the signal display unit 11 and outputs the control signal to the signal device 1 via the I / F 71 in order to perform a predetermined signal display of the signal device 1.
The communication unit 26 is communicably connected to the traffic signal information management server 3 via the network NW. The communication unit 26 periodically requests the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the captured image data stored in the storage unit 24 or requests from the traffic signal information management server 3. Then, it is transmitted to the traffic signal information management server 3. The communication unit 26 transmits the signal ID in association with the information to be transmitted.
The power supply unit 73 supplies the stored power to the traffic light 1, the traffic light information management device 2, and the imaging device 6.

The traffic signal information management server 3 includes a communication unit 31, a data analysis unit 32, an output unit 33, and a storage unit 34.
The communication unit 31 is communicably connected to the traffic signal information management device 2 via the network NW. The communication unit 31 outputs the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the captured image data received from the traffic signal information management device 2 to the data analysis unit 32.
The data analysis unit 32 stores the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the captured image data received from the traffic signal information management device 2 via the communication unit 31 in the storage unit 34. The data analysis unit 32 performs various data analysis described later based on the information stored in the storage unit 34, and creates analysis result information based on the analysis target attribute based on the determination result information and the like.

The output unit 33 is, for example, a display device such as a liquid crystal display, a data communication unit that transmits information, image data, or the like to an external device or the mobile communication device 5, and the analysis result created by the data analysis unit 32 Output information. For example, when the analysis result information corresponding to a certain vehicle is created by the data analysis unit 32, the output unit 33 transmits the analysis result information to the vehicle. The output unit 33 transmits captured image data corresponding to a certain vehicle to the vehicle based on the analysis result information.
The storage unit 34 stores a traffic signal peripheral information table, a vehicle attribute information table, a person attribute information table, and captured image data received from the traffic signal information management device 2. The storage unit 34 includes a table that associates each traffic signal ID with a position where the traffic signal 1 represented by the traffic signal ID is installed.

The mobile communication device 5 includes a communication unit 51, a control unit 52, and an output unit 53.
The communication unit 51 is communicably connected to the traffic signal information management device 2 and the traffic signal information management server 3 via the network NW. The communication unit 51 outputs captured image data received from the traffic signal information management apparatus 2 or analysis result information received from the traffic signal information management server 3 to the control unit 52.
The control unit 52 controls the output unit 53 to output captured image data and analysis result information received via the communication unit 51.
The output unit 53 is, for example, a data output unit to a display device or an external display device, and is controlled by the control unit 52 to output captured image data and analysis result information.

Next, processing of the traffic signal information management apparatus 2 will be described with reference to FIG. FIG. 6 is a flowchart for explaining an example of a processing flow of the traffic signal information management apparatus 2.
As illustrated in FIG. 6, the imaging unit 61 of the imaging device 6 captures an image near the intersection. Then, the captured image data of the captured image is input to the image processing unit 21 of the traffic signal information management apparatus 2 via the I / F 72 (step ST1). The image processing unit 21 assigns a unique image ID to each input captured image data. For example, the image processing unit 21 will be described below with an example in which the image ID “0002” is assigned to the input captured image data.

  The image processing unit 21 calculates a movement vector between the captured image data (image ID “0002”) and captured image data (for example, an image with the image ID “0001”) acquired in the past in time series. The image processing unit 21 detects an image area corresponding to the moving body based on the calculated movement vector, and calculates the moving speed of the moving body. For example, the image processing unit 21 detects 20 image areas corresponding to the moving object, and calculates the moving speed of each image area.

That is, the image processing unit 21 captures captured image data, the image ID “0002”, data indicating an image area corresponding to the moving object (for example, information specifying the corresponding pixel and the pixel value), and each image. Image processing result information including information indicating the moving speed of the area is acquired (step ST2).
Then, the image processing unit 21 associates the captured image data, the image ID “0002”, and the data indicating the image area corresponding to the moving object, and outputs the data to the determination unit 22. In addition, the image processing unit 21 associates the captured image data, the image ID “0002”, and information indicating the movement speed of each image area, and outputs the information to the traffic signal peripheral information creation unit 23.

Next, the determination unit 22 performs pattern recognition on the data of the image area corresponding to the moving object input from the image processing unit 21, thereby determining information regarding the moving object included in the image area. Determination result information indicating the result is output (step ST3).
For example, the determination unit 22 determines that the data of the plurality of image areas corresponding to the moving body are the data of the image area indicating 15 vehicles and the data of the image area indicating five persons, respectively. It is determined by performing pattern recognition for determining the type and number of the patterns.

  In addition, the determination unit 22 sets the attributes such as the vehicle type, the body color, the number, the number of passengers, the sex of the driver, the driver age, and the like of the vehicle indicated by the data of the plurality of image areas corresponding to the vehicle to the moving object (vehicle). These are determined by performing pattern recognition for determining these predetermined attributes. Furthermore, the determination unit 22 performs pattern recognition for determining the attributes such as the age of the person indicated by the data of the plurality of image areas corresponding to the person, and determining these predetermined attributes of the moving object (person). judge. The determination unit 22 analyzes the captured image data input from the image processing unit 21 and determines the weather at the time of imaging.

  Next, the traffic light peripheral information creation unit 23 indicates the image processing result information obtained by the image processing unit 21, the judgment result information obtained by the judgment unit 22, and the temperature around the traffic light 1 detected by the temperature sensor 27. Based on the temperature information, the time information indicating the time measured by the time measuring unit 28, and the sound information indicating the sound in the vicinity of the traffic signal 1 acquired by the microphone 29, a traffic signal peripheral information table, a vehicle attribute information table, Create a person attribute information table. In other words, the traffic signal peripheral information creating unit 23 associates the input information with each other, stores the traffic signal peripheral information table, the vehicle attribute information table, and the person attribute information table in the storage unit 24 (step ST4). ).

  Then, the communication unit 26 assigns a traffic signal ID to the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the captured image data stored in the storage unit 24, and transmits the traffic signal information to the traffic signal information management server 3. (Step ST5).

Thereafter, the communication unit 26 determines whether or not analysis result information that is a result of data analysis by the traffic signal information management server 3 has been received (step ST6). When the analysis result information is received (step ST6-YES), the communication unit 26 transmits the analysis result information to the mobile communication device 5 by wireless communication (step ST7).
And the traffic signal information management apparatus 2 returns to step ST2 again, and repeats a process, when new image imaging data is input from the imaging device 6 (step ST8-YES).

Next, processing of the traffic signal information management server 3 will be described with reference to FIG. FIG. 7 is a flowchart for explaining an example of the processing flow of the traffic signal information management server 3.
As illustrated in FIG. 7, the communication unit 31 of the traffic signal information management server 3 transmits, for example, a signal requesting transmission of acquired information to the traffic signal information management device 2, and the traffic signal information management device 2 transmits the traffic signal peripheral information table, vehicle The attribute information table, the person attribute information table, and the captured image data are received (step ST21). The communication unit 31 outputs the received information to the data analysis unit 32.
The data analysis unit 32 stores the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the captured image data received from the traffic signal information management device 2 via the communication unit 31 in the storage unit 34, and this storage Based on the information stored in the unit 34, desired data analysis described later is performed (step ST22).

When the analysis result information obtained by the data analysis is transmitted to the mobile communication device 5 (step ST23-YES), the data analysis unit 32 transmits the traffic signal indicated by the traffic signal ID that transmitted the data in step ST21 via the communication unit 31. The analysis result information is transmitted to the information management device 2 (step ST24).
In addition, when the data analysis unit 32 outputs the analysis result information obtained by the data analysis to the output unit 33 (step ST25—YES), for example, an image indicating the analysis result is output from the output unit 33 to the output unit 33. The information is displayed on the display screen (step ST26). As described above, the output unit 33 may transmit the analysis result information to the corresponding mobile communication device 5 according to the analysis result information, or transmit the captured image data to the corresponding mobile communication device 5. May be. In this case, the output unit 33 may transmit analysis result information or captured image data directly to the corresponding mobile communication device 5 via the network NW, and indirectly via the traffic signal information management device 2. Alternatively, these may be transmitted to the corresponding mobile communication device 5 that corresponds.
If the data analysis has not been completed, the process returns to step ST22 and the process is repeated (step ST27-NO).

Next, processing of the mobile communication device 5 will be described with reference to FIG. FIG. 8 is a flowchart for explaining an example of the processing flow of the mobile communication device 5.
When the communication unit 51 of the mobile communication device 5 performs wireless communication with the communication unit 26 of the traffic signal information management device 2 and receives transmission information in the communication area with the traffic signal information management device 2 (step ST41-YES), Information is output to the control unit 52.
For example, when the communication unit 51 receives the analysis result information transmitted from the traffic signal information management server 3 to the traffic signal information management device 2 from the traffic signal information management device 2, the control unit 52 For example, an image indicating the analysis result is displayed on the display screen of the output unit 53 (step ST42).
As described above, the mobile communication device 5 is not limited to the method described above, and may receive information or data directly transmitted from the output unit 33 of the traffic signal information management server 3.

  Here, data analysis by the data analysis unit 32 of the traffic signal information management server 3 will be described. The data analysis unit 32 can execute at least one of data analysis described below.

<Data analysis to monitor the driving situation of the traveling vehicle>
The data analysis unit 32 of the traffic signal information management server 3 determines a dangerous area where a traffic accident is likely to occur, for example, by data analysis.
For example, based on the determination result information, the data analysis unit 32 calculates the occurrence rate of sudden braking by the vehicle to be analyzed by statistical processing and obtains it as analysis result information. Further, the data analysis unit 32 calculates the sudden brake occurrence rate by statistical processing for each region based on the position corresponding to the traffic signal ID, and obtains it as analysis result information.

More specifically, the data analysis unit 32 counts vehicles that are suddenly braked based on changes in the vehicle traveling speed based on the traveling speed in the vehicle attribute information table. The data analysis unit 32 statistically processes the ratio of vehicles that are suddenly braking for each intersection.
The analysis result information that represents the ratio of vehicles that are suddenly braked for each region, obtained in this way, predicts that traffic accidents may occur at intersections that have a large percentage of vehicles that are suddenly braked. Thus, it is useful information in that a warning indicating the danger at the intersection can be displayed.
In addition, the traffic signal information management server 3 is based on the analysis result by this data analysis part 32 with respect to the traffic signal information management apparatus 2 mounted in the traffic signal 1 of the intersection with many ratios of the vehicle which applies a sudden brake. Information for displaying a warning message may be transmitted to the mobile communication device 5.

Further, the data analysis unit 32 detects the traveling speed of the vehicle based on the information in the vehicle attribute information table transmitted from the traffic signal information management device 2 of the plurality of adjacent traffic signals 1, and detects the vehicle that is suddenly braked. It may be specified.
For example, based on the information of the vehicle attribute information table received from the traffic signal information management devices 2_1, 2_2, and 2_3 mounted on the traffic signals 1_1, 1_2, and 1_3 that are continuously arranged in the traveling direction of the lane, the data analysis unit 32 Determines that vehicles having the same number, vehicle type, body color, and the like are the same vehicle. The data analysis unit 32 is configured to detect the traveling speed when the vehicle is traveling between the traffic lights 1_1 and 1_2, the traveling speed when traveling between the traffic lights 1_2 and 1_3, and the traffic signal immediately before the traffic light 1_3. By comparing the traveling speed and the like, it can be determined whether or not the vehicle is rapidly decelerated.

  Further, the data analysis unit 32 is not limited to a vehicle that has been suddenly braked, and by analyzing the captured image data, a vehicle that runs out of the central lane, a vehicle that runs overtaking, a bicycle that crosses the roadway, A person or the like may be detected, and a rate at which these persons are detected may be calculated statistically. These pieces of information are useful information in that a place where dangerous driving or the like is occurring can be found.

Moreover, the data analysis part 32 may calculate the traveling speed of the vehicle which approachs an intersection from the reverse direction, and may determine a collision possibility. For example, based on the determination result information, the data analysis unit 32 detects at least two vehicles to be analyzed and enters the intersection from different directions, and based on the moving speed of the vehicle, Is calculated as the analysis result information by calculating the possibility of collision at the intersection.
More specifically, the traffic signal information management devices 2_1, 2_12, 2_13 mounted on the traffic lights 1_11, 1_12, 1_13 arranged continuously in the traveling direction of the first lane, and the intersection of the first lane and the intersection U It is assumed that there are signal information management devices 2_14, 2_15, and 2_16 mounted on signal devices 1_14, 1_15, and 1_16 that are continuously arranged in the second lane that intersects. In this case, the traffic lights 1_13 and 1_16 are set at the same intersection U, and control traffic flows in the first lane and the second lane, respectively.
The data analysis unit 32 determines that vehicles having the same number, vehicle type, vehicle body color, and the like are the same vehicle based on information in the vehicle attribute information table, and the vehicle A entering the intersection U from the first lane. The vehicle B entering from the second lane is detected. The data analysis unit 32 calculates the traveling speeds of the vehicles A and B, and determines whether or not the timings when both the vehicles A and B enter the intersection U are the same when entering the intersection U at the traveling speed. judge. If the approach timings are the same, the data analysis unit 32 determines that the possibility of collision is high, and there is a risk of collision with the traffic signal information management device 2 of the traffic signal 1 in the lane in which the vehicles A and B are traveling. Therefore, analysis result information indicating that a message prompting to slow down is transmitted is transmitted. The traffic signal information management device 2 that has received the analysis result information transmits a message that prompts the vehicle A or B traveling in the communication area to decelerate because there is a danger of a collision.

Furthermore, the data analysis unit 32 may calculate the presence / absence of a traffic jam and the length of the traffic jam based on the number of vehicles and the traveling speed in the traffic signal peripheral information table.
For example, the data analysis unit 32 generates information related to road congestion caused by the vehicle based on the determination result information and obtains it as analysis result information.
When a plurality of vehicles traveling at a traveling speed below a certain speed are detected, the data analysis unit 32 calculates how long the vehicle is generated in the lane traveling direction. Then, the data analysis unit 32 reads the road information stored in the storage unit 34 in advance, identifies the road where the traffic jam occurs, and creates the traffic jam information indicating the road where the traffic jam occurs. The data analysis unit 32 transmits this traffic jam information to the mobile communication device 5 via the network NW.
The mobile communication device 5 is a device having a car navigation function, for example. The mobile communication device 5 receives the traffic jam information and outputs information on the occurrence of the traffic jam based on the traffic jam information. If the mobile communication device 5 determines based on the traffic jam information that there is a traffic jam on the route to the current position or the destination when traveling, the mobile communication device 5 notifies the user of the route change.
Thus, when the user changes the route, the traffic light peripheral information table, the vehicle attribute information table, and the person attribute information table are useful information in that traffic congestion can be reduced.

Moreover, the data analysis part 32 may detect the vehicle of parking violation based on the traveling speed and vehicle attribute information of a traffic signal periphery information table.
For example, the data analysis unit 32 obtains, as analysis result information, information related to a vehicle that violates traffic rules among the vehicles to be analyzed based on the determination result information.
The data analysis unit 32 detects a stopped vehicle based on the traveling speed over a plurality of captured image data in the determination result by the determination unit 22. When the data analysis unit 32 determines that the vehicle that has stopped is a vehicle that has stopped for more than the time for which parking is prohibited in the parking prohibited area, the number or the vehicle type that indicates the attribute included in the vehicle attribute information, etc. Is read from the vehicle attribute information table and obtained as traffic violation information.
In addition to the parking prohibition, the data analysis unit 32 can obtain information useful for cracking down on traffic violations such as speed violations, signal ignorance, and other violations by data analysis.

For example, when a specific vehicle is traveling at a speed equal to or higher than a specified speed based on information transmitted from the plurality of traffic signal information management devices 2, the data analysis unit 32 displays information for specifying the vehicle in the vehicle attribute information table. To obtain traffic violation information due to speed violations.
In addition, when the vehicle passing through the intersection is in a red state based on the traffic light lighting color of the traffic signal peripheral information table transmitted from the traffic signal information management device 2, the data analyzing unit 32 is information that identifies the vehicle. Is obtained from the vehicle attribute information table and obtained as traffic violation information by ignoring the signal.
Furthermore, the data analysis unit 32 observes the traveling route and traveling speed of each vehicle based on information transmitted from the plurality of traffic signal information management devices 2, and makes a right turn at a right turn prohibited intersection or without a temporary stop. When a vehicle entering the intersection is detected, information for identifying the vehicle is read from the vehicle attribute information table and obtained as traffic violation information.

  In addition, the structure which controls the driving | operation of each vehicle based on the analysis result information obtained by the data analysis part 32 in this way may be sufficient. In this case, the mobile communication device 5 is connected to the drive unit of the vehicle, and controls the traveling direction and traveling speed of the vehicle according to the analysis result information received from the traffic signal information management server 3. For example, when it is determined that the possibility of collision is high as the analysis result information of the data analysis unit 32, the mobile communication device 5 of the corresponding vehicle controls the drive unit of the vehicle so as to reduce the speed.

Further, the data analysis unit 32 may transmit the captured image data together with the analysis result information to the mobile communication device 5. Thereby, the mobile communication device 5 mounted on the vehicle can receive and display, for example, traffic jam information and captured image data that is an image of a road in a traffic jam from the traffic signal information management server 3.
Even if there is no traffic jam, the data analysis unit 32 receives information indicating the travel route of the vehicle from the mobile communication device 5, and corresponds to the road on which the vehicle will travel from this travel route. The captured image data transmitted from the traffic signal information management device 2 of the traffic signal 1 is obtained by searching. Then, the data analysis unit 32 transmits the captured image data to the mobile communication device 5. Thereby, the user can confirm the situation ahead of the travel route with the image.

<Data analysis to obtain data that can be used for store opening plans>
For example, the data analysis unit 32 of the traffic signal information management server 3 obtains information for analyzing a new store opening plan by data analysis, and outputs the information to the computer that displays the information of the new store opening plan. May be.
For example, the computer displays information indicating traffic conditions around the store and information indicating characteristics of passers-by along with the trade area information and property information on the display screen.
For example, the computer displays a map designated by the user on the display screen, reads information associated with the map from the database, and displays the information. The information associated with this map is information representing the traffic and traffic volume in this area, or the attributes and characteristics relating to this area.

The data analysis unit 32 of the traffic signal information management server 3 obtains information indicating the characteristics of the area in association with the map by analysis.
For example, based on the determination result information, the data analysis unit 32 obtains, as analysis result information, information that can be used for marketing analysis of the area where the traffic signal is installed based on the number and attributes of the analysis target.
The data analysis unit 32 sets the traffic signal 1 for each time zone of morning, noon, evening, and night based on information indicating the date and time in the traffic signal peripheral information table and information indicating the number of vehicles and the number of persons. Calculate the traffic and traffic volume of the area, and obtain it as an analysis result. For example, if the traffic volume of the vehicle is large in the morning and evening, it can be estimated that the person commuting by the vehicle passes through the area where the traffic light 1 is present. Therefore, it is useful information in that the characteristics of the trade area can be analyzed.

Further, the data analysis unit 32 obtains, as an analysis result, information representing the characteristics of a person who travels in this area by car based on the vehicle type, driver sex, and driver age in the vehicle attribute information table. For example, if the vehicle type is a one-box car, the driver is in their 20s and 30s, and the gender is female, it can be estimated that there is a high possibility of being a housewife with many family members. Therefore, it is useful information in that the characteristics of the trade area can be analyzed.
Furthermore, the data analysis unit 32 obtains information representing the characteristics of the person who passes through this area as an analysis result based on the gender, age, movement method, and portable goods in the person attribute information table. For example, if the gender is female, the age is 20-30, and a person is pushing a stroller as a portable item, it can be estimated that there is a high possibility of being a housewife with an infant. Therefore, it is useful information in that the characteristics of the trade area can be analyzed.

In addition, the traffic light 1 is often installed in a place where people and cars go and go, and by using the analysis result by data analysis, the marketing trend according to the characteristics of the area where the traffic signal 1 is installed is generally observed. It is possible to analyze from a simple viewpoint.
As a result, in a franchise business such as a convenience store or a pharmacy store, it is possible to plan a new store with good location conditions. For example, when operating a franchise business, a new store opening will be evaluated at the time of opening a new store using paper-based materials such as store location map information, surrounding information, business area information, population, business area, expected sales, and layout diagrams. , Make payments. In addition, member store owner candidates use similar materials to examine the profitability and growth potential of store openings.
As described above, by obtaining information indicating the characteristics of the area from the captured image data by each traffic signal information management device 2, it is possible to acquire a variety of information related to the new store opening plan for supporting the new store opening plan.

Moreover, the data analysis part 32 may analyze the change of the traffic according to the weather based on the weather, temperature, and the number of persons of the signal peripheral information table.
Further, the data analysis unit 32 may statistically analyze the local atmosphere using information indicating the noise level in the traffic signal peripheral information table. For example, an area where the noise level is low on average can be estimated as a quiet residential area.

  Further, the storage unit 34 stores information for performing pattern recognition, and the data analysis unit 32 performs pattern recognition on the captured image data transmitted from the traffic signal information management device 2. Good. For example, as the pattern information stored in the storage unit 34, information for specifying the type and brand of clothes is prepared in advance, and the data analysis unit 32 includes the type and brand of the person's clothes included in the captured image data. May be determined.

<Billing process by analysis result information distribution>
The data analysis unit 32 of the traffic signal information management server 3 may charge the user of the mobile communication device 5 that has transmitted the analysis result information.
For example, if the analysis result information to be transmitted is obtained for a user who has subscribed in advance to a service that transmits specific analysis result information as a result of the data analysis, the data analysis unit 32 performs the mobile communication The analysis result information is transmitted to the device 5, and the storage unit 34 stores that the analysis result information is transmitted to the user. Then, the data analysis unit 32, for example, determines the usage fee of the service that requests payment to each user according to the number of times analysis result information has been sent to each user, the type of information sent, etc. Send to processing center etc. This billing processing center is a center that collects a user's usage fee for transmitting the above-described analysis result information in advance. In this billing processing center, a server capable of communicating with the traffic signal information management server 3 is installed, and this server has personal information (for example, user name and movement) of a user who subscribes to a service for transmitting analysis result information. The identification number of the body communication device) and the service contents (for example, the type of analysis result information requested by the user to be distributed) are stored, and the information is transmitted to the traffic signal information management server 3.

As described above, since the imaging device 6 according to the present embodiment has high resolution and high sensitivity, the traffic signal information management device 2 performs analysis based on captured image data captured by the imaging device 6. Detailed information such as types and attributes can be obtained. Thereby, the traffic signal information management device 2 can create a traffic signal peripheral information table, a vehicle attribute information table, and a person attribute information table in which the types and attributes of the analysis target are associated. Further, the data analysis unit 32 uses the traffic signal peripheral information table, the vehicle attribute information table, and the person attribute information table to analyze characteristics resulting from the person's action pattern in the area where the traffic signal 1 is installed. Can be obtained.
Therefore, the traffic signal peripheral information table, vehicle attribute information table, person attribute information table, and analysis result information obtained in this way correspond to economic trends such as store opening plans for the purpose of monitoring traffic conditions as described above. It can be used for the purpose of grasping marketing trends.
In the present invention, such useful information can be acquired comprehensively from the traffic lights 1 installed in most of the areas where people are present.

In addition, this invention is not restricted to the said embodiment, You may have the following structures.
For example, the data analysis unit 32 has been described by taking the configuration mounted on the traffic signal information management server 3 as an example, but may be mounted on each traffic signal information management device 2. In this case, the data analysis unit 32 mounted on the traffic signal information management device 2 includes the traffic signal peripheral information table, the vehicle attribute information table, the person attribute information table, and the imaging stored in the storage unit 24 by the traffic signal information management device 2 itself. It may use image data. The data analysis unit 32 mounted on the traffic signal information management device 2 performs the above-described data analysis by combining the information transmitted from the other traffic signal information management device 2 and the information of its own storage unit 24. It may be.
Thereby, since communication with the traffic signal information management server 3 can be reduced, the processing speed can be improved.

Moreover, although the signal information management apparatus 2 was demonstrated as a structure mounted in the signal apparatus 1, this invention is not limited to this, You may mount in the direction of the signal information management server 3. FIG. In this case, the captured image data transmitted from the imaging device 6 mounted on the traffic light 1 is received by the traffic signal information management device 2 mounted on the traffic signal information management server 3, and the same processing as described above is performed.
Further, the traffic signal information management device 2 may be configured to include a display device such as a liquid crystal display or an electric display panel, and displays information corresponding to the analysis result information of the data analysis received from the traffic signal information management server 3. It may be a thing.
The traffic light 1 may be a mobile traffic light installed at a construction site or the like. The imaging device 6 may be a camera that can capture a 360 degree range.

  A program for realizing the procedure by the signal information management device 2 or the signal information management server 3 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed. Thus, execution processing may be performed. Here, the “computer system” may include hardware such as an OS (Operating System) and peripheral devices.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used. The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a recording device.

Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (Dynamic) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)) that holds a program for a certain period of time is also included.
The program may be transmitted from a computer system storing the program in a recording device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  DESCRIPTION OF SYMBOLS 1 ... Traffic light, 2 ... Traffic light information management apparatus, 3 ... Traffic light information management server, 4 ... Vehicle, 5 ... Mobile communication apparatus, 6 ... Imaging device, 21 ... Image processing part, 22 ... Determination part, 23 ... Traffic signal peripheral information Creation unit, 24 ... storage unit, 25 ... control unit, 26 ... communication unit, 27 ... temperature sensor, 28 ... timing unit, 29 ... microphone, 31 ... communication unit, 32 ... data analysis unit, 33 ... output unit, 34 ... Storage unit 51 ... Communication unit 52 ... Control unit 53 ... Output unit

Claims (12)

A determination unit that determines at least one of a type, an attribute, and a number of analysis targets based on captured image data acquired by an imaging device attached to a traffic light;
A data analysis unit that creates analysis result information based on determination result information indicating a result determined by the determination unit for at least one of the type, attribute, and number of the analysis targets;
An information management device comprising: an output unit that outputs the analysis result information created by the data analysis unit to another device mounted on a vehicle traveling in a place where the traffic light is installed. The information management apparatus according to claim 1, wherein the output unit transmits the captured image data corresponding to a vehicle to the vehicle based on the analysis result information. The information management apparatus according to claim 1, wherein the captured image data includes at least one of an image of a road in a traffic jam and an image of a travel route of a vehicle. The output unit outputs the analysis result information and the control information to the other device mounted on a vehicle that can be controlled based on control information supplied from the outside,
The information management apparatus according to any one of claims 1 to 3, wherein the data analysis unit further creates the control information based on the analysis result information. 5. The data analysis unit according to claim 1, wherein the data analysis unit calculates, based on the determination result information, a rate of occurrence of sudden braking by the analysis target vehicle by statistical processing and obtains the analysis result information. The information management apparatus as described in any one of them. The data analysis unit calculates the sudden braking occurrence rate by statistical processing for each region based on a position corresponding to traffic signal identification information for identifying the traffic signal, and obtains it as the analysis result information. 5. The information management device according to 5. The output unit outputs, based on the analysis result information, information for displaying a warning message to another device mounted on a vehicle traveling in the region where the occurrence rate of the sudden braking is high. The information management apparatus according to claim 6. The determination unit
When it is determined that the type of the analysis target is a vehicle and the number of the analysis targets is plural, the position and moving speed of each of the plurality of vehicles are included in the determination result information and output to the data analysis unit And
The data analysis unit
The analysis including information indicating presence / absence of a collision of at least two of the plurality of vehicles based on positions and moving speeds of the plurality of vehicles included in the determination result information output by the determination unit. Create results information,
The output unit is
The information indicating the presence or absence of a collision included in the analysis result information created by the data analysis unit is output to another device mounted on a vehicle traveling in a place where the traffic light is installed. The information management device according to claim 7. Based on the captured image data acquired by the imaging device attached to the traffic signal, the traffic signal is identified by determination result information indicating a result determined by the determination unit that determines at least one of the type, attribute, and number of analysis targets. Connected to the output unit that outputs the traffic signal identification information in association with each other,
A data analysis device comprising: a data analysis unit that creates analysis result information output to another device mounted on a vehicle traveling in a place where the traffic light is installed based on the determination result information. A server comprising the information management device according to any one of claims 1 to 8. A plurality of traffic lights each comprising the information management device according to any one of claims 1 to 8,
A server comprising the data analysis device according to claim 9 and communicating with the plurality of traffic lights,
An information management system comprising: A determination means for determining at least one of a type, an attribute, and a number of objects to be analyzed based on captured image data acquired by an imaging device attached to a traffic light;
Data analysis means for creating analysis result information based on determination result information indicating a result determined by the determination means for at least one of the type, attribute, and number of the analysis targets;
Output means for outputting the analysis result information created by the data analysis means to another device mounted on a vehicle traveling in a place where the traffic light is installed;
Program to function as.

Images