JP5980090B2 - Traffic information notification device - Google Patents

Description

  The present invention relates to an apparatus for notifying traffic information by photographing an object with a camera and automatically analyzing the information.

  On roads with poor prospects and intersections, there are many cases where direct confirmation is not possible, which is a factor that is likely to cause traffic accidents. Curved mirrors are often installed at these locations, but depending on the installation method, there may be cases where visibility is poor, and there are cases where oversight or the sense of distance is difficult to grasp due to the characteristics of the convex mirror. .

  As in the example described in Document 1, millimeter wave radar has been put into practical use as a means for detecting the distance to an object and its speed even under bad weather conditions such as rain and fog at night. Although it is used to realize a vehicle rear-end collision prevention function based on information such as the distance of the vehicle, it can only recognize the distance to an object with a clear line of sight.

JP 2007-42042 A

  The problem to be solved is to improve the recognition of the object by displaying additional information that cannot be shown only by a normal mirror on a road with poor visibility or at an intersection.

  In one embodiment of the present invention, for example, a camera that generates image information by imaging, a distance measurement unit that acquires distance information from the target object, image information generated by the camera, and the distance measurement unit A processing unit that acquires position information of the target object based on the distance information, an image conversion unit that converts the image information generated by the camera to match the display state, and a target object acquired by the processing unit. A coordinate conversion processing unit that performs coordinate conversion processing of position information, and a display unit, the display unit displays an image converted by the image conversion unit, and further, based on the position information converted by the coordinate conversion processing unit The additional information about the target object in the image is displayed.

  According to the present invention, it is possible to improve the recognition of an object.

It is explanatory drawing which showed an example of the structure of the traffic information notification apparatus. It is explanatory drawing which showed an example of the installation state of a traffic information notification apparatus. It is explanatory drawing which showed an example of the structure of the traffic information notification apparatus. It is explanatory drawing which showed an example of the installation state of a traffic information notification apparatus. It is explanatory drawing which showed an example of the structure of the traffic information notification apparatus. It is explanatory drawing which showed an example of the installation state of a traffic information notification apparatus.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a configuration diagram of a traffic information notification device according to the first embodiment of the present invention. Reference numeral 11 denotes a camera that acquires surrounding video information. In order to acquire a wide range of video information, a fisheye lens or the like may be attached. The distance measuring device 21 acquires a distance from an object. For example, a millimeter wave radar. The recognition processing unit 31 recognizes an object from video information from the camera 11 and distance information from the distance measuring device 21. Information such as the type, size, and position of the object is acquired from the image and its coordinates in the video information, its change, and distance information, and output.

  The image conversion processing unit 41 performs image conversion according to the arrangement of the display device 71. For example, when the traffic information notification device according to the first embodiment of the present invention is arranged in the arrangement as shown in FIG. 2, the arrangement of the camera and the arrangement of the display device are not in the same direction, and the display device The camera 11 obtains video information different from the case where a normal mirror is installed at the position. The image conversion process is performed so that the image becomes the same as when the mirror is installed. Further, when the camera 11 is equipped with a fisheye lens or the like for wide-area photography, image conversion, clipping processing, and the like are performed based on the influence.

  The coordinate conversion processing unit 51 performs a coordinate conversion process on the target according to the arrangement of the display device 71 and outputs the target object together with information about the target object, as is the case with the image processing unit 41.

  In the marker overlay processing unit 61, a rectangle that emphasizes the target object based on the coordinate information of the target object input from the coordinate conversion processing unit 51 on the converted video information input from the image conversion processing unit 41. Overlay images and output.

  The display device 71 displays an image from the marker overlay processing unit. By using a display device using a self-light emitting element such as a display device 71 in which light emitting diode elements are arranged, a plasma display, or the like, visibility can be improved even in an environment under external light.

  The traffic information notification apparatus according to the second embodiment of the present invention will be described with reference to FIG. In this embodiment, the information can be provided to both roads with poor visibility as shown in FIG. The same can be achieved by using two sets of the traffic information notification device according to the first embodiment, but the configuration described in the present embodiment has some further advantages as described below.

  The camera 12 is equipped with a fish-eye lens or the like that can photograph a wide range of a road with poor visibility, and outputs acquired video information. Further, when a problem occurs in the apparatus, the apparatus can output status information. Compared with the case where two sets of traffic information notification devices according to the first embodiment are used, the number of cameras can be reduced, and the cost can be reduced.

  The distance measuring devices 22 and 23 are for acquiring the distance to the object as in the first embodiment. The distance measuring device 22 is used to acquire distance information of an object on a vertical road, and the distance measuring device 23 is used to acquire distance information of an object on a horizontal road. Further, like the camera 12, each has a function of outputting its own state information.

  The recognition processing unit 32 uses the image information from the camera 12 and the distance information from the distance measuring devices 22 and 23 to acquire the object information as in the first embodiment. The information includes information about whether the object is approaching, stopping, or moving away, and its speed. The detected information is output to the coordinate conversion processing unit 52 and the control device 81. Further, when information such as a destructive action is recognized from the video information for the entire apparatus of this embodiment, the information is also output to the control device 81. Further, when information such as the occurrence of a traffic accident is recognized from the video information, the information is output to the control device 81.

  Similar to the first embodiment, the image conversion processing units 41 and 42 perform image conversion processing in accordance with the display device. The image conversion processing unit 41 performs image conversion processing for the display device 72, and the image conversion processing unit 42 performs image conversion processing for the display device 73.

  The coordinate conversion processing unit 52 performs coordinate conversion processing of the target object. The difference from the first embodiment is that since there are two display devices 72 and 73, information corresponding to each arrangement is output.

  Similar to the first embodiment, the marker overlay processing units 61 and 62 superimpose a display for emphasizing the target object on the video information and output the superimposed information to the display devices 72 and 73.

  The display devices 72 and 73 display the video information from the marker overlay processing units 61 and 62 as in the first embodiment. Further, it has a function of outputting its own status information to the control device 81. In particular, it has a function of outputting information when the panel of the display device is damaged. Further, the display devices 72 and 73 have a function of stopping display. This has an advantage that power consumption can be suppressed. This function can be enabled (stop display) when there is no target object looking at the display device in the recognition processing unit, or when there is no problem even if the display device is turned off. For example, from the information of the camera 11 and the distance measuring device 22, when the target object does not exist on the road on the vertical side, or is away from the target road, the display device 73 is not seen. The display can be stopped, the display can be stopped by a signal from the control device 81, and the power consumption can be reduced. Further, from the information of the camera 11 and the distance measuring devices 22 and 23, when there is no target object on either road, it is possible to stop the display on both the display devices 72 and 73.

  Similarly, when there is no target object on either road, the image information processing unit 91 can stop the operation and save power in response to an instruction from the control device 81. When there is a target object that may be viewing the display device 72 or 73 on only one road, the operations of the image conversion processing unit 41 or 42 and the marker overlay processing unit 61 or 62 are performed. It is also possible to output a signal from the control device 81 to the image information processing unit 91 so as to stop the process.

  The recording apparatus 101 is an apparatus capable of recording image information that enters from the camera 11. All image information may be stored. Further, a part is overwritten every certain period in the ring buffer shape, and a part is specified by an instruction from the control device 81 (including a copy from past image information existing on the ring buffer). It may be composed of an area capable of holding image information for a certain range of time. The recording of these pieces of image information is necessary because, as described in the description of the control device 81, the previous information is necessary when an accident or the like occurs. When data is arranged in the form of a ring buffer and the controller 81 detects the occurrence of an accident or the like, the data including the past is copied from the ring buffer to an area that can hold image information for a certain range of time. By doing so, necessary information before and after the occurrence of an accident can be retained without being erased. Further, the recording apparatus 101 is configured to be able to output image information to the communication apparatus 111 as necessary.

  The communication device 111 is a communication device that enables data exchange with the outside. By transmitting image information input from the recording apparatus 101 from the communication apparatus 111, information can be monitored in a remote place (for example, a traffic monitoring center). In addition, by transmitting information input from the control device 81 via a communication device, it becomes possible to communicate the status of the entire device to a remote location, and information such as the occurrence of an accident or the like, It is also possible to transmit information such as a destructive action being performed, and an instruction is sent from the remote place to the control device 81 via the communication device 111 so as to transmit the image information before and after the information. It becomes possible to send information. Further, there is an advantage that it is possible to issue a command for controlling the display device 72 or 73 to continue to be displayed by explicitly stopping the power saving function in the control device 81 via the communication device 111 from a remote place.

  In this embodiment, the display device has two configurations in the case of a road with poor visibility, but this is not particular, and the number of distance measuring devices, image conversion processing units, marker overlay processing units, and display devices is the same. By changing, for example, it is possible to have a configuration of four display devices on a T-junction.

  A traffic information notification apparatus according to Embodiment 3 of the present invention will be described with reference to FIG. In this embodiment, as shown in FIG. 6, the information can be provided to an information terminal existing near a road with poor visibility.

  The camera 12, the distance measuring devices 22, 23, the recognition processing unit 32, the recording device 101, and the communication device 111 operate in the same manner as in the second embodiment.

  In the image conversion processing 41 and 42, the video information from the camera 12 is matched with the position information of the information terminal 131 given from the information transmission apparatus 121 via the control apparatus 82 and the angle of view requested by the information terminal 131. Convert to image and output.

  In the coordinate conversion processing unit 53, the information terminal 131 obtains the position information of the target object obtained in the recognition process 32 based on the position information of the information terminal 131 given from the information transmission device 121 via the control device 82. Convert to the required format and output. If the position information of the information terminal 131 can be recognized as the target object recognized in the recognition process 32, the position information from the recognition process 32 may be corrected.

  The information transmission apparatus 121 receives the image information from the image conversion processing units 41 and 42 and the position information from the sitting conversion processing unit 53 and outputs the information to the information terminal 131. The information terminal 131 receives the position information, the angle of view information of the requested image, and the format information of the requested position information.

  The control device 82 operates in substantially the same manner as in the second embodiment, but since there is no display device, there is no power saving process for the display device. However, when there is no target object recognized by the recognition processing unit 32 and there is no information request from the information terminal from the information transmission apparatus 121, the operation of the conversion processing unit 92 is stopped to save power. It is possible to do.

  In this embodiment, the number of compatible information terminals is up to two, but it is possible to increase the number of compatible information terminals by changing the number of image conversion processing units. However, the present invention is applicable to roads of other shapes such as T-shaped roads.

  The traffic information notification device in these embodiments described above may be configured as follows.

  For example, a target object based on a camera that generates image information by imaging, a distance measurement unit that acquires distance information from the target object, image information generated by the camera, and distance information acquired by the distance measurement unit A processing unit that acquires the position information of the camera, an image conversion unit that converts the image information generated by the camera to match the display state, and coordinates that perform coordinate conversion processing of the position information of the target object acquired by the processing unit A conversion processing unit; and a display unit, wherein the display unit displays the image converted by the image conversion unit, and further on the target object in the image based on the position information converted by the coordinate conversion processing unit. The additional information may be displayed.

  Further, for example, in the traffic information notification device described above, the display of the display unit can be stopped based on image information generated by the camera and information acquired by the distance measuring device. Also good.

  Further, for example, based on a camera that generates image information by imaging, a distance measurement unit that acquires distance information from a target object, image information generated by the camera, and distance information acquired by the distance measurement unit. A processing unit that acquires position information of the target object, an image conversion unit that converts image information generated by the camera, a coordinate conversion processing unit that performs coordinate conversion processing of the position information of the target object acquired by the processing unit, An output unit may be provided, and the output unit may be configured to output the image converted by the image conversion unit or the position information converted by the coordinate conversion processing unit.

  Further, for example, in the above-described traffic information notification device, the camera may be configured to be a camera equipped with a wide-angle lens capable of photographing a wide area.

  Further, for example, in the above-described traffic information notification device, the distance measuring device may be configured to be a distance measuring device using a millimeter wave radar.

  Further, for example, in the above-described traffic information notification device, the display unit may be configured to use a self-luminous element.

  Further, for example, the above-described traffic information notification device may be configured to have a storage unit capable of holding past image information.

  In addition, for example, in the above-described traffic information notification device, information on the state of the traffic information notification device (for example, information on failure of the traffic information notification device or information on destruction of the traffic information notification device can be exemplified). You may comprise so that it may have a communication part which can transmit outside.

  Further, for example, the above-described traffic information notification device may be configured to include a communication unit that enables control of the traffic information notification device from a remote place.

11, 12 Camera 21, 22, 23 Distance measuring device 31, 32 Recognition processing unit 41, 42 Image conversion processing unit 51, 52, 53 Coordinate conversion processing unit 61, 62 Marker overlay processing unit 71, 72 Display device 81, 82 Control Device 91 Image information processing unit 92 Conversion processing unit 101 Recording device 111 Communication device 121 Information transmission device 131 Information terminal

Claims (10)

A camera that generates image information by imaging;
A distance measuring unit that obtains distance information from the target object;
A processing unit that acquires position information of a target object based on image information generated by the camera and distance information acquired by the ranging unit;
An image conversion unit that converts the image information generated by the camera to match the display state;
A coordinate transformation processing unit that performs coordinate transformation processing of the position information of the target object acquired by the processing unit;
And a display unit,
The image conversion unit acquires position information of the display unit and angle of view information of the image requested by the display unit, and converts the image information generated by the camera into an image that matches the angle of view requested by the display unit. Perform the conversion process,
The display unit displays the image converted by the image conversion unit,
Furthermore, based on the position information converted by the coordinate conversion processing unit, additional information about the target object in the converted image is displayed. In the traffic information notification device according to claim 1,
The display unit displays the image converted by the image conversion unit, and further superimposes a rectangular image that emphasizes the target object in the converted image based on the position information converted by the coordinate conversion processing unit. A traffic information notification device characterized by displaying . In the traffic information notification device according to claim 1 or 2,
A traffic information notification device characterized in that the display of the display unit can be stopped based on image information generated by the camera and information acquired by a distance measuring device. In the traffic information notification device according to any one of claims 1 to 3,
The traffic information notification device , wherein the camera is a camera equipped with a wide-angle lens capable of photographing a wide area . In the traffic information notification device according to any one of claims 1 to 4,
A traffic information notifying device, wherein the distance measuring device is a distance measuring device using a millimeter wave radar . In the traffic information notification device according to any one of claims 1 to 5,
The traffic information notification device, wherein the display unit uses a self-luminous element . In the traffic information notification device according to any one of claims 1 to 6,
A traffic information notification device having a storage unit capable of holding past image information . In the traffic information notification device according to any one of claims 1 to 7,
A traffic information notification device comprising a communication unit capable of transmitting information on a state of the traffic information notification device to the outside . The traffic information notification device according to claim 8 ,
The information on the state of the traffic information notification device includes failure information on the traffic information notification device or information on destruction of the traffic information notification device. In the traffic information notification device according to any one of claims 1 to 9,
A traffic information notification device comprising a communication unit that enables control of the traffic information notification device from a remote location .

Images