JP4048292B2 - Traffic information display system, captured image transmission device, in-vehicle information display device and storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a traffic information display system capable of confirming in advance an in-vehicle monitor an image showing a road condition such as a destination or a candidate for passing when driving a vehicle to a destination. The present invention relates to a traffic information display system in which a relationship with a planned travel direction can be easily grasped on a monitor screen, and a storage medium storing the traffic information display processing program.
[0002]
[Prior art]
For example, Japanese Patent Laid-Open No. 9-180087 proposes a traffic information display system that transmits an image captured by a camera installed in a remote place and displays the image on a vehicle-mounted monitor. In this conventional traffic information display system, when a user designates a passage candidate point or the like in order to grasp in advance the road condition of a destination or a passage candidate point, a captured image at the designated passage candidate point from the vehicle to the base station The signal which requests is transmitted by radio.
[0003]
The base station always receives captured images transmitted from various monitoring stations such as intersections where cameras are installed in advance, and when a captured image of a designated passing candidate point is requested from a vehicle, A captured image is taken out and transmitted to the vehicle. The vehicle that has received the captured image displays the captured image on the in-vehicle monitor, so that the user can confirm in advance the road condition of the planned passage candidate point with a video.
[0004]
FIG. 45 is a block diagram of the traffic information display system according to the above-described prior art. This traffic information display system includes an imaging device 107 installed at a monitoring station such as an intersection, a base station 108 that receives a captured image transmitted from each monitoring station, and a candidate for passing through the base station 108. A vehicle-mounted information display device 100 that requests a captured image of a point or the like and receives the captured image transmitted from the base station 108.
[0005]
The information display device 100 includes a map information database 104 storing map information used in a car navigation system, a GPS (global positioning system) 106 for acquiring the position of the host vehicle, and an instruction input for inputting an instruction from a driver or the like. Means 102, display means (monitor screen) 101, wireless transmission / reception means 105 for transmitting / receiving signals to / from base station 108, and image synthesis for performing overall image synthesis and image synthesis to display on display means 101 And a control means 103.
[0006]
FIG. 46 is a conceptual explanatory diagram of a conventional traffic information display system. A monitoring camera (imaging device) 107 is attached to each traffic signal installed at an intersection or the like, and the base station 108 receives captured images that are captured and transmitted in real time by each imaging device 107. . When the information display device 100 mounted on the vehicle 1 requests the base station 108 for a video of a candidate passage location, a captured image (request image) of the candidate passage point is transmitted from the base station 108, and the information display device 100 displays the captured image on the monitor screen.
[0007]
FIG. 47 is an explanatory diagram when a captured image is requested from the base station. The driver 2 displays map information used in the car navigation system on the screen 101a of the display means 101. This map displays the current position (starting point) calculated by the GPS 106 to the destination (destination point) A, and includes two candidate routes 10 and 11, and candidate passing points B and C on the route 10. And a passing candidate point D on the route 11 are displayed. The driver 2 looks at this map, for example, and designates, for example, the passage candidate point C with the instruction input means 102 (see FIG. 45).
[0008]
FIG. 48 is an explanatory diagram when the captured image transmitted from the base station 108 is displayed on the in-vehicle monitor. When the in-vehicle information display device 100 receives the captured image, the captured image is displayed on the display unit 101, and the driver 2 grasps the congestion status of the passage candidate point C by viewing the captured image 101b. As a result, the driver 2 can appropriately select the routes 10 and 11.
[0009]
[Problems to be solved by the invention]
However, in the conventional traffic information display system, there is a problem that it is difficult to understand the relationship with the own vehicle only by the captured image at the passing candidate point displayed on the in-vehicle monitor. This problem will be described with reference to FIGS.
[0010]
FIG. 49 is a diagram illustrating an imaging device installation state at the passage candidate point C. Passing candidate point C is a crossroad, and it is assumed that four imaging devices 107a, 107b, 107c, and 107d are installed. A vehicle following the leading vehicle 3 in the opposite lane with respect to the planned traveling direction F of the own vehicle Suppose that there was a traffic jam.
[0011]
50 (a), (b), (c), and (d) are captured images of the respective imaging devices 107a, 107b, 107c, and 107d, and traffic jams occur due to the different imaging directions of the imaging devices 107a, 107b, 107c, and 107d. The position where the image 3a of the first vehicle 3 can be seen is different.
[0012]
The information that the driver wants to know is which direction on the captured image the traveling direction F of the host vehicle in FIG. 49 is and the positional relationship between the direction and the traffic jam vehicle 3. However, even if the captured images of FIGS. 50 (a), (b), (c), and (d) are sequentially transmitted from the base station 108, none of the captured images includes information that the driver wants to know. Judgment of whether there is traffic jam in the same direction as the passing direction of the own vehicle, whether the traffic jam occurs only on the opposite lane, or whether the traffic jam occurs on the route intersecting with the passing direction of the own vehicle Can not.
[0013]
The above-described prior art describes that an arrow indicating a course direction is displayed on a captured image. The above problem can be solved if an arrow indicating the passing direction of the host vehicle is combined and displayed on the captured image illustrated in FIG. 50, but what specific means can be used to determine the direction of the arrow to be combined and displayed? If the above is not solved, the above problem cannot be solved.
[0014]
An object of the present invention is to provide a traffic information display system capable of combining and displaying information indicating the passing direction of the host vehicle on a captured image transmitted from a base station or the like, a captured image transmission device, and an in-vehicle information display device, Another object of the present invention is to provide a storage medium storing the traffic information display processing program.
[0015]
[Means for Solving the Problems]
The traffic information display system that achieves the above-described object provides an image pickup that transmits camera parameters of the image pickup device together with the picked-up image when a picked-up image of the selected point is requested among the picked-up images by the image pickup device installed at each point. The route direction of the host vehicle in the captured image received from the image transmission device, the captured image transmitted from the captured image transmission device, and received from the map information of the selected point and the received camera parameter. And a vehicle-mounted information display device that synthesizes information indicating the course direction with the captured image and displays the synthesized image on a screen.
[0016]
With this configuration, the information display device can calculate and determine which direction in the captured image the course direction of the host vehicle known from the map information is based on the camera parameter. It is possible to combine and display with.
[0017]
Preferably, the information display device displays the map information displayed on the screen while changing the map information according to the movement of the viewpoint, and displays the captured image combined with the screen. With this configuration, the map information sequentially changes along the route on the map information, and the captured image is displayed at the end. Therefore, it becomes easy to grasp the congestion state of the road from the captured image.
[0018]
More preferably, the information display device is located directly behind the imaging device that has captured the captured image displayed on the screen from a position where the position of the viewpoint to be moved can be viewed over the entire map information displayed on the screen. And moving to the same position as the imaging device. With this configuration, since the movement of the viewpoint finally becomes the position of the imaging device, it is possible to more easily grasp from which direction of the selected point the captured image displayed on the screen is captured and which direction of its own path is. .
[0019]
More preferably, the information display device converts the captured image displayed on the screen into an image viewed from a virtual camera and displays the image on the screen. With this configuration, a distorted captured image that is difficult to see is displayed as an easy-to-view image.
[0020]
More preferably, the information display device finally changes the position of the viewpoint to the position of the imaging device, displays the captured image of the imaging device on the screen, and compositely displays information indicating the course direction. It is characterized by doing. With this configuration, it is possible to understand in what direction the actual captured image is finally displayed on the screen in order, and the captured image can be intuitively grasped.
[0021]
More preferably, the information display device has three-dimensional information as the map information. With this configuration, the map information is easy to see, and there is no sense of incongruity when the map information and the captured image are switched.
[0022]
More preferably, the information display device synthesizes and displays an imaging range of the imaging device that has captured the captured image when displaying map information on the screen. With this configuration, it is possible to know which range the imaging range is before the captured image is displayed on the screen, and it is easy to grasp when the captured image is displayed on the screen.
[0023]
More preferably, the captured image transmission device transmits time information indicating a shooting time of the captured image to be transmitted together, and the information display device is configured such that the captured image displayed on the screen is within a certain time from the current time. The captured image is displayed in color in the case of the above-mentioned data, and when the captured image is data of a predetermined time or longer, the saturation of the captured image is reduced and displayed. With this configuration, it is possible to reduce the frame rate of shooting by the imaging device, and to achieve power saving and cost reduction. Further, even when a past captured image is displayed, it can be intuitively recognized that the captured image is several minutes before.
[0024]
More preferably, the captured image transmission device also transmits the captured image and the camera parameter at points around the selected point in addition to the captured image and the camera parameter of the selected point, The information display device also displays the captured image of the surrounding points on the screen before displaying the captured image of the selected point on the screen. With this configuration, it is possible to grasp the surrounding congestion situation and use it as a reference for route selection.
[0025]
More preferably, the captured image transmission device transmits the captured image at a reduced resolution when transmitting the captured images of the imaging devices installed at a plurality of points together. With this configuration, a plurality of captured images can be transmitted without delaying the image data transmission speed.
[0026]
More preferably, the captured image transmission device is provided in a base station, and the base station collects captured images from the imaging device at each point and transmits the requested captured images to a request destination. With this configuration, unified management of captured images becomes possible.
[0027]
More preferably, the information display device displays the captured image as a monochrome image when displaying the captured image as a still image on the screen. When the transmission speed of image data is slow or the shooting frame rate of the imaging device is low, the captured image is displayed as a still image. In this case, by displaying the monochrome image, It is easy to identify whether the vehicle is stationary or the still image is stationary, and it is possible to avoid misidentifying the user.
[0028]
More preferably, the captured image transmission device is provided in each imaging device connected to the Internet, and the information display device requests the captured image from the corresponding imaging device via the Internet. . With this configuration, even when a failure occurs, it is possible to avoid an overall system down.
[0029]
The captured image transmission device that achieves the above object is a captured image transmission device that constitutes one of the traffic information display systems described above. Since the camera parameter is transmitted together with the captured image from this captured image transmission device, the in-vehicle information display device side can easily calculate the course direction of the host vehicle in the captured image together with the map information. Become.
[0030]
A vehicle-mounted information display device that achieves the above object is characterized in that it is an information display device that constitutes one of the traffic information display systems described above. Since this information display device calculates the course direction of the host vehicle in the captured image from the map information and the camera parameters, information indicating the course direction can be synthesized and displayed when the captured image is displayed on the screen.
[0031]
Preferably, in the above, there is provided means for selecting a point for requesting the captured image from points on the map information displayed on the screen. With this configuration, it is easy to select a point on the map information that requires a captured image.
[0032]
More preferably, the acquired accident and traffic jam information is synthesized and displayed on the map information displayed on the screen. This configuration makes it easier for the user to grasp the road conditions.
[0033]
More preferably, the means for selecting is configured to select a route on the map information and a point on the selected route with three types of inputs. With this configuration, the user's operation becomes easier.
[0034]
More preferably, the selecting means is configured to hold the previously selected information and start the next selection from the previous selection state. With this configuration, the number of user selection operations is further reduced.
[0035]
In the traffic information display system using the Internet, each of the captured image transmission devices includes means for granting access permission to the information display device that has requested the captured image using an access key for requesting access permission. And charging. With this configuration, the security of the system is improved, and charging is performed according to the usage frequency.
[0036]
The storage medium that achieves the above object stores the processing program that causes the in-vehicle electronic device including the display screen to operate as the information display device according to any one of the above-described information by causing the in-vehicle electronic device to read the processing program. It is characterized by that. With this configuration, for example, the hardware configuration of a car navigation system can be used.
[0037]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0038]
(First embodiment)
FIG. 1 is a configuration diagram of a traffic information display system according to the first embodiment of the present invention. In this traffic information display system, the imaging device 107 installed at each monitoring station such as an intersection, and the base station 108 that receives the captured image captured and transmitted by each imaging device 107 separately for each imaging device installation location. A camera parameter database 301 that is connected to the base station 108 and stores camera parameters, which will be described later, of the respective image capturing devices 107, and passage candidate points that are wirelessly communicated with the base station 108 and requested by a vehicle driver or the like And a vehicle-mounted information display device 100 that receives and displays the captured image from the base station 108. The camera parameter database 301 may be built in the base station 108.
[0039]
The information display device 100 includes a map information database 104 storing map information used in a car navigation system, a GPS (global positioning system) 106 for acquiring the position of the host vehicle, and an instruction input for inputting an instruction from a driver or the like. Means 102, display means (monitor screen) 101, wireless transmission / reception means 105 for transmitting / receiving signals to / from base station 108, and image synthesis for performing overall image synthesis and image synthesis to display on display means 101 And a control means 103.
[0040]
This information display device 100 is also used as a car navigation system. A program for performing traffic information display processing according to the present embodiment for the car navigation system is transferred from an external storage medium such as a CD-ROM or a DVD to an internal storage medium such as a built-in memory. By being read in, the car navigation system is operated as an in-vehicle device (information display device) of the traffic information display system.
[0041]
The information display device 100 shown in FIG. 1 according to the present embodiment is the same in configuration as the conventional information display device 100 described in FIG. However, as will be described later, the image composition control unit 103 of the information display apparatus 100 according to the present embodiment processes the camera parameter information sent together with the captured image from the base station 108 and converts the captured image into the captured image. The difference is that the function for synthesizing information such as an arrow indicating the passing direction is provided by the program.
[0042]
FIG. 2 is map information displayed on the monitor screen by the car navigation system described in FIG. The image composition control means 103 of the information display device 100 can know the passing direction F of the own vehicle on any of the routes 10 and 11 from the relationship between the starting point of the map information and the destination A.
[0043]
FIG. 3 is a diagram illustrating a camera (imaging device) installation state at the passage candidate point B illustrated in FIG. 2. One imaging device 107 is installed at the passage candidate point B. Camera parameters such as a shooting range (view angle) 307 and a shooting direction 308 of the imaging device 107 are stored in the database 301 provided in the base station 108, and the base station 108 receives information from the vehicle-mounted information display device 100. When a captured image of the passage candidate point B is requested, together with the captured image, the camera parameters of the imaging device 107 that captured the captured image are transmitted to the information display device 100 together.
[0044]
FIG. 4 is an explanatory diagram of an arrow F indicating a passing direction obtained from the map information of FIG. The image composition control unit 103 calculates the direction in which the direction of the arrow F indicating the passing direction in FIG. 2 is oriented in the captured image to be synthesized from the camera parameters of the imaging device 107, and also in the captured image The position 305 of the passing road is calculated.
[0045]
Then, as shown in FIG. 5, an arrow F is displayed at a position 305, and an image captured by the imaging device 107 of FIG. As a result, when the driver sees this composite image, it becomes clear at a glance which direction the passing direction of the host vehicle is in the captured image, and the positional relationship with the vehicle image 3a of the congested vehicle 3 shown in FIG. It can be easily grasped.
[0046]
FIG. 6A is an explanatory diagram of camera parameters of each imaging apparatus 107 stored in the database 301 of FIG. The camera parameters include three-degree-of-freedom data of a three-dimensional position (x, y, z) 306 indicating the world coordinate position of the imaging device 107, two-degree-of-freedom data indicating an angle and a shooting direction 308, and a rotation angle around the shooting direction. 3 includes external parameters having a total of 6 degrees of freedom of 1-degree-of-freedom data indicating 310, an angle of view 307 of the imaging device 107, lens distortion, and internal parameters such as a lens center axis 312 in the camera angle of view 311.
[0047]
By using this camera parameter, the image composition control means 103 can obtain the world coordinate position of each pixel of the captured image by calculation, and the route that the vehicle travels and the passing direction F of the road have the camera parameter. It is possible to determine where on the imaging screen of the image capturing apparatus 107 and which direction it is directed. Here, the lens distortion data is data indicating the angular relationship between the incident light 313 to the lens 302 and the incident light 314 from the lens 302 to the CCD, as shown in FIG. 6B.
[0048]
(Second Embodiment)
FIG. 7 is a configuration diagram of a traffic information display system according to the second embodiment of the present invention. Compared with the traffic information display system according to the first embodiment (see FIG. 1), the traffic information display system according to the present embodiment includes the viewpoint control means 401, and the image synthesis control means. The only difference is that the image is synthesized using an image converted by the viewpoint 103, and other configurations and operations are the same as those in the first embodiment. Hereinafter, the composite display of an image subjected to viewpoint conversion will be described.
[0049]
FIG. 8 is a diagram illustrating a state in which the driver 2 causes the display unit 101 to display map information in the present embodiment. In this state, the driver 2 designates an arbitrary point, for example, a candidate passage point C. The map information when this designation is made is a view of the map as viewed from directly above, as shown in the screen 101a of FIG.
[0050]
When the passing candidate point C is designated, this designation selection signal is notified from the instruction input means 102 to the viewpoint control means 401 via the image composition control means 103. Upon receiving this notification, the viewpoint control means 401 converts the map information displayed on the display means 101 into map information obtained by converting the viewpoint, for example, as shown in FIG. 9, converts the map into a bird's eye view seen obliquely from above, and displays the display means. 101 is displayed. A method for converting a map viewed from directly above into a bird's eye view has been widely known.
[0051]
Next, the viewpoint control means 401 receives the data of the selected point (passing candidate point C in this example) and brings the viewpoint closer to the point C, thereby displaying the display on the display means 101 as shown in FIG. The selected point C is displayed on the screen 101a so as to be gradually enlarged and displayed on the screen 101a. At the point in time when the image of FIG. 10 can be displayed, the information display device 100 receives the data of the camera parameters (such as the installation position and imaging range of the imaging device 107) of the imaging device 107 installed at the selected point C from the base station 108. Therefore, based on the camera parameter data, the computer graphic (CG) image 402 of the imaging device and the imaging range 403 on the map are combined in the display screen 101a of FIG. indicate. Further, the passage route on the route 10 is highlighted with a thick line or the like from other routes, and an arrow image F indicating the passage direction is also displayed.
[0052]
FIG. 11 is a diagram showing the display screen 101a of the display means 101 when the viewpoint approaches the point C. In this FIG. 11, compared with FIG. 10, the map of the point C is further enlarged and displayed. When the distance to the point C approaches the predetermined distance, the viewpoint control unit 401 turns the viewpoint closer to the back of the shooting direction of the imaging device 107 (CG 402 on the screen 101a) while further bringing the viewpoint closer to the point C. Make it. By this operation, the direction in which the map is synthesized and displayed can be brought closer to the shooting direction of the imaging device, and the change in the state of the screen 101a is shown in the order of the progress of this operation, as shown in FIGS. It is.
[0053]
Eventually, the viewpoint control unit 401 matches the viewpoint with the position of the imaging device 402, and also matches the direction in which the map is combined with the shooting direction of the imaging device 402. FIG. 15 shows the display screen 101a at that time. At this time, since the viewpoint coincides with the position of the imaging apparatus, the CG 402 of the imaging apparatus 107 that has been displayed is not displayed.
[0054]
After the screen of FIG. 15 is displayed, as shown in FIG. 16, the image of the arrow F indicating the passing direction of the host vehicle in FIG. 15 is combined with the captured image sent from the base station 108 and displayed on the display screen. indicate. In the switching of the display screen 101a of FIGS. 15 and 16, the display screen 101a of FIG. 15 is a combination of map information in accordance with the position and direction of the imaging device, whereas FIG. On the display screen 101a ′, the position of the road, the horizontal line, and the like remain substantially the same positional relationship as the display screen 101a of FIG. 15, so the driver takes an image based on the arrow image F indicating the passing direction of the vehicle. The image can be judged and the road condition can be accurately grasped.
[0055]
FIG. 17 is an explanatory diagram showing the relationship between the display control procedure of the viewpoint control means 401 according to the present embodiment and the input signals from the driver (user) and the base station 108. Initially, a point selection waiting state is entered, and a diagram (display screen 101a in FIG. 8) of the map viewed from directly above is displayed (step S41). When a point selection is input from the user, a bird's eye view (FIG. 9) is then displayed (step S42), and then the viewpoint is sequentially approached to the selected point (step S43). FIGS. 10 and 11 show the transition of the display screen at this time. At this time, the information display apparatus 100 receives the camera parameters of the imaging apparatus 107 installed at the point C from the base station 108. .
[0056]
Further, by performing the process of moving the viewpoint closer to the selected point and moving back to the imaging apparatus (step S44), the display screen transitions to FIGS. 12, 13, and 14, and the position of the viewpoint and the viewing direction are the position of the imaging apparatus. When the shooting direction matches (step S45), FIG. 15 is displayed. And when the captured image of the point C is received from the base station 108, the arrow F which shows a passing direction is synthesize | combined with this captured image, and it displays like FIG. 16 (step S46).
[0057]
Here, when the user selects another point, for example, the destination A, the process proceeds in the reverse direction to steps S46, S45, S44, S43, S42, and S41, and the display screen 101a of the display means 101 is also displayed. 16 to FIG. 15, 14, 13, 12, 11, 10, 9, and 8, the process returns to the original point selection waiting state. In this way, by reversing the movement of the viewpoint when returning to the initial state, the user can more easily understand the relationship between the viewpoint of the captured image and the shooting direction and the entire path that were viewed as they were. Can be made.
[0058]
Next, the imaging range 403 on the map will be described with reference to FIGS. 18 (a), (b), and (c). FIG. 18A shows the photographing apparatus 402, its photographing direction 404, and a rectangular photographing range (view angle) 405 that is a predetermined distance away from the photographing apparatus 402 in the photographing direction 404 and perpendicular to the photographing direction 404. ing. Further, four lines 406 connecting each of the four corners of the photographing range 405 and the photographing apparatus 402 are shown. The inside of the quadrangular pyramid cut by these four lines 406 is the imaging range of the imaging device 402.
[0059]
When these four lines 406 are extended until they reach the road surface, and the imaging range 405 is projected onto the road surface, this projection range becomes a region 407 shaded in FIG. This area 407 is a photographing range of the photographing apparatus 402. However, if the shooting range 407 is above the horizontal line, the shooting range 407 extends infinitely far in the direction of arrow E. In a range that is a predetermined distance away from the shooting range 407, it is difficult to obtain useful information about the traffic state from the captured image.
[0060]
Therefore, as shown in FIG. 18C, a trapezoidal area 403 generated by dividing the above-described area 407 by an upper limit line 408 that is separated from the imaging apparatus 402 by a predetermined distance t in the imaging direction is displayed on the map. And This is displayed on the screen as the photographing range 403 shown in FIGS. Instead of the shooting range 403, the above-described square pyramid itself may be displayed.
[0061]
According to the present embodiment described above, the positional relationship between the captured image and the information indicating the passing direction of the host vehicle is sequentially intuitively grasped by the transition screen, so that the relationship with the host vehicle can be easily recognized. Can do.
[0062]
(Third embodiment)
FIG. 19 is a configuration diagram of a traffic information display system according to the third embodiment of the present invention. Compared with the traffic information display system according to the second embodiment (see FIG. 7), the traffic information display system according to the present embodiment is configured such that the image composition control unit 103 of the information display device 100 has a texture mapping unit 509. The only difference is the addition of functional means that operates in accordance with the image composition processing program. Other configurations and operations are the same as those in the second embodiment. Hereinafter, image composition display by the texture mapping method will be described.
[0063]
FIG. 20 is an explanatory diagram of a texture mapping method that is an image composition method unique to the image composition control means 103 according to the third embodiment. The captured image transmitted from the base station 108 is an actual image captured by the camera 501, and when the actual camera 501 is installed, its installation position and installation direction are restricted and should be attached to an ideal position and direction. It is rare to be able to.
[0064]
As the actual camera 501 shown in FIG. 20, a wide-angle camera is usually used. When the subject 503 on the road surface 506 is imaged from diagonally above with the wide-angle camera, the captured image is as shown in FIG. Then, the subject image 503a is displayed on the distorted road surface image 506a. The image composition control unit 103 according to the present embodiment converts this captured image into an image captured by a virtual camera 504 arranged at an ideal position (for example, a position directly above the road surface 506) shown in FIG. As shown in FIG. 22, it is displayed on the screen 101a of the display means. In FIG. 22, the shaded portion is a portion that is not reflected in the actual camera 501.
[0065]
In this example, an image synthesis method is employed in which the road surface 506 is a model, the captured image is a texture, and the texture is mapped to the model. This image composition method is called a texture mapping method. Although the virtual camera is arranged directly above the road surface, the arrangement position of the virtual camera 504 is arbitrary, and an actual captured image can be combined with an image viewed from an arbitrary direction. In addition to the road surface, as shown in FIG. 23, texture mapping can be performed on a three-dimensional model including a road surface 506 and a wall 507 from an actual camera 501 up to a certain distance.
[0066]
FIG. 24 is a diagram showing respective ranges 510 and 511 for texture mapping on a three-dimensional model composed of a road surface 506 and a wall 507 from the imaging device 107 to a certain distance. In the third embodiment, a range 512 obtained by combining both the ranges 510 and 511 is displayed instead of the imaging range 403 in the second embodiment. When the captured image signal is sent from the base station 108, the captured image signal is immediately texture-mapped and displayed on the range 512.
[0067]
25, FIG. 26, FIG. 27, and FIG. 28 are diagrams showing the transition of the display screen according to the present embodiment corresponding to FIG. 13, FIG. 14, FIG. 15, and FIG. 16 of the second embodiment. The captured image is texture-mapped in a range 512 in the figure. In this embodiment, since the viewpoint (arrangement position of the virtual camera) and the shooting direction approach the actual imaging device 107 according to the transition of the display screen, the range 512 is reached as the processing proceeds to FIGS. 25, 26, and 27. The composite image displayed on the screen is displayed so as to approach the actual captured image.
[0068]
In the state of the display screen shown in FIG. 27, since the viewpoint and the shooting direction are the same as those of the imaging apparatus, the image synthesized by texture mapping is also substantially the same as the captured image itself. Finally, the display screen is switched from FIG. 27 to FIG. 28, and the image of the arrow F indicating the passage direction is combined with the captured image of the imaging device 107 and displayed. Since the content of the image displayed on the display screen shown in FIG. 28 is almost the same as the image content of the display screen shown in FIG. 27, the user can recognize these as almost continuous.
[0069]
As described above, in the present embodiment, the captured image transmitted from the base station is synthesized and converted into an image viewed from the virtual camera, texture mapped to the map data, and the virtual camera position is gradually brought closer to the actual camera position. Therefore, it becomes possible to accurately determine the road conditions such as the passage candidate points more than in the second embodiment.
[0070]
In the example described above, the display is finally switched from the texture-mapped composite image to the captured image of the imaging device, but it is not always necessary to switch. This is because the contents of the display screen shown in FIG. 27 and the contents of the display screen shown in FIG. 28 are almost the same.
[0071]
(Fourth embodiment)
FIG. 29 is a configuration diagram of a traffic information display system according to the fourth embodiment of the present invention. Compared with the traffic information display system according to the third embodiment (see FIG. 19), the traffic information display system according to the present embodiment is configured such that the image composition control unit 103 of the information display device 100 has a texture mapping unit 509. When the image composition method is used, the difference is that the three-dimensional information (3D information) 601 included in the map information database 104 is used, and other configurations and operations are the same. Hereinafter, use of the 3D information 601 will be described.
[0072]
FIG. 30 is a diagram illustrating a captured image captured by the imaging device. In the captured image, there are an image 603 showing a road surface and an image 602 showing a three-dimensional object (a vehicle in the illustrated example). When this captured image is combined with the image projected from the virtual camera directly above by the texture mapping method described in the third embodiment, the image shown in FIG. 31 is obtained. In FIG. 31, the road surface image 605 is an image of the road surface viewed from directly above, but the three-dimensional object image 604 is greatly distorted and synthesized. This is because a large positional shift occurs between the road surface model used for texture mapping and the three-dimensional object.
[0073]
Actually, since the imaging device for road monitoring is installed at a position higher than the vehicle, the vehicle is not distorted as much as shown in FIG. However, for buildings such as buildings, large distortion may occur.
[0074]
Therefore, in the fourth embodiment, the three-dimensional information 601 included in the map information is used as follows. FIG. 32 is a diagram showing the usage method. Here, the imaging range 512 configured by the road surface 510 and the wall 511 is the same as that of the third embodiment. In the present embodiment, a three-dimensional object (such as a building) 606 within the imaging range 512 is searched from the three-dimensional information 601 included in the map information database 104, and thereby the imaging range is corrected from the range 512 to the range 607. The The new imaging range 607 is also a model on which texture mapping is performed.
[0075]
In this way, for buildings such as buildings, the use of the three-dimensional information 601 included in the map information database 104 prevents a large positional deviation from the model and prevents a large distortion from occurring in the composite image as well. be able to. Other configurations and operations are the same as those of the third embodiment.
[0076]
In the third and fourth embodiments, the viewpoint is gradually changed from the entire map to the selected point, the image displayed on the screen is changed based on the viewpoint change, and finally the viewpoint and the shooting direction are changed. The position of the imaging device and the shooting direction are made to coincide with each other. For example, finally, an image that looks down from a position higher by a certain amount than the actual height of the imaging device may be synthesized. Further, an image that looks down on the selected point from directly above may be synthesized.
[0077]
In the third and fourth embodiments, the case where one imaging device is installed at the point C has been described, but two or more imaging devices may be installed. By using the image composition method by the texture mapping means, it is easy to synthesize each captured image of two or more imaging devices into one captured image. Even in this case, the viewpoint of the captured image to be displayed can be sequentially changed from the entire map to the selected point.
[0078]
(Fifth embodiment)
FIG. 33 is a configuration diagram of a traffic information display system according to the fifth embodiment of the present invention. Compared with the traffic information display system according to the first embodiment (see FIG. 1), the traffic information display system according to the present embodiment is configured so that the information display device 100 receives the signal received by the wireless transmission / reception means 105. It has a signal storage means 701 for storing, and the image composition control means 103 uses the stored data of the signal storage means 701 to perform image composition. Other configurations and operations are the same as those in the first embodiment. is there. This embodiment is particularly effective when the signal transmission speed between the base station 108 and the host vehicle is limited.
[0079]
The captured image of the imaging device is transmitted from the base station 108 to the vehicle wirelessly. When the signal transmission speed is sufficient, a real-time image (for example, an image of 30 frames per second) can be transmitted as a moving image. . However, if the signal transmission speed is not sufficient, real-time transmission of moving images is impossible.
[0080]
Therefore, in this embodiment, a real-time moving image is not transmitted to the vehicle, but a moving image with dropped frames is transmitted to the vehicle. This makes it possible to transmit a captured image necessary for the vehicle even at a low signal transmission speed. The signal accumulating unit 701 provided in the vehicle information display device 100, when reception of the first frame of the received moving image signal is completed, sends the image of the one frame as a still image to the image composition control unit 103. Output. If the input image is a still image, the image control unit 103 converts the input image into a black and white image, combines the arrow image F indicating the course direction, and the like, and then outputs it to the display unit 101.
[0081]
While the still image is displayed on the display unit 101, the signal storage unit 701 stores a moving image including a plurality of frames dropped by the wireless transmission / reception unit 105. Then, when the reception of the moving image is completed, the signal storage unit 701 outputs the moving image to the image composition control unit 103 while performing loop reproduction. When the input image is a moving image, the image control unit 103 synthesizes the arrow image F indicating the course direction and the like as a color image, and then outputs the synthesized image to the display unit 101.
[0082]
With such a configuration, first, after selecting a point, the user can view the state of the selected point with the shortest delay time although it is a still image. By displaying the still image in black and white, it is possible to recognize without confusion whether the vehicle in the image is stopped due to traffic congestion or whether the vehicle in the image is stopped due to the still image. In addition, it is possible to know the traffic flow at the selected point while holding down the communication fee by loop display of moving images. Note that this embodiment can be used in combination with the other embodiments described above.
[0083]
(Sixth embodiment)
FIG. 34 is a configuration diagram of a traffic information display system according to the sixth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (FIG. 1) only in that a signal storage unit 801 is provided in the base station 108. Other configurations and operations are the same as those in the first embodiment.
[0084]
This embodiment is used when the signal transmission between the imaging device 107 and the base station 108 installed at each point requires a cost corresponding to the transmission amount or when the power consumption of the imaging device 107 is saved. Is valid.
[0085]
The image capturing apparatus 107 according to the present embodiment has a predetermined time (for example, 30 minutes) every time set for each point (for example, every 30 minutes at a point where the traffic volume is low and every 10 minutes when the traffic volume is a little). The captured moving image is transmitted to the base station 108, and the base station 108 stores the moving image received from the imaging device 107 in the signal storage unit 801 together with the shooting time data.
[0086]
When the base station 108 receives a request signal for a captured image from the vehicle side, the base station 108 reads out the captured image at the selected point from the signal storage unit 801 and transmits it to the vehicle side together with the shooting time data. The image control means 103 of the information display means 100 mounted on the vehicle, when the inputted shooting time data is older than the present time by a certain time or more, makes this a black and white image and combines an arrow image or the like indicating the course direction. After that, it is output to the display means 101 together with the photographing time.
[0087]
Also, if the input shooting time data is not older than the current time by a certain time (threshold time set in the information display device 100) or more, the received captured image remains as a color image and an arrow image indicating the course direction, etc. Are output to the display means 101 together with the photographing time.
[0088]
As described above, according to the present embodiment, it is possible to save a communication fee between the base station 108 and the imaging device 107 and to reduce power consumption. In addition, by displaying the old image in black and white, the user can immediately recognize that the display image is an old image. A configuration may be adopted in which, when the captured image is old, the image is not uniformly converted into a black and white image, but an image with reduced saturation according to the age of the image is displayed. Note that this embodiment can be used in combination with the other embodiments described above.
[0089]
(Seventh embodiment)
Next, a traffic information display system according to a seventh embodiment of the present invention will be described. The device configuration of the traffic information display system according to the present embodiment is the same as that of the third embodiment (see FIG. 19), and the basic operation for displaying the picked-up image of the selected point is also the same. In the form, for example, when a captured image of a selected point C is displayed, a captured image of a point B in the middle before the viewpoint reaches the point C is also displayed.
[0090]
That is, in the present embodiment, after the bird's eye view of FIG. 35 which is the same as FIG. 9 is displayed, when the selected point C is zoomed up (enlarged display) as shown in FIG. The captured image of the imaging device installed in the periphery, in this example, the point B before the selected point C, and its camera parameters are also taken on the vehicle side simultaneously with the captured image of the imaging device installed in the selected point C and its camera parameters. Sent to.
[0091]
Upon receiving these signals, the vehicle-mounted information display device 100 generates a composite image for each of the selected point C and the point B existing around the selected point C and displays it on the display unit 101. That is, the CG image 402 (B) of the imaging device installed at the point B is displayed and the captured image of the point B is synthesized and displayed in the imaging range 512 (B) by texture mapping, and the CG of the imaging device installed at the selected point C is displayed. The image 402 (C) is displayed and the captured image of the selected point C is synthesized and displayed in the imaging range 512 (C) by texture mapping.
[0092]
Next, as shown in FIG. 37, when the viewpoint approaches the selected spot C and the selected spot C is enlarged and displayed, the base station 108 transmits a captured image of only the selected spot C, and the vehicle side selects the selected spot C. The captured image is synthesized and displayed in the imaging range 512 (C) of the point C by texture mapping. The subsequent operation and screen display are the same as those in the third embodiment.
[0093]
FIG. 38 is an explanatory diagram when the base station 108 transmits captured images of the selected point C and the peripheral point B to the requesting vehicle. When transmitting captured images of a plurality of points to the vehicle, as shown in the upper part of FIG. 38, the image data is transmitted with reduced resolution, and when only the captured images of only the target point are transmitted to the vehicle, As shown in the lower part of FIG. 38, image data with high resolution is transmitted. As a result, it is possible to suppress the data transmission speed when transmitting a plurality of captured images.
[0094]
According to the present embodiment, after the point is selected, the image of the surrounding point is also displayed until the image of the selected point is enlarged, so that the user knows not only the selected point but also the surroundings. be able to. For this reason, the traffic state of the candidate route can be known in more detail, and the route selection can be appropriately determined.
[0095]
In addition, when the base station 108 transmits captured images from a plurality of points to the vehicle side, a low-resolution image is transmitted, and when a captured image of only the selected point is transmitted, a high-resolution image is transmitted. Thus, the data transmission speed required for communication can be kept below a certain level. At the time when the captured images from a plurality of points are displayed on the display unit 101, the captured images at the respective points are displayed in a small size. Therefore, even in a low-resolution image, deterioration in image quality can be suppressed on the display image. Note that this embodiment can be used in combination with the third, fourth, fifth, and sixth embodiments described above.
[0096]
(Eighth embodiment)
FIG. 39 is a configuration diagram of a traffic information display system according to the eighth embodiment of the present invention. Compared with the traffic information display system (FIG. 1) according to the first embodiment, the base station 108 acquires the accident / congestion information 1003 in the traffic information display system according to the present embodiment. The difference is that information is transmitted to the vehicle side and displayed on the display means 101 of the information display device 100, and other configurations and operations are the same as those in the first embodiment.
[0097]
FIG. 40 is a diagram showing a situation when the user (driver) 2 first selects a point where he / she wants to check road information, and the display screen 101a shows destinations and candidate passage points (A, B, C). , D) are displayed together with the map information. At this time, the base station 108 collects accident / congestion information 1003, and the accident / congestion information 1003 is transmitted to the vehicle. In the information display apparatus 100 that has received the accident / traffic congestion information 1003, as shown in FIG. 40, an image indicating an accident (a square image in the illustrated example) 1001 and an image indicating a traffic jam (illustrated) on the candidate routes 10 and 11. In this example, a circle image) 1002 is synthesized and displayed on the map information.
[0098]
While looking at this display screen 101, the driver 2 selects a point in the route 10 or 11 where traffic is congested or a part that is likely to be affected by an accident, and the situation at each point. To the base station 108, and the traffic situation can be accurately grasped. Note that this embodiment can be used in combination with the above-described embodiments.
[0099]
(Ninth embodiment)
FIG. 41 is a configuration diagram of a traffic information display system according to the ninth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (FIG. 1) in that the instruction input unit 102 of the information display device 100 includes a point selection unit 1100. However, other configurations and operations are the same as those in the first embodiment.
[0100]
FIG. 42 is a front view of the display means 101 according to the present embodiment. On the display screen 101a of the display means 101, destinations and passage candidate points (A, B, C, D, E) are displayed together with the map information. Next to the display screen 101a, the point selection means 1100, that is, a button 1101, 1102, 1103, and 1104 are provided. The button 1101 means “forward”, the button 1102 means “return”, the button 1103 means “decision”, and the button 1104 means “cancel”.
[0101]
FIG. 43 is an explanatory diagram showing how a specific point is selected using these buttons 1101, 1102, 1103, 1104. Now, as shown in the selection state (a) of FIG. 43, it is assumed that the route of the point B-C-A is selected as the route, and this route is blinking on the display screen 101 of FIG. Further, as another route, it is assumed that there are two options of a point D-C-A and a point D-E-A. When the driver wants to select another route, the driver can advance the selected portion in the direction of arrow a every time the button 1101 is pressed, and can return the selected portion in the direction of arrow b every time the button 1102 is pressed. In response to this selection, the corresponding route on the display screen 101a of FIG.
[0102]
After selecting the route, the button 1103 is pressed to “decide”. As a result, as shown by an arrow c in FIG. If it is desired to return to the selection state a where the route is selected from the selection state B, the button 1104 is pressed to input “Cancel”. As a result, as shown by the arrow d in FIG. 43, the selection state B returns to the selection state A.
[0103]
In the selection state b, the point where the captured image is to be displayed is selected. There are three points B, C, and A as points for displaying a captured image in a state where the route B-C-A is selected, and they are arranged in order from the starting point. Any one of these three points is selected using a “forward” button 1101 and a “return” button 1102. The selected point is displayed blinking on the display screen 101a of FIG. If the selected point is correct, the “OK” button 1103 is pressed to change to the state C as shown by the arrow c. In this state C, the sentence “Are you sure you want to confirm C?” Is displayed on the display screen 101a in an overlapping manner. When another point is selected, the “cancel” button 1103 is pressed to return to the selection state b as shown by the arrow d. After performing the point selection, when the user presses the “OK” button 1103 to confirm the selected point, the state transitions to the state D as indicated by the arrow c, and the point selection is completed.
[0104]
The operation after the point is selected is the same as that in the first embodiment. In this way, even if there are multiple passing candidate points on the map, the user can easily select a point by operating the four buttons “forward”, “back”, “decision”, and “cancel”. The base station 108 can be requested for a captured image at that point. Since the “cancel” button is not necessarily required, at least three buttons of “forward”, “return”, and “decision” may be provided. This embodiment can be used in combination with each of the embodiments described above.
[0105]
In addition, the selected route and point are stored as initial values even after the selection is completed, and the selection state is restored to the initial value when another point is subsequently selected. As shown in FIG. 4, when the point A is selected next with respect to the initial selected point C, the point A can be selected by pressing the “forward” button 1101 once. As described above, the number of operations of the three buttons “forward”, “return”, and “decision” can be minimized by always storing the previous selection state as the initial value.
[0106]
(Tenth embodiment)
FIG. 44 is a configuration diagram of a traffic information display system according to the tenth embodiment of the present invention. In the traffic information display system according to the present embodiment, an imaging device 107 installed at each point, an accident / congestion information source 1003, and an imaging device search site 1203 are interconnected via the Internet 1201 without having a base station. The in-vehicle information display device 100 is connected to the Internet 1201.
[0107]
The in-vehicle information display device 100 includes wireless transmission / reception means 105 and 1202, and is connected to the Internet 1201 through these. As the wireless transmission / reception means 105 and 1202, multiple types of communication means such as a mobile phone, a personal handyphone system (PHS), and a beacon can be used. The image composition control unit 103 connects to the imaging device search site 1203 via the Internet 1201 and receives the location of the nearby imaging device 107 on the map and the address on the network.
[0108]
When the user selects an imaging device at a location where the road condition is to be confirmed from among the imaging devices present in the vicinity, the image composition control unit 103 is then connected to the imaging device 107 via the Internet 1201 and the imaging is performed. A captured image of the apparatus and camera parameters are received. At this time, that is, when connecting to the imaging device 107, the image composition control unit 103 has a vehicle-specific access key 1207, and the imaging device 107 gives an access permission 1206 according to this access key 1207. The access key 1207 is charged according to the transmitted captured image.
[0109]
As described above, by adopting a configuration that does not have a base station, even if a local system failure occurs, the entire system does not go down, and a traffic information display system system with a high operating rate can be realized. .
[0110]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, the information which shows the advancing direction of the own vehicle correctly on a picked-up image sent from a base station etc. can be combined and displayed, and it can make a user grasp | ascertain a road condition correctly. It becomes possible to provide a traffic information display system.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a traffic information display system according to a first embodiment of the present invention.
FIG. 2 is a diagram showing map information displayed on the display means of the traffic information display system according to the first embodiment of the present invention.
FIG. 3 is a diagram showing an example of an installation state of the imaging device in the traffic information display system according to the first embodiment of the present invention.
FIG. 4 is an explanatory diagram of the direction and position of an arrow image indicating a traveling direction determined from camera parameters in the traffic information display system according to the first embodiment of the invention.
FIG. 5 is a diagram showing a display example of a captured image in the traffic information display system according to the first embodiment of the present invention.
FIG. 6 is an explanatory diagram of camera parameters in the traffic information display system according to the first embodiment of the present invention.
FIG. 7 is a configuration diagram of a traffic information display system according to a second embodiment of the present invention.
FIG. 8 is a diagram showing a point selection situation in the traffic information display system according to the second embodiment of the present invention;
FIG. 9 is a diagram showing a map as a bird's-eye view in the traffic information display system according to the second embodiment of the present invention;
FIG. 10 is a diagram showing a process of enlarging and displaying a selected point from the display state of FIG. 9 in the traffic information display system according to the second embodiment of the present invention.
11 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 10 in the traffic information display system according to the second embodiment of the present invention.
12 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 11 in the traffic information display system according to the second embodiment of the present invention.
13 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 12 in the traffic information display system according to the second embodiment of the present invention.
FIG. 14 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 13 in the traffic information display system according to the second embodiment of the present invention.
15 is an enlarged view of a selected point from the display state of FIG. 14 in the traffic information display system according to the second embodiment of the present invention.
FIG. 16 is a diagram of switching from the display state of FIG. 15 to a captured image display screen in the traffic information display system according to the second embodiment of the present invention;
FIG. 17 is a diagram showing a screen display transition procedure in the traffic information display system according to the second embodiment of the present invention;
FIG. 18 is an explanatory diagram of an imaging range in the traffic information display system according to the second embodiment of the present invention.
FIG. 19 is a configuration diagram of a traffic information display system according to a third embodiment of the present invention.
FIG. 20 is an explanatory diagram of an arrangement of an actual imaging device and a virtual camera in the traffic information display system according to the third embodiment of the present invention.
FIG. 21 is a diagram illustrating a captured image of an actual imaging device in the traffic information display system according to the third embodiment of the invention.
FIG. 22 is a diagram illustrating an example in which a captured image of an actual imaging device in a traffic information display system according to a third embodiment of the present invention is combined with an image viewed from a virtual camera position.
FIG. 23 is an explanatory diagram of a three-dimensional model of texture mapping in the traffic information display system according to the third embodiment of the present invention.
FIG. 24 is an explanatory diagram of an imaging range of a three-dimensional model in the traffic information display system according to the third embodiment of the present invention.
FIG. 25 is a diagram showing a process of enlarging and displaying the screen display of the selected spot in the traffic information display system according to the third embodiment of the present invention.
FIG. 26 is a diagram showing a process of further enlarging the screen display of the selected point from the display state of FIG. 25 in the traffic information display system according to the third embodiment of the present invention.
FIG. 27 is an enlarged view of the screen display of the selected point from the display state of FIG. 26 in the traffic information display system according to the third embodiment of the present invention.
FIG. 28 is a diagram of switching from the display state of FIG. 27 to the display screen of a captured image in the traffic information display system according to the third embodiment of the present invention.
FIG. 29 is a block diagram of a traffic information display system according to a fourth embodiment of the present invention.
FIG. 30 is a diagram showing an example of a captured image in the traffic information display system according to the fourth embodiment of the present invention.
FIG. 31 is a diagram obtained by converting the image shown in FIG. 30 captured by the traffic information display system according to the fourth embodiment of the present invention into an image viewed from a virtual viewpoint by texture mapping;
FIG. 32 is an explanatory diagram of an imaging range used in the traffic information display system according to the fourth embodiment of the present invention.
FIG. 33 is a block diagram of a traffic information display system according to a fifth embodiment of the present invention.
FIG. 34 is a block diagram of a traffic information display system according to a sixth embodiment of the present invention.
FIG. 35 is a screen transition diagram explaining the traffic information display system according to the seventh embodiment of the present invention.
FIG. 36 is a screen explanatory diagram in which the display screen is changed from the display state of FIG. 35 in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 37 is a diagram in which the selected point is further enlarged and displayed from the display state of FIG. 36 in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 38 is an explanatory diagram of image resolution when transmitting captured images of a plurality of different points to a vehicle in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 39 is a block diagram of a traffic information display system according to an eighth embodiment of the present invention.
FIG. 40 is an explanatory diagram of display of accident and traffic jam information in the traffic information display system according to the eighth embodiment of the present invention.
FIG. 41 is a block diagram of a traffic information display system according to a ninth embodiment of the present invention.
FIG. 42 is a front view of display means in the traffic information display system according to the ninth embodiment of the present invention.
FIG. 43 is a functional explanatory diagram of point selection means in the traffic information display system according to the ninth embodiment of the present invention.
FIG. 44 is a block diagram of a traffic information display system according to the tenth embodiment of the present invention.
FIG. 45 is a configuration diagram of a conventional traffic information display system.
FIG. 46 is a conceptual explanatory diagram of a conventional traffic information display system.
FIG. 47 is an explanatory diagram of point selection in a conventional traffic information display system.
FIG. 48 is a diagram showing a captured image display example in the conventional traffic information display system.
FIG. 49 is a diagram showing an installation example of an imaging device in a conventional traffic information display system.
FIG. 50 is a diagram showing a captured image display example in a conventional traffic information display system.
[Explanation of symbols]
100 Information display device mounted on vehicle
101 Display means
101a Display screen
102 Instruction input means
103 Image composition control means
104 Map information database
105 Wireless transmission / reception means
106 GPS
107 Imaging device installed at each point
108 base station
301 Camera parameter database
307 Shooting range
308 Shooting direction
401 viewpoint control means
402 CG image of imaging device
403 Shooting range on the map
504 Virtual camera
509 Texture mapping means
512 Shooting range
601 Three-dimensional (3D) information
606 Three-dimensional object (building)
607 Imaging range
701 Signal storage means
801 Signal storage means
1003 Accident and traffic information
1100 Point selection means
1201 Internet

Claims (7)

From a captured image transmission device that transmits a camera parameter of the imaging device together with the captured image when a captured image of a selected location is requested among the captured images by the imaging device installed at each point, and the captured image transmission device Information indicating the course direction of the host vehicle in the captured image received in the captured image received from the received map image of the selected point and the received camera parameter. A vehicle-mounted information display device that synthesizes and displays the information on the screen, and the information display device displays the map information displayed on the screen while changing the map information according to the movement of the viewpoint and the imaging on the screen. The image is synthesized and displayed, and the position of the viewpoint to be moved is changed from the position where the entire map information displayed on the screen can be viewed from the front. Traffic information display system characterized by changing to the same position as the image pickup device wraps around the image pickup device captured the captured image to be displayed on the screen from behind. The information display device finally changes the position of the viewpoint to the position of the imaging device, displays the captured image of the imaging device on the screen, and synthesizes and displays information indicating the course direction. The traffic information display system according to claim 1 . The information display device, traffic information according to claim 1 or claim 2, wherein the displaying by combining imaging range of the imaging device taken the captured image when displaying the map information on the screen Display system. When the captured image transmission device transmits time information indicating the photographing time of the captured image to be transmitted, and the information display device displays the captured image to be displayed on the screen within a certain time from the current time. the according to any one of claims 1 to 3, characterized in that to display drop the saturation of the captured image when the captured image is a color display the captured image is the previous data over a predetermined time Traffic information display system. The captured image transmission device also transmits the captured image and the camera parameters at points around the selected point in addition to the captured image and the camera parameters of the selected point, and the information display device The traffic according to any one of claims 1 to 4 , wherein the captured image of the surrounding points is also displayed on the screen before the captured image of the selected point is displayed on the screen. Information display system. 6. The traffic according to claim 5 , wherein the captured image transmission device transmits the captured image at a reduced resolution when transmitting the captured images of the imaging devices installed at a plurality of points together. Information display system. The traffic information display system according to any one of claims 1 to 6 , wherein the information display device displays the captured image as a monochrome image when displaying the captured image as a still image on the screen.

Images