JP2004021514A - Traffic information display system, pick-up image transmitter, and onboard information display device and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a course direction of an own vehicle in a pick-up image when receiving transmitted image data of the image picked up at a distant point, displaying the pick-up image and grasping the congestion situation of a road. <P>SOLUTION: A base station 108 transmits the camera parameter 301 of an imaging apparatus 107 together with the pick-up image when the pick-up image at a selected point out of the pick-up images picked up by the imaging apparatus 107 installed at various points is requested. When the pick-up image transmitted from the base station 108A is received, a course direction of an own vehicle in the pick-up image is obtained from map information 104 of the selected point and the received camera parameter 301, and course direction information is combined with the pick-up image and displayed on a screen. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a traffic information display system capable of confirming in advance an image showing road conditions such as a destination or a candidate passage when driving to a destination by driving a vehicle on an in-vehicle monitor. The present invention relates to a traffic information display system capable of easily grasping the relationship with a scheduled traveling direction on a monitor screen, and a storage medium storing the traffic information display processing program.
[0002]
[Prior art]
A traffic information display system for transmitting an image captured by a camera installed in a remote place and displaying the image on an on-vehicle monitor is proposed in, for example, Japanese Patent Application Laid-Open No. Hei 9-180087. In this conventional traffic information display system, when a user specifies a candidate passage point or the like in order to grasp in advance the road conditions of a destination or a candidate passage point, a vehicle captures an image at the designated candidate passage point from the vehicle to the base station. Is transmitted wirelessly.
[0003]
The base station constantly receives captured images transmitted from monitoring stations at various places such as intersections where cameras are installed in advance, and when a captured image of a designated passing candidate point is requested from a vehicle, the designated passing candidate point The captured image is taken out and transmitted to the vehicle. The vehicle that has received the captured image displays the captured image on the in-vehicle monitor, so that the user can check in advance the road conditions of the scheduled passage candidate point with the video.
[0004]
FIG. 45 is a configuration diagram of the traffic information display system according to the related art described above. The traffic information display system includes an image pickup device 107 installed at a monitoring station at each location such as an intersection, a base station 108 that receives a captured image sent from each monitoring station, and a candidate for passing to the base station 108. An information display device 100 mounted on a vehicle that requests a captured image of a point or the like and receives the captured image sent from the base station 108.
[0005]
The information display device 100 includes a map information database 104 storing map information used in a car navigation system, a GPS (global positioning system) 106 for acquiring the position of the vehicle, and an instruction input for inputting an instruction from a driver or the like. Means 102, display means (monitor screen) 101, wireless transmission / reception means 105 for exchanging signals with base station 108, image synthesis for controlling and controlling these to perform image synthesis and display on display means 101 The control means 103 is provided.
[0006]
FIG. 46 is a conceptual explanatory diagram of a conventional traffic information display system. A monitoring camera (imaging device) 107 is attached to each of the traffic lights installed at intersections and the like, and the base station 108 receives the captured image which is captured and transmitted in real time by each imaging device 107. . When the information display device 100 mounted on the vehicle 1 requests the base station 108 for an image of a candidate passage point, a captured image (request image) of the candidate passage point is transmitted from the base station 108, and the information display device 100 100 displays the captured image on a monitor screen.
[0007]
FIG. 47 is an explanatory diagram when a captured image is requested from the base station. The driver 2 displays map information used in the car navigation system on the screen 101a of the display unit 101. In this map, the current position (starting point) calculated by the GPS 106 to the destination (destination point) A is displayed, and two candidate routes 10 and 11 and candidate locations B and C on the route 10 are displayed. And a candidate passage point D on the route 11 are displayed. The driver 2 looks at this map, for example, and specifies, for example, a candidate passage point C with the instruction input means 102 (see FIG. 45).
[0008]
FIG. 48 is an explanatory diagram when the captured image transmitted from the base station 108 is displayed on the vehicle-mounted monitor. When the in-vehicle information display apparatus 100 receives the captured image, the captured image is displayed on the display unit 101, and the driver 2 grasps the congestion state of the candidate passage point C by looking at the captured image 101b. Thereby, the driver 2 can appropriately select the routes 10 and 11.
[0009]
[Problems to be solved by the invention]
However, the conventional traffic information display system has a problem that it is difficult to recognize the relationship with the host vehicle only from the captured image at the candidate passage point displayed on the on-vehicle monitor. This problem will be described with reference to FIGS.
[0010]
FIG. 49 is a diagram exemplifying an installation state of an imaging device at a candidate passage point C. The candidate passage point C is a crossroad, and four imaging devices 107a, 107b, 107c, and 107d are installed, and a vehicle that follows the leading vehicle 3 in the oncoming lane with respect to the expected traveling direction F of the own vehicle. Suppose there was traffic.
[0011]
FIGS. 50 (a), (b), (c), and (d) show captured images of the imaging devices 107a, 107b, 107c, and 107d. Is different in the position where the image 3a of the leading vehicle 3 can be seen.
[0012]
The information that the driver wants to know is which direction the planned traveling direction F of the own vehicle in FIG. 49 is on the captured image, and the positional relationship between the direction and the traffic jam vehicle 3. However, even if the captured images of FIGS. 50 (a), (b), (c), and (d) are sequentially transmitted from the base station 108, none of the captured images contains information that the driver wants to know. It is determined whether there is congestion in the same direction as the vehicle's passing direction, whether traffic congestion occurs only in the oncoming lane, or whether traffic congestion occurs on the route that intersects with the vehicle's passing direction. Can not.
[0013]
The above-described related art describes displaying an arrow indicating a course direction on a captured image. The above problem can be solved if the arrow indicating the passing direction of the own vehicle is synthesized and displayed on the captured image illustrated in FIG. 50, but the problem of how to determine the direction of the arrow to be synthesized and displayed can be determined. Without solving the above, the above problem cannot be actually solved.
[0014]
An object of the present invention is to provide a traffic information display system capable of combining and displaying information indicating a passing direction of a host vehicle on a captured image sent from a base station or the like, a captured image transmission device, and an in-vehicle information display device. Another object is to provide a storage medium storing the traffic information display processing program.
[0015]
[Means for Solving the Problems]
A traffic information display system that achieves the above object includes an image capturing device that transmits a camera parameter of the image capturing device together with the captured image when a captured image of a selected point is requested among images captured by an image capturing device installed at each point. An image transmitting device, and receives the captured image transmitted from the captured image transmitting device, and calculates the traveling direction of the own vehicle in the captured image received from the map information of the selected point and the received camera parameter. A vehicle-mounted information display device for combining the information indicating the course direction with the captured image and displaying the information on a screen.
[0016]
According to this configuration, the information display device can calculate and determine the direction of the course of the own vehicle that is known from the map information in the captured image based on the camera parameters. Can be combined and displayed.
[0017]
Preferably, the information display device displays the map information displayed on the screen on the screen while changing the map information in accordance with the movement of a viewpoint, and displays the captured image on the screen in a synthesized manner. With this configuration, the map information changes sequentially along the route on the map information, and the captured image is displayed at the end, so that it is easy to easily grasp the congestion state of the road from the captured image.
[0018]
More preferably, the information display device is configured to set the position of the viewpoint to be moved from a position overlooking the entire map information displayed on the screen to a position directly behind the imaging device that has captured the captured image to be displayed on the screen. And is changed to the same position as the imaging device. With this configuration, since the movement of the viewpoint finally becomes the position of the imaging device, the captured image displayed on the screen can be more easily grasped from which direction of the selected point and which direction of the own course is. .
[0019]
More preferably, the information display device is characterized in that the captured image displayed on the screen is converted into an image viewed from a virtual camera and displayed on the screen. With this configuration, a distorted captured image that is difficult to see is displayed as an easy-to-view image.
[0020]
More preferably, the information display device finally changes the position of the viewpoint to the position of the imaging device, displays the captured image of the imaging device on the screen, and synthesizes and displays information indicating the course direction. It is characterized by doing. With this configuration, it is possible to sequentially understand in which direction the actual captured image is finally displayed on the screen, and the captured image can be grasped intuitively.
[0021]
More preferably, the information display device has three-dimensional information as the map information. With this configuration, the map information is easy to see, and the sense of discomfort when the map information and the captured image are switched is eliminated.
[0022]
More preferably, when displaying the map information on the screen, the information display device combines and displays a photographing range of the photographing device that photographed the photographed image. With this configuration, it is possible to know the range of the imaging range before the captured image is displayed on the screen, and it is easy to know when the captured image is displayed on the screen.
[0023]
More preferably, the captured image transmitting device transmits time information indicating the capturing time of the captured image to be transmitted together, and the information display device is configured such that the captured image displayed on the screen is within a certain time from a current time. When the captured image is data of a predetermined time or more, the captured image is displayed in a reduced color. With this configuration, it is possible to reduce the frame rate of shooting by the imaging device, and to achieve power saving and cost reduction. In addition, even when a past captured image is displayed, it is possible to intuitively recognize that the captured image is several minutes ago.
[0024]
More preferably, the captured image transmitting device also transmits the captured image and the camera parameters at a point around the selected point in addition to the captured image and the camera parameters of the selected point, The information display device may also display the captured images of the surrounding points on the screen before displaying the captured images of the selected point on the screen. With this configuration, the surrounding congestion state can be grasped, and can be used as a reference for route selection.
[0025]
More preferably, the captured image transmission device transmits the captured image at a reduced resolution when transmitting the captured images of the imaging devices installed at a plurality of points together. With this configuration, a plurality of captured images can be transmitted without delaying the image data transmission speed.
[0026]
More preferably, the captured image transmitting device is provided in a base station, and the base station collects images captured by the image capturing devices at each point and transmits a requested captured image to a request destination. With this configuration, it is possible to centrally manage the captured image.
[0027]
More preferably, the information display device displays the captured image as a monochrome image when displaying the captured image as a still image on the screen. If the transmission speed of the image data is slow or the imaging frame rate of the imaging device is low, the captured image will be displayed as a still image. It is easy to identify whether the vehicle is stopped or the image is a still image in which the image is stopped, and it is possible to avoid giving a false recognition to the user.
[0028]
More preferably, the captured image transmission device is provided in each imaging device connected to the Internet, and the information display device requests the captured image to the corresponding imaging device via the Internet. . With this configuration, even when a failure occurs, the entire system can be prevented from going down.
[0029]
A captured image transmission device that achieves the above object is a captured image transmission device that constitutes one of the traffic information display systems described above. Since the captured image transmitting device transmits the camera parameters together with the captured image, the information display device for the vehicle can easily calculate the course direction of the own vehicle in the captured image together with the map information. Become.
[0030]
An on-vehicle information display device that achieves the above object is characterized in that it is an information display device that constitutes one of the traffic information display systems described above. Since the information display device calculates the course direction of the own vehicle in the captured image from the map information and the camera parameters, the information indicating the course direction can be displayed when the captured image is displayed on the screen.
[0031]
Preferably, in the above, there is provided means for selecting a point requesting the captured image from points on the map information displayed on the screen. With this configuration, it is easy to select a point on the map information requesting a captured image.
[0032]
More preferably, the acquired accident and traffic congestion information are combined and displayed on the map information displayed on the screen. This configuration makes it easier for the user to grasp the road conditions.
[0033]
More preferably, the selecting means is configured to perform selection of a route on the map information and selection of a point on the selected route by three types of inputs. With this configuration, the operation of the user becomes easier.
[0034]
More preferably, the selection means holds the information selected last time and starts the next selection from the previous selection state. With this configuration, the number of selection operations by the user is further reduced.
[0035]
In the above traffic information display system using the Internet, each of the captured image transmission devices includes a means for granting access permission, and the information display device that has requested the captured image using an access key for requesting the access permission is provided. It is characterized by charging. With this configuration, the security of the system is improved, and charging is performed according to the usage frequency.
[0036]
A storage medium that achieves the above object stores the processing program that causes the in-vehicle electronic device having a display screen to operate as the information display device according to any one of the above-described devices by reading the processing program. It is characterized by the following. With this configuration, for example, the hardware configuration of a car navigation system can be used.
[0037]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0038]
(First Embodiment)
FIG. 1 is a configuration diagram of a traffic information display system according to the first embodiment of the present invention. This traffic information display system includes an image pickup device 107 installed at a monitoring station at various places such as an intersection, and a base station 108 that receives an image picked up and transmitted by each image pickup device 107 for each image pickup device installation location. And a camera parameter database 301 connected to the base station 108 and holding camera parameters of each imaging device 107, which will be described later, and a candidate passage point or the like requested by a vehicle driver or the like by performing wireless communication with the base station 108 And an on-vehicle information display device 100 that receives the captured image from the base station 108 and displays it. Note that the camera parameter database 301 may be configured to be built in the base station 108.
[0039]
The information display device 100 includes a map information database 104 storing map information used in a car navigation system, a GPS (global positioning system) 106 for acquiring the position of the vehicle, and an instruction input for inputting an instruction from a driver or the like. Means 102, display means (monitor screen) 101, wireless transmission / reception means 105 for exchanging signals with base station 108, image synthesis for controlling and controlling these to perform image synthesis and display on display means 101 The control means 103 is provided.
[0040]
The information display device 100 is also used as a car navigation system, and stores a program for performing the traffic information display processing according to the present embodiment in the car navigation system from an external storage medium such as a CD-ROM or a DVD to an internal storage medium such as a built-in memory. , The car navigation system is operated as a vehicle-mounted device (information display device) of the traffic information display system.
[0041]
The information display device 100 shown in FIG. 1 according to the present embodiment has the same configuration as the conventional information display device 100 described with reference to FIG. However, as described later, the image synthesis control unit 103 of the information display apparatus 100 according to the present embodiment processes the camera parameter information transmitted together with the captured image from the base station 108 and converts the information of the own vehicle into the captured image. The difference is that a function of synthesizing information such as an arrow indicating a passing direction is provided by the program.
[0042]
FIG. 2 shows map information displayed on the monitor screen by the car navigation system described with reference to FIG. The image synthesizing control means 103 of the information display device 100 can know the passing direction F of the own vehicle on any of the routes 10 and 11 from the relationship between the starting point of the map information and the destination A.
[0043]
FIG. 3 is a diagram illustrating a camera (imaging device) installed state at the candidate passage point B illustrated in FIG. 2. At the passing candidate point B, one imaging device 107 is installed. Camera parameters such as a photographing range (angle of view) 307 and a photographing direction 308 of the image pickup device 107 are stored in a database 301 provided in the base station 108. When a captured image of the passing candidate point B is requested, the camera image parameters of the imaging device 107 that has captured the captured image are transmitted to the information display device 100 together with the captured image.
[0044]
FIG. 4 is an explanatory diagram of an arrow F indicating a passing direction obtained from the map information in FIG. The image synthesis control unit 103 calculates from the camera parameters of the imaging device 107 which direction the arrow F indicating the passing direction in FIG. 2 faces in the captured image to be synthesized, and calculates the direction in the captured image. Of the passing road 305 is calculated.
[0045]
Then, as shown in FIG. 5, an arrow F is displayed at a position 305, and an image captured by the imaging device 107 in FIG. As a result, when the driver views this composite image, it becomes clear at a glance which direction the passing direction of the own vehicle is in the captured image, and the positional relationship between the congested vehicle 3 and the vehicle image 3a shown in FIG. It can be easily grasped.
[0046]
FIG. 6A is an explanatory diagram of camera parameters of each imaging device 107 stored in the database 301 of FIG. The camera parameters include three-degree-of-freedom data of a three-dimensional position (x, y, z) 306 indicating a world coordinate position of the imaging device 107, two-degree-of-freedom data indicating an angle and a shooting direction 308, and a rotation angle around the shooting direction. An external parameter having a total of 6 degrees of freedom of 1-degree-of-freedom data indicating 310, internal parameters such as an angle of view 307 and lens distortion of the imaging device 107, and a lens center axis 312 within a camera angle of view 311 are included.
[0047]
By using the camera parameters, the image synthesis control unit 103 can calculate the world coordinate position of each pixel of the captured image by calculation, and the route along which the vehicle travels and the direction of passage F of the road have the camera parameters. It is possible to determine where on the imaging screen of the imaging device 107 the image is to be taken and in which direction. Here, the lens distortion data is, as shown in FIG. 6B, data indicating an angular relationship between incident light 313 to the lens 302 and incident light 314 from the lens 302 to the CCD.
[0048]
(Second embodiment)
FIG. 7 is a configuration diagram of a traffic information display system according to the second embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (see FIG. 1) in that the information display device 100 includes the viewpoint control unit 401 and the image synthesis control unit. The only difference is that the image synthesis is performed by the image 103 using the viewpoint-converted image. Other configurations and operations are the same as those of the first embodiment. Hereinafter, the composite display of the viewpoint-converted image will be described.
[0049]
FIG. 8 is a diagram illustrating a state in which the driver 2 displays the map information on the display unit 101 in the present embodiment. In this state, the driver 2 specifies an arbitrary point, for example, a candidate passage point C. The map information at the time of this designation is a view of the map as viewed from directly above as shown in a screen 101a of FIG.
[0050]
When the candidate passage point C is designated, the designation selection signal is notified from the instruction input unit 102 to the viewpoint control unit 401 via the image synthesis control unit 103. Upon receiving this notification, the viewpoint control unit 401 converts the map information displayed on the display unit 101 into map information obtained by performing viewpoint conversion, and converts the map into a bird's-eye view viewed from diagonally above as shown in FIG. 101 is displayed. A method of converting a map viewed from directly above into a bird's-eye view has been widely known.
[0051]
Next, the viewpoint control unit 401 receives the data of the selected point (in this example, the candidate passage point C) and brings the viewpoint closer to the point C, thereby displaying the display unit 101 as shown in FIG. The selected point C is displayed on the screen 101a such that the selected point C is gradually enlarged. At the time when the image in FIG. 10 can be displayed, the information display device 100 stores the data of the camera parameters (the installation position, the imaging range, and the like of the imaging device 107) of the imaging device 107 installed at the selected point C in the base station 108. From the camera, the computer graphic (CG) image 402 of the imaging device and the imaging range 403 on the map are synthesized on the display screen 101a of FIG. 10 based on the camera parameter data. indicate. Further, the passing route on the route 10 is displayed and emphasized by a bold line or the like from other routes, and an arrow image F indicating the passing direction is also displayed.
[0052]
FIG. 11 is a diagram showing the display screen 101a of the display means 101 when the viewpoint further approaches the point C. In FIG. 11, the map of the point C is further enlarged and displayed as compared with FIG. When the distance to the point C approaches a predetermined distance, the viewpoint control unit 401 moves the viewpoint to the rear side in the shooting direction of the imaging device 107 (CG 402 on the screen 101a) while further moving the viewpoint to the point C. Let By this operation, the direction in which the map is synthesized and displayed can be made closer to the imaging direction of the imaging device, and the state change of the screen 101a in the order of the operation is shown in FIG. 12, FIG. 13, and FIG. It is.
[0053]
Eventually, the viewpoint control unit 401 matches the viewpoint with the position of the imaging device 402, and also matches the direction in which the map is synthesized with the imaging direction of the imaging device 402. FIG. 15 shows the display screen 101a at that time. At this time, since the viewpoint matches the position of the imaging device, the CG 402 of the imaging device 107 which has been displayed up to that point is not displayed.
[0054]
After the screen of FIG. 15 is displayed, as shown in FIG. 16, the image of the arrow F indicating the passing direction of the own vehicle in FIG. 15 is synthesized with the captured image sent from the base station 108, and displayed on the display screen. indicate. In the switching between the display screens 101a in FIGS. 15 and 16, the display screen 101a in FIG. 15 combines the map information in accordance with the position and the direction of the imaging device, whereas the display screen 101a in FIG. On the display screen 101a ', the position of the road, the horizon, and the like remain almost the same positional relationship as the display screen 101a of FIG. 15, so that the driver takes an image based on the arrow image F indicating the passing direction of the own vehicle. The image can be determined, and the road condition can be accurately grasped.
[0055]
FIG. 17 is an explanatory diagram showing the relationship between the display control procedure of the viewpoint control unit 401 and the input signals from the driver (user) and the base station 108 according to the present embodiment. At first, a point selection waiting state is set, and a diagram (display screen 101a in FIG. 8) in which the map is viewed from directly above is displayed (step S41). When the user inputs a point selection, a bird's-eye view (FIG. 9) is displayed next (step S42), and the viewpoint is sequentially approached to the selected point (step S43). FIGS. 10 and 11 show the transition of the display screen at this time. At this point, the information display device 100 receives the camera parameters of the imaging device 107 installed at the point C from the base station 108. .
[0056]
Further, by performing a process of moving the viewpoint closer to the selected point and wrapping around the back of the imaging device (step S44), the display screen transitions to FIG. 12, FIG. 13, and FIG. When it matches the shooting direction (step S45), FIG. 15 is displayed. Then, when the captured image of the point C is received from the base station 108, an arrow F indicating the passing direction is combined with the captured image and displayed as shown in FIG. 16 (step S46).
[0057]
Here, when the user selects another point, for example, the destination A, the process proceeds in the reverse of steps S46, S45, S44, S43, S42, and S41, and the display screen 101a of the display unit 101 also changes as shown in FIG. The transition from 16 to FIG. 15, FIG. 14, FIG. 13, FIG. 12, FIG. 11, FIG. 9, FIG. In this way, by controlling the movement of the viewpoint in reverse when returning to the initial state, the user can more easily understand the relationship between the viewpoint and the shooting direction of the captured image and the entire route, which have been viewed as it is. Can be done.
[0058]
Next, the imaging range 403 on the map will be described with reference to FIGS. FIG. 18A shows a photographing device 402, its photographing direction 404, and a rectangular photographing range (angle of view) 405 that is separated from the photographing device 402 by a predetermined distance in the photographing direction 404 and is perpendicular to the photographing direction 404. ing. Further, four lines 406 connecting each of the four corners of the photographing range 405 to the photographing device 402 are shown. The inside of the quadrangular pyramid cut off by these four lines 406 is the shooting range of the shooting device 402.
[0059]
When these four lines 406 are extended until the road surface is reached, and the photographing range 405 is projected on the road surface, the projected range becomes a hatched area 407 in FIG. 18B. This area 407 is the photographing range of the photographing device 402. However, when the photographing range 407 is above the horizontal line, the photographing range 407 extends infinitely far in the direction of arrow E. It is difficult to obtain useful information on traffic conditions from the captured image in a range that is a predetermined distance away from the shooting range 407.
[0060]
Therefore, as shown in FIG. 18C, a trapezoidal area 403 generated by partitioning the area 407 by an upper limit line 408 separated by a predetermined distance t from the imaging device 402 in the imaging direction is defined as an imaging range 403 on a map. And This is displayed on the screen as the photographing range 403 shown in FIGS. Note that, instead of the photographing range 403, the above-described quadrangular pyramid itself may be displayed.
[0061]
According to the above-described embodiment, since the positional relationship between the captured image and the information indicating the passing direction of the own vehicle is sequentially and intuitively grasped by the transition screen, it is easy to recognize the relationship with the own vehicle. Can be.
[0062]
(Third embodiment)
FIG. 19 is a configuration diagram of a traffic information display system according to the third embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the second embodiment (see FIG. 7) in that The only difference is that a functional means operated by an image synthesizing processing program is added, and other configurations and operations are the same as those of the second embodiment. Hereinafter, the image synthesis display by the texture mapping method will be described.
[0063]
FIG. 20 is an explanatory diagram of a texture mapping method, which is an image composition method unique to the image composition control unit 103 according to the third embodiment. The captured image transmitted from the base station 108 is an image captured by the actual camera 501. When the actual camera 501 is installed, its installation position and installation direction are restricted, and the actual camera 501 should be installed at an ideal position and direction. Is rare.
[0064]
As an actual camera 501 shown in FIG. 20, a wide-angle camera is generally used. When a wide-angle camera captures an image of a subject 503 on a road surface 506 from obliquely above, the captured image is as shown in FIG. , The subject image 503a is displayed on the distorted road surface image 506a. The image synthesis control unit 103 according to the present embodiment converts the captured image into an image captured by a virtual camera 504 arranged at an ideal position (for example, a position directly above the road surface 506) illustrated in FIG. As shown in FIG. 22, it is displayed on the screen 101a of the display means. In FIG. 22, the hatched portions are portions that are not actually captured by the camera 501.
[0065]
In this example, an image synthesis method is adopted in which the road surface 506 is used as a model, the captured image is used as a texture, and the texture is mapped to the model. This image synthesis method is called a texture mapping method. Although the virtual camera is arranged directly above the road surface, the arrangement position of the virtual camera 504 is arbitrary, and it is possible to combine an actual captured image with an image viewed from an arbitrary direction. Further, as shown in FIG. 23, it is also possible to perform texture mapping not only on the road surface but also on a three-dimensional model composed of the road surface 506 and the wall 507 at a certain distance from the actual camera 501.
[0066]
FIG. 24 is a diagram showing respective ranges 510 and 511 for texture mapping on a three-dimensional model composed of a road surface 506 and a wall 507 up to a certain distance from the imaging device 107. In the third embodiment, a range 512 that combines the two ranges 510 and 511 is displayed instead of the imaging range 403 in the second embodiment. Then, when the captured image signal is transmitted from the base station 108, the captured image signal is immediately texture-mapped on the range 512 and displayed.
[0067]
FIG. 25, FIG. 26, FIG. 27, and FIG. 28 are diagrams showing the transition of the display screen according to the present embodiment corresponding to FIG. 13, FIG. 14, FIG. 15, and FIG. , A captured image is texture-mapped to a range 512 in FIG. In the present embodiment, the viewpoint (location position of the virtual camera) and the shooting direction approach the actual imaging device 107 in accordance with the transition of the display screen. Therefore, as the process proceeds from FIG. 25, FIG. 26, and FIG. Is displayed so as to approach the actual captured image.
[0068]
In the state of the display screen shown in FIG. 27, the viewpoint and the shooting direction are the same as those of the imaging device, so that the image synthesized by texture mapping is almost the same as the captured image itself. Finally, the screen is switched from the display screen of FIG. 27 to the display screen of FIG. 28, and the image of the arrow F indicating the passing direction is combined with the captured image of the imaging device 107 and displayed. Since the contents of the image displayed on the display screen shown in FIG. 28 are almost the same as the image contents of the display screen shown in FIG. 27, the user can recognize these as substantially continuous.
[0069]
As described above, in the present embodiment, the captured image transmitted from the base station is synthesized and converted into an image viewed from the virtual camera, texture-mapped to map data, and the virtual camera position gradually approaches the actual camera position. Therefore, it is possible to more accurately determine the road conditions such as the candidate passage points than in the second embodiment.
[0070]
In the above-described example, the display is finally switched from the texture-mapped composite image to the image captured by the image capturing apparatus. However, the display need not always be switched. This is because the contents of the display screen shown in FIG. 27 and the contents of the display screen shown in FIG. 28 are almost the same.
[0071]
(Fourth embodiment)
FIG. 29 is a configuration diagram of a traffic information display system according to the fourth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the third embodiment (see FIG. 19) in that the image synthesis control means 103 of the information display apparatus 100 is different from the traffic information display system in that the texture mapping means 509 is used. When the image synthesis method is used, three-dimensional information (3D information) 601 of the map information database 104 is used, and the other configurations and operations are the same. Hereinafter, the use of the 3D information 601 will be described.
[0072]
FIG. 30 is a diagram illustrating a captured image captured by the imaging device. The captured image includes an image 603 of a road surface and an image 602 of a three-dimensional object (vehicle in the illustrated example). When this captured image is combined with the image projected from the virtual camera directly above by the texture mapping method described in the third embodiment, an image shown in FIG. 31 is obtained. In FIG. 31, the road surface image 605 is an image of the road surface viewed from directly above, but the three-dimensional object image 604 is greatly distorted and synthesized. This is because a large positional shift occurs between the road surface model used for texture mapping and the three-dimensional object.
[0073]
Actually, the road monitoring image pickup device is installed at a position higher than the vehicle, so that the vehicle is not distorted as shown in FIG. However, for a building such as a building, a large distortion may occur.
[0074]
Therefore, in the fourth embodiment, the three-dimensional information 601 included in the map information is used as described below. FIG. 32 is a diagram showing a usage method. Here, the imaging range 512 constituted by the road surface 510 and the wall 511 is the same as in the third embodiment. In the present embodiment, a three-dimensional object (such as a building) 606 within the imaging range 512 is searched from the three-dimensional information 601 included in the map information database 104, whereby the imaging range is corrected from the range 512 to the range 607. You. The new imaging range 607 is also a model on which texture mapping is performed.
[0075]
As described above, even for a building such as a building, by using the three-dimensional information 601 included in the map information database 104, a large positional deviation from the model does not occur, and a large distortion is similarly prevented from occurring in the composite image. be able to. Other configurations and operations are the same as those of the third embodiment.
[0076]
In the third and fourth embodiments, the viewpoint is gradually changed from the entire map to the selected point, the image displayed on the screen is changed based on the change in the viewpoint, and finally, the viewpoint and the shooting direction are changed. Although the position of the imaging device is made to coincide with the imaging direction, it is not always necessary to make them coincide. For example, an image that looks down from a position that is higher than the actual height of the imaging device by a certain amount may be synthesized. Further, an image that looks down on the selected point from directly above may be combined.
[0077]
In the third and fourth embodiments, the case where one imaging device is installed at the point C has been described, but two or more imaging devices may be installed. By using the image combining method by the texture mapping means, it is easy to combine the captured images of two or more imaging devices into one captured image. Even in this case, the viewpoint of the captured image to be displayed can be changed in order from the entire map to the selected point.
[0078]
(Fifth embodiment)
FIG. 33 is a configuration diagram of a traffic information display system according to the fifth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (see FIG. 1) in that the information display apparatus 100 converts the signal received by the wireless transmission / reception means 105. The difference is that a signal accumulating unit 701 for accumulating is provided, and the image synthesizing control unit 103 performs image synthesizing using the data accumulated in the signal accumulating unit 701, and other configurations and operations are the same as those of the first embodiment. is there. This embodiment is particularly effective when the signal transmission speed between the base station 108 and the host vehicle is limited.
[0079]
An image captured by the imaging device is wirelessly transmitted from the base station 108 to the vehicle. If the signal transmission speed is sufficient, a real-time image (for example, an image of 30 frames per second) can be transmitted as a moving image. . However, if the signal transmission speed is not sufficient, real-time transmission of moving images becomes impossible.
[0080]
Therefore, in the present embodiment, instead of transmitting a real-time moving image to the vehicle, a moving image with dropped frames is transmitted to the vehicle. This makes it possible to transmit a captured image required for a vehicle even at a low signal transmission speed. The signal storage means 701 provided in the information display device 100 of the vehicle sends the image of the one frame as a still image to the image synthesizing control means 103 when the first frame of the received moving image signal is completely received. Output. When the input image is a still image, the image control unit 103 converts the image into a black-and-white image, synthesizes an arrow image F indicating the course direction, and outputs the combined image to the display unit 101.
[0081]
While the still image is being displayed on the display unit 101, the signal storage unit 701 stores the moving image composed of a plurality of dropped frames received by the wireless transmission / reception unit 105. When the reception of the moving image is completed, the signal storage unit 701 outputs the moving image to the image combining control unit 103 while performing loop reproduction. When the input image is a moving image, the image control unit 103 synthesizes the moving image with an arrow image F or the like indicating a course direction and outputs the synthesized image to the display unit 101.
[0082]
With such a configuration, first, after selecting a point, the user can view the state of the selected point with the shortest delay time, though it is a still image. By displaying this still image in black and white, it is possible to recognize without confusion whether the vehicle in the image is stationary due to traffic congestion or whether the vehicle in the image is stationary due to the still image. Further, the loop playback display of the moving image allows the user to know the traffic flow at the selected point while keeping down the communication fee. This embodiment can be used in combination with the other embodiments described above.
[0083]
(Sixth embodiment)
FIG. 34 is a configuration diagram of a traffic information display system according to the sixth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (FIG. 1) only in that signal storage means 801 is provided in base station 108. Other configurations and operations are the same as those of the first embodiment.
[0084]
This embodiment is used when signal transmission between the imaging device 107 installed at each point and the base station 108 requires a cost according to the amount of transmission, or when power consumption of the imaging device 107 is reduced. Is valid.
[0085]
The image capturing apparatus 107 according to the present embodiment is provided for only a predetermined time (for example, 30 minutes at a point where traffic volume is small, and every 10 minutes at a point where traffic volume is small) set for each point. The captured moving image is transmitted to the base station 108, and the base station 108 stores the moving image received from the imaging device 107 in the signal storage unit 801 together with the shooting time data.
[0086]
When the base station 108 receives a request signal for a captured image from the vehicle, the base station 108 reads the captured image at the selected point from the signal storage unit 801 and transmits the captured image to the vehicle along with the shooting time data. The image control means 103 of the information display means 100 mounted on the vehicle, when the input photographing time data is older than a certain period of time from the present time, converts this into a black-and-white image and synthesizes an arrow image indicating the course direction and the like. After that, the information is output to the display unit 101 together with the shooting time.
[0087]
If the input photographing time data is not older than the current time by more than a certain time (threshold time set in the information display device 100), the received captured image remains a color image, and an arrow image indicating the course direction is displayed. Are output to the display unit 101 together with the shooting time.
[0088]
As described above, according to the present embodiment, it is possible to save the communication fee between the base station 108 and the imaging device 107, and to reduce the power consumption. Further, by displaying the old image in black and white, the user can immediately recognize that the display image is the old image. When the captured image is old, the image may not be converted to a black and white image uniformly, but may be configured to display an image whose saturation is lowered according to the age of the image. Note that this embodiment can be used in combination with the other embodiments described above.
[0089]
(Seventh embodiment)
Next, a traffic information display system according to a seventh embodiment of the present invention will be described. The device configuration of the traffic information display system according to the present embodiment is the same as that of the third embodiment (see FIG. 19), and the basic operation of displaying the captured image of the selected point is the same. The embodiment is different in that, for example, when a captured image of the selected point C is displayed, a captured image of a point B on the way before the viewpoint reaches the point C is also displayed.
[0090]
That is, in the present embodiment, after the bird's-eye view of FIG. 35 that is the same as that of FIG. 9 is displayed, when the selected point C is zoomed up (enlarged display) as shown in FIG. In the vicinity, in this example, the captured image of the imaging device installed at the point B before the selected point C and the camera parameters thereof are also the same as the captured image of the imaging device installed at the selected point C and the camera parameters. Sent to.
[0091]
Upon receiving these signals, the information display device 100 mounted on the vehicle generates a composite image for each of the selected point C and the point B existing around the selected point C, and displays the composite image on the display unit 101. That is, the CG image 402 (B) of the imaging device at the point B is displayed, and the captured image of the point B is synthesized and displayed in the imaging range 512 (B) by texture mapping. The image 402 (C) is displayed, and the captured image of the selected point C is synthesized and displayed in the imaging range 512 (C) by texture mapping.
[0092]
Next, as shown in FIG. 37, when the viewpoint approaches the selected point C and the selected point C is enlarged and displayed, the base station 108 transmits a captured image of only the selected point C, and the vehicle selects the selected point C. The captured image is synthesized and displayed in the imaging range 512 (C) at the point C by texture mapping. Subsequent operations and screen display are the same as in the third embodiment.
[0093]
FIG. 38 is an explanatory diagram when the base station 108 transmits captured images of the selected point C and the peripheral point B to the requesting vehicle. When transmitting captured images at a plurality of points to the vehicle, as shown in the upper part of FIG. 38, the image data with reduced resolution is transmitted. As shown in the lower part of 38, image data with high resolution is transmitted. This makes it possible to reduce the data transmission speed when transmitting captured images at a plurality of locations.
[0094]
According to the present embodiment, after the point is selected, the image of the peripheral point is displayed before the image of the selected point is enlarged and displayed, so that not only the selected point but also the surrounding area is known. be able to. For this reason, the traffic condition of the candidate route can be known in more detail, and the selection of the route can be appropriately determined.
[0095]
Further, when the base station 108 transmits captured images from a plurality of points to the vehicle side, the base station 108 transmits a low-resolution image, and when transmitting a captured image of only the selected point, a high-resolution image is transmitted. Thus, the data transmission speed required for communication can be suppressed to a certain value or less. At the time of displaying captured images from a plurality of points on the display unit 101, the captured images at the respective points are displayed in a small size, so that even if the image has a low resolution, deterioration of the image quality on the display image can be suppressed to a low level. This embodiment can be used in combination with the above-described third, fourth, fifth, and sixth embodiments.
[0096]
(Eighth embodiment)
FIG. 39 is a configuration diagram of a traffic information display system according to the eighth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (FIG. 1) in that the base station 108 obtains accident / congestion information 1003, The difference is that the information is transmitted to the vehicle side and displayed on the display means 101 of the information display device 100, and other configurations and operations are the same as those of the first embodiment.
[0097]
FIG. 40 is a diagram showing a state where the user (driver) 2 first selects a point at which the user wants to check the road information. The display screen 101a shows a destination and a candidate passage point (A, B, C). , D) are displayed together with the map information. At this time, accident and traffic congestion information 1003 is collected in the base station 108, and the accident and traffic congestion information 1003 is transmitted to the vehicle. As shown in FIG. 40, the information display device 100 that has received the accident / congestion information 1003 displays an image (square image in the illustrated example) 1001 indicating an accident and an image (contrast image) on the candidate routes 10 and 11 as illustrated in FIG. In this example, a circle image 1002 is superimposed and displayed on the map information.
[0098]
While looking at the display screen 101, the driver 2 selects, in the routes 10 and 11, a portion of a congested portion or a portion likely to be affected by an accident, and focuses on the situation at each location. Is requested to the base station 108, and the traffic situation can be accurately grasped. This embodiment can be used in combination with the above-described embodiments.
[0099]
(Ninth embodiment)
FIG. 41 is a configuration diagram of the traffic information display system according to the ninth embodiment of the present invention. The traffic information display system according to the present embodiment is different from the traffic information display system according to the first embodiment (FIG. 1) in that the instruction input means 102 of the information display device 100 includes a point selection means 1100. However, other configurations and operations are the same as those of the first embodiment.
[0100]
FIG. 42 is a front view of display means 101 according to the present embodiment. On the display screen 101a of the display means 101, destinations and candidate passage points (A, B, C, D, E) are displayed together with the map information, and beside the display screen 101a, a point selection means 1100, that is, a button 1101, 1102, 1103, and 1104 are provided. The button 1101 indicates “forward”, the button 1102 indicates “return”, the button 1103 indicates “enter”, and the button 1104 indicates “cancel”.
[0101]
FIG. 43 is an explanatory diagram showing how a specific point is selected using these buttons 1101, 1102, 1103, and 1104. Now, it is assumed that, as shown in the selection state (A) of FIG. 43, the route of the point BCA is selected as the route, and this route is blinking on the display screen 101 of FIG. It is also assumed that there are two alternative routes, a point D-C-A and a point D-E-A. If the driver wants to select another route, the driver can advance the selected location in the direction of arrow a each time the button 1101 is pressed, and return the selected location in the direction of arrow b each time the button 1102 is pressed. In response to this selection, the corresponding route on the display screen 101a of FIG. 42 is displayed blinking.
[0102]
After selecting the route, the user presses the button 1103 to “determine”. As a result, as shown by an arrow c in FIG. 43, the process proceeds from the selected state A to the selected state B. When it is desired to return from the selection state B to the selection state A in which the route is selected, the user presses the button 1104 and inputs "cancel". As a result, as shown by an arrow d in FIG. 43, the state returns from the selected state B to the selected state A.
[0103]
In the selection state b, a point where the captured image is to be displayed is selected. There are three options of points for displaying captured images in a state where the route B-CA is selected, and there are three points B, C, and A, which are arranged in order from the closest to the departure point. One of these three points is selected using a “forward” button 1101 and a “back” button 1102. The selected point blinks on the display screen 101a of FIG. If the selected point is correct, the user presses the "OK" button 1103 and transitions to state C as shown by arrow c. In this state C, the sentence “Is it OK with C?” For confirming the selected point is overlapped on the display screen 101a. If another point is to be selected again, the "cancel" button 1103 is pressed to return to the selected state b as shown by arrow d. After the point is selected, when the user presses the "OK" button 1103 to confirm the selected point, the state transits to state d as shown by arrow c, and the point selection is completed.
[0104]
The operation after the point is selected is the same as in the first embodiment. As described above, even if there are a plurality of candidate passage points on the map, the user can easily select a point by operating the four buttons “forward”, “return”, “decide”, and “cancel”. , The captured image of the point can be requested to the base station 108. Note that the "cancel" button is not necessarily required, so that at least three buttons of "advance", "return", and "enter" may be provided. This embodiment can be used in combination with the above-described embodiments.
[0105]
In addition, the selected route and point are stored as initial values even after completion of the selection, and the selected state is returned to the initial value when another point is subsequently selected. As shown in the figure, when the next point A is selected with respect to the selected point C of the initial value, the point A can be selected only by pressing the “forward” button 1101 once. In this way, by constantly updating and storing the previous selection state as the initial value, the number of times of operation of the three buttons “forward”, “return”, and “determine” can be minimized.
[0106]
(Tenth embodiment)
FIG. 44 is a configuration diagram of a traffic information display system according to the tenth embodiment of the present invention. In the traffic information display system according to the present embodiment, an imaging device 107 installed at each point, an accident / congestion information source 1003, and an imaging device search site 1203 are interconnected by the Internet 1201 without having a base station. The information display device 100 mounted on the vehicle is connected to the Internet 1201.
[0107]
The in-vehicle information display device 100 includes wireless transmission / reception units 105 and 1202, and is connected to the Internet 1201 via these units. As the wireless transmission / reception means 105 and 1202, it is possible to use a plurality of types of communication means such as a mobile phone, a personal handy phone system (PHS), and a beacon. The image composition control unit 103 connects to the imaging device search site 1203 via the Internet 1201 and receives the location of the nearby imaging device 107 on the map and the address on the network.
[0108]
When the user selects an imaging device at a place where the user wants to check the road condition from among imaging devices existing in the vicinity, the image synthesis control unit 103 connects to the imaging device 107 via the Internet 1201 and performs the imaging. The apparatus receives a captured image of the apparatus and camera parameters. At this time, that is, when connecting to the imaging device 107, the image composition control means 103 has a vehicle-specific access key 1207, and the imaging device 107 gives an access permission 1206 according to the access key 1207. The access key 1207 is charged for the transmitted captured image.
[0109]
As described above, by adopting a configuration having no base station, even if a local system failure occurs, the entire system does not go down, and a traffic information display system system with a high operating rate can be realized. .
[0110]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, the information which shows the traveling direction of the own vehicle can be correctly displayed with respect to the captured image sent from the base station etc., and it is possible to make a user correctly grasp road conditions. It is possible to provide a traffic information display system.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a traffic information display system according to a first embodiment of the present invention.
FIG. 2 is a diagram showing map information displayed on display means of the traffic information display system according to the first embodiment of the present invention.
FIG. 3 is a diagram showing an example of an installation state of an imaging device in the traffic information display system according to the first embodiment of the present invention.
FIG. 4 is an explanatory diagram of a direction and a position of an arrow image indicating a traveling direction determined from a camera parameter in the traffic information display system according to the first embodiment of the present invention.
FIG. 5 is a diagram showing a display example of a captured image in the traffic information display system according to the first embodiment of the present invention.
FIG. 6 is an explanatory diagram of camera parameters in the traffic information display system according to the first embodiment of the present invention.
FIG. 7 is a configuration diagram of a traffic information display system according to a second embodiment of the present invention.
FIG. 8 is a diagram showing a point selection situation in the traffic information display system according to the second embodiment of the present invention.
FIG. 9 is a diagram showing a map as a bird's-eye view in the traffic information display system according to the second embodiment of the present invention.
FIG. 10 is a diagram showing a process of enlarging and displaying a selected point from the display state of FIG. 9 in the traffic information display system according to the second embodiment of the present invention.
FIG. 11 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 10 in the traffic information display system according to the second embodiment of the present invention.
FIG. 12 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 11 in the traffic information display system according to the second embodiment of the present invention.
FIG. 13 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 12 in the traffic information display system according to the second embodiment of the present invention.
FIG. 14 is a diagram showing a process of further enlarging and displaying a selected point from the display state of FIG. 13 in the traffic information display system according to the second embodiment of the present invention.
FIG. 15 is an enlarged view of a selected point from the display state of FIG. 14 in the traffic information display system according to the second embodiment of the present invention.
FIG. 16 is a diagram in which the traffic information display system according to the second embodiment of the present invention has switched from the display state of FIG. 15 to a captured image display screen.
FIG. 17 is a diagram showing a transition procedure of screen display in the traffic information display system according to the second embodiment of the present invention.
FIG. 18 is an explanatory diagram of an imaging range in the traffic information display system according to the second embodiment of the present invention.
FIG. 19 is a configuration diagram of a traffic information display system according to a third embodiment of the present invention.
FIG. 20 is an explanatory diagram of an arrangement of an actual imaging device and a virtual camera in the traffic information display system according to the third embodiment of the present invention.
FIG. 21 is a diagram illustrating a captured image of an actual imaging device in the traffic information display system according to the third embodiment of the present invention;
FIG. 22 is a diagram showing an example in which a captured image of an actual imaging device is combined with an image viewed from a virtual camera position in the traffic information display system according to the third embodiment of the present invention.
FIG. 23 is an explanatory diagram of a three-dimensional model of texture mapping in the traffic information display system according to the third embodiment of the present invention.
FIG. 24 is an explanatory diagram of an imaging range of a three-dimensional model in the traffic information display system according to the third embodiment of the present invention.
FIG. 25 is a diagram illustrating a process of enlarging and displaying a screen display of a selected point in the traffic information display system according to the third embodiment of the present invention.
FIG. 26 is a diagram showing a process of further enlarging and displaying the screen display of the selected point from the display state of FIG. 25 in the traffic information display system according to the third embodiment of the present invention.
FIG. 27 is a diagram showing a screen display of a selected point further enlarged from the display state of FIG. 26 in the traffic information display system according to the third embodiment of the present invention.
FIG. 28 is a diagram in which the traffic information display system according to the third embodiment of the present invention has switched from the display state of FIG. 27 to a captured image display screen.
FIG. 29 is a configuration diagram of a traffic information display system according to a fourth embodiment of the present invention.
FIG. 30 is a diagram showing an example of a captured image in the traffic information display system according to the fourth embodiment of the present invention.
FIG. 31 is a diagram in which the image shown in FIG. 30 captured by the traffic information display system according to the fourth embodiment of the present invention is converted into an image viewed from a virtual viewpoint by texture mapping.
FIG. 32 is an explanatory diagram of an imaging range used in the traffic information display system according to the fourth embodiment of the present invention.
FIG. 33 is a configuration diagram of a traffic information display system according to a fifth embodiment of the present invention.
FIG. 34 is a configuration diagram of a traffic information display system according to a sixth embodiment of the present invention.
FIG. 35 is a screen transition diagram for explaining the traffic information display system according to the seventh embodiment of the present invention.
FIG. 36 is an explanatory view of a screen in which the display screen is shifted from the display state of FIG. 35 in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 37 is a diagram showing the selected point further enlarged from the display state of FIG. 36 in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 38 is an explanatory diagram of an image resolution when transmitting captured images of a plurality of different points to a vehicle in the traffic information display system according to the seventh embodiment of the present invention.
FIG. 39 is a configuration diagram of a traffic information display system according to an eighth embodiment of the present invention.
FIG. 40 is an explanatory diagram showing display of accident and congestion information in the traffic information display system according to the eighth embodiment of the present invention.
FIG. 41 is a configuration diagram of a traffic information display system according to a ninth embodiment of the present invention.
FIG. 42 is a front view of display means in the traffic information display system according to the ninth embodiment of the present invention.
FIG. 43 is a functional explanatory view of a point selecting means in the traffic information display system according to the ninth embodiment of the present invention.
FIG. 44 is a configuration diagram of a traffic information display system according to a tenth embodiment of the present invention.
FIG. 45 is a configuration diagram of a conventional traffic information display system.
FIG. 46 is a conceptual explanatory diagram in a conventional traffic information display system.
FIG. 47 is a diagram for explaining point selection in a conventional traffic information display system.
FIG. 48 is a diagram showing a captured image display example in a conventional traffic information display system.
FIG. 49 is a diagram showing an example of installation of an imaging device in a conventional traffic information display system.
FIG. 50 is a diagram showing a captured image display example in a conventional traffic information display system.
[Explanation of symbols]
100 Vehicle-mounted information display device
101 display means
101a Display screen
102 Instruction input means
103 Image synthesis control means
104 map information database
105 wireless transmission / reception means
106 GPS
107 Imaging device installed at each point
108 base stations
301 Camera Parameter Database
307 shooting range
308 Shooting direction
401 viewpoint control means
402 CG image of imaging device
403 Shooting range on map
504 virtual camera
509 Texture mapping means
512 shooting range
601 Three-dimensional (3D) information
606 Solid object (building)
607 Imaging range
701 Signal storage means
801 Signal storage means
1003 accident, traffic jam information
1100 Point selection means
1201 Internet

Claims (21)

A captured image transmitting device that transmits a camera parameter of the image capturing device together with the captured image when a captured image of a selected location is requested among captured images by an imaging device installed at each location; and Information indicating the course direction of the own vehicle in the captured image received from the map information of the selected point and the received camera parameters after receiving the transmitted captured image and information indicating the course direction in the captured image A traffic information display system, comprising: an on-vehicle information display device for synthesizing and displaying on a screen. 2. The information display device according to claim 1, wherein the information display device displays the map information displayed on the screen while changing the map information in accordance with a movement of a viewpoint, and displays the captured image on the screen while synthesizing the captured image. Traffic information display system. The information display device, the position of the viewpoint to be moved, from a position overlooking the entire map information displayed on the screen, from around the imaging device that has taken the captured image displayed on the screen, from directly behind 3. The traffic information display system according to claim 2, wherein the position is changed to the same position as the imaging device. The traffic according to any one of claims 1 to 3, wherein the information display device converts the captured image displayed on the screen to an image viewed from a virtual camera and displays the image on the screen. Information display system. The information display device is characterized in that the position of the viewpoint is finally changed to the position of the imaging device, the captured image of the imaging device is displayed on the screen, and information indicating the course direction is synthesized and displayed. The traffic information display system according to claim 1. The traffic information display system according to claim 1, wherein the information display device has three-dimensional information as the map information. 7. The information display device according to claim 1, wherein when displaying the map information on the screen, the information display device combines and displays a photographing range of the photographing device that photographed the photographed image. 8. Traffic information display system. The captured image transmitting device transmits time information indicating the capturing time of the captured image to be transmitted together, and the information display device determines that the captured image displayed on the screen is data within a certain time from the current time. 8. The display according to claim 1, wherein the captured image is displayed in color, and when the captured image is data before a predetermined time or more, the captured image is displayed with reduced saturation. Traffic information display system. The captured image transmission device transmits the captured image and the camera parameters at a point around the selected point in addition to the captured image and the camera parameters of the selected point, the information display device, The traffic according to any one of claims 1 to 8, wherein, before displaying the captured image of the selected point on the screen, the captured image of the peripheral point is also displayed on the screen. Information display system. The traffic according to claim 9, wherein the captured image transmitting device transmits the captured image at a reduced resolution when transmitting the captured images of the respective imaging devices installed at a plurality of points together. Information display system. 11. The image capturing apparatus according to claim 1, wherein the image capturing apparatus is provided in a base station, and the base station collects images captured by the image capturing apparatus at each point and transmits a requested image to a request destination. The traffic information display system according to any of the above. 12. The traffic information display system according to claim 1, wherein the information display device displays the captured image as a still image on the screen as a black and white image. The said captured image transmission apparatus is provided in each imaging apparatus connected to the Internet, The said information display apparatus requests the said imaging apparatus from the said imaging apparatus via the said Internet, The claim 1 characterized by the above-mentioned. Item 13. The traffic information display system according to any one of Items 12. A captured image transmitting apparatus comprising the traffic information display system according to claim 1. An in-vehicle information display device comprising the traffic information display system according to any one of claims 1 to 13. 16. The in-vehicle information display device according to claim 15, further comprising means for selecting a point at which the captured image is requested from points on the map information displayed on the screen. 17. The in-vehicle information display device according to claim 15, wherein the acquired accident and traffic congestion information are combined and displayed on the map information displayed on the screen. 17. The on-vehicle vehicle according to claim 16, wherein the selecting unit is configured to select a route on the map information and select a point on the selected route by three types of inputs. Information display device. 19. The in-vehicle information display device according to claim 18, wherein the selection unit is configured to hold information selected last time and start a next selection from a previous selection state. 14. The image capturing apparatus according to claim 13, wherein each of the captured image transmitting apparatuses includes a unit for giving an access permission, and charges the information display apparatus that has requested the captured image using an access key for requesting the access permission. Described traffic information display system. 20. A storage medium storing the processing program for causing the in-vehicle electronic device having the display screen to operate as the information display device according to claim 15 by reading the processing program.

Images