US20090256906A1 - Image display apparatus and image generation apparatus - Google Patents
Image display apparatus and image generation apparatus Download PDFInfo
- Publication number
- US20090256906A1 US20090256906A1 US11/995,884 US99588406A US2009256906A1 US 20090256906 A1 US20090256906 A1 US 20090256906A1 US 99588406 A US99588406 A US 99588406A US 2009256906 A1 US2009256906 A1 US 2009256906A1
- Authority
- US
- United States
- Prior art keywords
- image
- point
- map
- view
- section
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
- G01C21/34—Route searching; Route guidance
- G01C21/36—Input/output arrangements for on-board computers
- G01C21/3626—Details of the output of route guidance instructions
- G01C21/3647—Guidance involving output of stored or live camera images or video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/09—Arrangements for giving variable traffic instructions
- G08G1/0962—Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
- G08G1/0968—Systems involving transmission of navigation instructions to the vehicle
- G08G1/0969—Systems involving transmission of navigation instructions to the vehicle having a display in the form of a map
Definitions
- the present invention relates to an image display apparatus and an image generation apparatus for displaying and generating a map image including a taken image taken by an image pickup apparatus.
- a conventional map display apparatus as described below is known.
- the conventional map display apparatus is communicably connected through a traffic control network to image pickup apparatuses each provided at a traffic signal.
- One traffic signal is provided on each corner of an intersection, i.e., the east side of the intersection, the west side thereof, the south side thereof, and the north side thereof.
- the image pickup apparatus provided at the traffic signal on the east side takes an image of a state of a road running toward the image pickup apparatus itself, that is, a road running from the west into the intersection, and transmits an obtained video to the map display apparatus through the traffic control network.
- the image pickup apparatuses provided on the west side, the south side, and the north side each transmits, to the map display apparatus through the traffic control network, a video of a state of a road running toward the image pickup apparatus itself, that is, videos of states of roads running from the east, the north, and the south, respectively, into the intersection.
- the map display apparatus includes a map information display board on which an intersection is displayed, and four monitors which are assigned with four directions, east, west, south and north, respectively.
- the monitor for the east is embedded in a portion corresponding to the east side of the intersection displayed on the map information display board.
- the monitors for the west, the south, and the north are embedded in portions corresponding to the west side of the intersection displayed on the map information display board, the south side thereof, and the north side thereof, respectively.
- the map display apparatus acquires, from the image pickup apparatus provided on the west side, a video representing a road running into the intersection from the east, and rotates the acquired video in the left direction (counterclockwise), and then displays, on the monitor for the east, a video obtained by the rotation. Similarly, a video obtained by rotating, in the right direction (clockwise), a video representing a state of a road running into the intersection from the west is displayed on the monitor for the west. Further, a video obtained by vertically inverting (by rotating 180 degrees) a video representing a state of a road running into the intersection from the south is displayed on the monitor for the south. Further, on the monitor for the north, a video representing a state of a road running into the intersection from the north is displayed.
- Patent Document 1 Japanese Laid-Open Patent Publication No. 11-161888
- the point of view used for the video displayed on the map information display board As the point of view used for the video displayed on the map information display board, the point of view of the image pickup apparatus, that is, the point of view of a camera is used as it is.
- the point of view used for displaying the intersection that is, a road map
- the map information display board is a point of view used for displaying the intersection viewed vertically from overhead of the intersection. That is, the point of view is different therebetween.
- a viewer is allowed to easily understand such a content displayed on the map display board, in a stationary state such as a state in a traffic control center or the like.
- an object of the present invention is to provide a display apparatus or a generation apparatus for displaying or generating a map image which is easy for a moving user to intuitively understand.
- a first aspect of the present invention is directed to an image display apparatus, connected through a communication network to at least one image pickup apparatus and an image generation apparatus each of which is externally provided, capable of displaying at least two types of map images.
- the image display apparatus includes a first display section for displaying a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon, and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by at least notifying the image generation apparatus of a point-of-view angle and a line-of-sight direction of the first map image displayed by the first display section.
- the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, and thereafter generates the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, notified by the request transmission section, and provides the image display apparatus with the point-of-view converted image.
- the image display apparatus further includes a second display section for displaying a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image.
- the request transmission section of the image display apparatus further notifies the image generation apparatus of a traveling direction of the moving object.
- the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, generates an intermediate image by extracting a portion of the taken image having been acquired, in accordance with the traveling direction notified by the request transmission section, and further generates the point-of-view converted image by using the intermediate image having been generated, and provides the image display apparatus with the point-of-view converted image.
- the image generation apparatus is connected through the communication network to a plurality of image pickup apparatuses provided at different positions from each other.
- the request transmission section of the image display apparatus further notifies the image generation apparatus of a setting position of one of the plurality of image pickup apparatuses so as to request the point-of-view converted image of the setting position from the image generation apparatus.
- the image generation apparatus acquires a taken image from the one of the plurality of image pickup apparatuses provided at the setting position for which the point-of-view converted image is requested, in response to a request from the request transmission section, generates the point-of-view converted image, and provides the image display apparatus with the point-of-view converted image.
- the second display section of the image display apparatus displays the second map image in which the point-of-view converted image of the setting position for which the point-of-view converted image is requested by the request transmission section, is superimposed on the first map image.
- the second map image is obtained by superimposing the point-of-view converted image on the first map image at one of a position corresponding to a setting position of the image pickup apparatus, a position corresponding to the vicinity of the setting position, and at a position corresponding to a position taken by the image pickup apparatus.
- a second aspect of the present invention is directed to an image display apparatus, connected through a communication network to at least one image pickup apparatus and an image generation apparatus each of which is externally provided, capable of displaying at least two types of map images.
- the image display apparatus includes: a first generation section for generating a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon; a first display section for displaying the first map image generated by the first generation section; and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by notifying the image generation apparatus of a point-of-view angle and a line-of sight direction of the first map image displayed by the first display section.
- the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, and thereafter generates the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image, and provides the image display apparatus with the point-of-view converted image.
- the image display apparatus further includes a second generation section for generating a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image, and a second display section for displaying the second map image generated by the second generation section.
- the request transmission section of the image display apparatus further notifies the image generation apparatus of a traveling direction of the moving object.
- the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, generates an intermediate image by extracting a portion of the taken image having been acquired, in accordance with the traveling direction notified by the request transmission section, and further generates the point-of-view converted image by using the intermediate image having been generated, and provides the map image display apparatus with the point-of-view converted image.
- the image generation apparatus is connected through the communication network to a plurality of image pickup apparatuses provided at different positions from each other.
- the request transmission section of the image display apparatus further notifies the image generation apparatus of a setting position of one of the plurality of image pickup apparatuses so as to request the point-of-view converted image of the setting position from the image generation apparatus.
- the image generation apparatus acquires a taken image from the one of the plurality of image pickup apparatuses provided at the setting position for which the point-of-view converted image is requested, in response to a request from the request transmission section, generates the point-of-view converted image, and provides the map image display apparatus with the point-of-view converted image.
- the second display section of the image display apparatus displays the second map image in which the point-of-view converted image of the setting position for which the point-of-view converted image is requested by the request transmission section is superimposed on the first map image.
- the second generation section generates the second map image by superimposing the point-of-view converted image provided by the image generation apparatus, on the first map image, at one of a position corresponding to a setting position of the image pickup apparatus, a position corresponding to the vicinity of the setting position, and a position corresponding to a position taken by the image pickup apparatus.
- a third aspect of the present invention is directed to an image providing system.
- the image providing system comprises: an image generation apparatus connected to at least one image pickup apparatus, which is externally provided, so as to communicate with each other; and an image display apparatus, connected to the image generation apparatus so as to communicate with each other, capable of displaying at least two types of map images.
- the image display apparatus includes: a first display section for displaying a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon; and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by notifying the image generation apparatus of a point-of-view angle and a line-of-sight direction of the first map image displayed by the first display section.
- the image generation apparatus includes: an image acquisition section for acquiring a taken image from the image pickup apparatus in response to a request from the request transmission section; a point-of-view conversion processing section for generating the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired by the image acquisition section so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image; and a transmission section for transmitting, to the image display apparatus, the point-of-view converted image generated by the point-of-view conversion processing section.
- the image display apparatus further includes a second display section for displaying a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image.
- a fourth aspect of the present invention is directed to an image generation apparatus, connected through a communication network to at least one image pickup apparatus which is externally provided, capable of generating at least two types of map images.
- the image generation apparatus includes: a first generation section for generating a first map image representing a map of an external moving object and a vicinity of the external moving object; a point-of-view conversion processing section for acquiring a taken image from the image pickup apparatus in response to a request transmitted from the external moving object, and thereafter generating the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image; and a second generation section for generating a second map image in which the point-of-view converted image generated by the point-of-view conversion processing section is superimposed on the first map image; and a transmission section for transmitting, to the external moving object, the second map image
- the direction and the point-of-view angle of the point-of-view converted image are converted so as to match the direction and the point-of-view angle, respectively, of the first map image, and therefore, when a user in a moving space views the second map image, the user is allowed to intuitively understand a content of the point-of-view converted image included in the second map image.
- FIG. 1 is a block diagram illustrating an entire configuration of an image providing system according to a first embodiment of the present invention.
- FIG. 2 is a block diagram illustrating in detail a configuration of an image generation apparatus 2 shown in FIG. 1 .
- FIG. 3 is a block diagram illustrating in detail a configuration of an image display apparatus 3 shown in FIG. 1 .
- FIG. 4 is a flow chart illustrating process steps of each of the image generation apparatus 2 and the image display apparatus 3 shown in FIG. 1 .
- FIG. 5 is a schematic diagram illustrating an example of a first map image displayed in step S 12 shown in FIG. 4 .
- FIG. 6 is a schematic diagram illustrating an example of a service point map image displayed in step S 14 shown in FIG. 4 .
- FIG. 7 is a schematic diagram illustrating an example of a data structure of a point-of-view converted image request generated in step S 16 shown in FIG. 4 .
- FIG. 8 is a schematic diagram illustrating an example of a second map image generated in step S 18 shown in FIG. 4 .
- FIG. 9 is a schematic diagram illustrating another example of the second map image generated in step S 18 shown in FIG. 4 .
- FIG. 10 is a schematic diagram illustrating still another example of the second map image generated in step S 18 shown in FIG. 4 .
- FIG. 11 is a schematic diagram illustrating an example of a service point map image displayed in step S 14 shown in FIG. 4 .
- FIG. 1 is a block diagram illustrating an entire configuration of an image providing system according to a first embodiment of the present invention.
- the image providing system at least one image pickup apparatus 1 , an image generation apparatus 2 , and an image display apparatus 3 are connected to each other through a communication network 4 so as to communicate with each other.
- the image pickup apparatus 1 is provided in the vicinity of an actual road, takes an image of a state of the road from the point of view of a camera thereof, and transmits the taken image to the communication network 4 .
- the image pickup apparatus 1 is provided above the center line of the road so as to be directed to both the up lane and the down lane of the road.
- the image pickup apparatus 1 transmits, to the communication network 4 , an image, taken from the point of view of the camera thereof, of states of both the lanes of the road.
- the image generation apparatus 2 is, for example, a server device on the communication network 4 , and provides the image display apparatus 3 with a point-of-view converted image.
- the point-of-view converted image will be described below in detail.
- FIG. 2 is a block diagram illustrating in detail a configuration of the image generation apparatus 2 shown in FIG. 1 .
- the image generation apparatus 2 comprises a communication section 21 , a storage device 22 , and a central processing section 23 .
- the communication section 21 transmits, to the central processing section 23 , various data transmitted through the communication network 4 , and transmits, to the communication network 4 , various data received from the central processing section 23 .
- the storage device 22 stores a database for managing at least a point-of-view angle, a line-of-sight direction, a setting position, an image pickup position, and identification information of each image pickup apparatus 1 on the communication network 4 , as shown in FIG. 2 .
- the point-of-view angle is an angle between an optical axis of the image pickup apparatus 1 and a surface of the road
- the line-of-sight direction represents a line-of-sight direction (corresponding to a compass direction) of the image pickup apparatus 1 on the horizontal surface
- the image pickup position represents positional information relating to a road area taken by the image pickup apparatus 1 .
- the central processing section 23 typically includes a CPU, a ROM, and a RAM.
- the CPU executes a computer program previously stored in the ROM, by using the RAM as a work area.
- the processing performed by the central processing section 23 will be specifically described below with reference to a flow chart and the like.
- the image display apparatus 3 is typically an information terminal apparatus or a navigation apparatus mounted in a vehicle corresponding to a moving space, and is characterized by performing a process of requesting a point-of-view converted image from the image generation apparatus 2 , and combining (superimposing), with (on) a map image, the point-of-view converted image transmitted from the image generation apparatus 2 .
- FIG. 3 is a block diagram illustrating in detail a configuration of the image display apparatus 3 shown in FIG. 1 .
- the image display apparatus 3 comprises an input device 31 , a storage device 32 , a central processing section 33 , a display section 34 , and a communication section 35 .
- the input device 31 is, for example, a touch panel or a button to be operated by a user of the image display apparatus 3 .
- the storage device 32 stores a point database representing a collection of information with which identification of a point (hereinafter, referred to as an available point) at which the image generation apparatus 2 is allowed to provide the point-of-view converted image is enabled, as shown in FIG. 3 .
- the storage device 32 further stores a map database representing a map of a predetermined area across, for example, Japan.
- the map data is structured such that the point-of-view angle of the map displayed on the display section 34 is allowed to be changed in the up/down direction and/or in the right/left direction.
- the map database is stored such that the direction for the map on a screen (hereinafter, referred to as a display screen) of the display section 34 is changeable (such that the top of the map represents the north or the heading direction).
- the central processing section 33 typically includes a CPU, a ROM and a RAM.
- the CPU executes a computer program previously stored in the ROM, by using the RAM as a work area.
- the processing performed by the central processing section 33 will be specifically described below with reference to a flow chart and the like.
- the display section 34 displays various images generated by the central processing section 33 .
- the communication section 35 transmits, to the central processing section 33 , various data transmitted through the communication network 4 , and transmits, to the communication network 4 , various data received from the central processing section 33 .
- the central processing section 33 of the image display apparatus 3 generates a first map image (step S 11 in FIG. 4 ). Specifically, the central processing section 33 acquires the most recent position of a vehicle having the image display apparatus 3 mounted therein by using an output from a GPS receiver and an autonomous navigation sensor not shown, and thereafter reads, from the map database in the storage device 32 , map data representing the most recent position and the vicinity thereof. The central processing section 33 generates the first map image by using the read map data.
- the direction and the point-of-view angle for the first map image having been generated are determined by a user operating the input device 31 or are predetermined.
- Reference map data generated in the above manner is transmitted from the central processing section 33 to the display section 34 , and the display section 34 displays, on the display screen, the first map image as shown in FIG. 5 (step S 12 ).
- a route acquired through a well-known route search processing may be combined with the first map image.
- the central processing section 33 when the point-of-view converted image is to be displayed on the display section 34 , a user operates the input device 31 in a predetermined manner.
- the input device 31 provides the central processing section 33 with a request of displaying the point-of-view converted image.
- the central processing section 33 receives the request of displaying the point-of-view converted image as described above (step S 13 )
- the central processing section 33 generates a service point map (see FIG. 6 ) on which a predetermined mark (hereinafter, referred to as an available point mark) is associated with the available point (step S 14 ).
- a predetermined mark hereinafter, referred to as an available point mark
- the available point mark may be represented as, for example, a camera mark or an icon including an illustration of a camera so as to preferably allow a user to easily know that a video is provided.
- the available area may be displayed as shown in FIG. 11 .
- the direction for the map may be changed such that the top of the map represents the north.
- the direction for the map may be slightly different between at a time at which the point-of-view converted image is requested and at a time at which the point-of-view converted image is received, or it is necessary to change the direction of the point-of-view converted image each time the direction (the cardinal direction toward which the vehicle is heading) for the map is changed.
- the service point map (see FIG. 6 ) as described above is transmitted from the central processing section 33 to the display section 34 , and displayed by the display section 34 (step S 14 ).
- step S 14 all the available points indicated by the available point information having been read may be displayed as a list.
- the process is returned to step S 11 .
- the service point map image When the service point map image is displayed, a user designates an available point desired by the user by operating the input device 31 . Thus, the available point information having been designated is provided to the central processing section 33 (step S 15 ).
- the central processing section 33 generates information (hereinafter, referred to as a point-of-view converted image request) used for allowing the image display apparatus 3 to request the point-of-view converted image from the image generation apparatus 2 (step S 16 ).
- the point-of-view converted image request includes identification information used for uniquely identifying each of the image generation apparatus 2 and the image display apparatus 3 on the communication network 4 , information representing the direction and the point-of-view angle of the map having been most recently set, and the available point information acquired in step S 15 , as shown in FIG. 7 .
- the point-of-view converted image request generated as describe above is transmitted to the communication network 4 through the communication section 35 (step S 16 ), transmitted over the communication network 4 , and received by the communication section 21 of the image generation apparatus 2 (sequence SQ 1 shown in FIG. 4 ).
- the central processing section 23 of the image generation apparatus 2 When the central processing section 23 of the image generation apparatus 2 receives the point-of-view converted image request from the communication section 21 (step S 21 ), the central processing section 23 generates a taken image request for requesting a taken image from the image pickup apparatus 1 provided at the available point(s) represented by the point-of-view converted image request (step S 22 ). Alternatively, the central processing section 23 may recognize the received available point as the image pickup position, and generate the taken image request for requesting the taken image.
- step S 22 The process of step S 22 will be specifically described.
- the central processing section 23 acquires, from the database (see FIG. 2 ) of the storage device 22 , the identification information of the image pickup apparatus 1 provided at the setting position represented by the available point information included in the point-of-view converted image request having been received.
- the central processing section 23 generates the taken image request including the identification information having been acquired.
- the central processing section 23 of the image generation apparatus 2 receives the taken image through the communication section 21 (step S 23 ), the central processing section 23 performs the point-of-view conversion process for the taken image (step S 24 ).
- step S 24 The process of step S 24 will be specifically described.
- the central processing section 23 acquires, from the database (see FIG. 2 ) of the storage device 22 , the point-of-view angle and the line-of-sight direction of the image pickup apparatus 1 from which the taken image having been most recently received has been transmitted.
- the point-of-view angle having been acquired is different from the point-of-view angle of the map having been most recently set by the image display apparatus 2 , and therefore the central processing section 23 changes the point-of-view angle of the taken image having been most recently taken, so as to match the point-of-view angle of the map.
- the central processing section 23 further changes the direction, specified by the line-of-sight direction having been acquired, of the taken image in which the point-of-view has been converted, so as to match the direction for the map having been most recently set, thereby generating the point-of-view converted image.
- the point-of-view converted image generated as described above is transmitted to the communication network 4 through the communication section 21 (step S 24 ), and is received by the communication section 35 of the image display apparatus 3 from which the point-of-view converted image request has been transmitted (sequence SQ 4 shown in FIG. 4 ).
- step S 17 When the central processing section 33 of the image display apparatus 3 receives the point-of-view converted image through the communication section 35 (step S 17 ), a second map image in which the point-of-view converted image is combined with the first map image is generated (step S 18 ).
- step S 18 The process of step S 18 will be specifically described.
- the central processing section 33 reads, from the map database of the storage device 32 , map data representing a point designated in step S 15 and the vicinity thereof.
- the central processing section 33 combines the point-of-view converted image having been most recently received, with the designated available point in the map image represented by the map data having been read, so as to generate the second map image shown in FIG. 8 .
- the point-of-view converted image may be displayed at a position corresponding to the vicinity of the setting position of the image pickup apparatus 1 , or at a position corresponding to a position taken by the image pickup apparatus.
- the point-of-view converted image may be displayed so as to allow a user to recognize relationship with the designated available point.
- the image display apparatus 3 may be configured such that a user is allowed to change between generation of the second map image shown in FIG. 8 , and generation of that shown in FIG. 9 , by operating the input device 31 .
- the point-of-view converted image may have triangle buttons at both ends thereof, and a position on the road displayed in the point-of-view converted image may be changed by pressing the triangle button.
- the second map image generated as described above is transmitted from the central processing section 33 to the display section 34 , and the display section 34 displays the received second map image on the display screen (step S 19 ).
- the direction and the point-of-view angle of the point-of-view converted image match the direction and the point-of-view angle, respectively, of the map image, so that a user in a moving space is allowed to intuitively understand the content of the point-of-view converted image.
- the point-of-view converted image including both lanes of the road is generated.
- the present invention is not restricted thereto, and when the image display apparatus 3 notifies the image generation apparatus 2 of the direction in which the vehicle is traveling, the image generation apparatus 2 is allowed to recognize the direction in which the vehicle is traveling, and may generate an intermediate image including only the lane on which the vehicle is traveling, and may thereafter generate the point-of-view converted image as described above so as to provide the image display apparatus 3 with the point-of-view converted image.
- the image generation apparatus 2 is allowed to provide the image display apparatus 3 with the point-of-view converted image obtained by changing a range covered by the point-of-view converted image in accordance with the direction in which the vehicle is traveling.
- step S 19 the process may be returned to step S 11 .
- step S 14 may be executed following step S 19 , a user is allowed to designate another available point, and the image display apparatus 3 is allowed to acquire the point-of-view converted image including another point. Thus, the user is allowed to view another second map image.
- the first and the second map images are generated by the image display apparatus 3 .
- the present invention is not restricted thereto.
- the first and the second map images may be generated by the image generation apparatus 2 .
- the image display apparatus 3 needs to transmit, to the image generation apparatus 2 , the information necessary for generation of the first and the second map images.
- the point-of-view conversion process performed by the image generation apparatus 2 in the present embodiment may be performed by the image display apparatus 3 .
- one of the image generation apparatus 2 or the image display apparatus 3 may automatically monitor a moving image at a point previously set by a user or a specific point (an intersection or a point, uploaded on the Internet, at which a congestion often occurs) on the set route, and measure traffic flow through image processing, and when, for example, a traffic situation changes due to, for example, a congestion occurring or a congestion being solved, it is possible to automatically display the image representing the point.
- a point at which a congestion occurs may be checked while sequentially changing a point, on a set route, at which the moving image is automatically monitored, and further an image of a point which is not indicated by congestion information transmitted, for example, through an FM multiplex broadcasting and/or from a transmitter on a road included in a traffic information system (VICS (Vehicle Information and Communication System)), may be displayed.
- VICS Vehicle Information and Communication System
- the image display apparatus is useful for an in-vehicle information terminal apparatus, a navigation apparatus, and the like, through which a moving user needs to intuitively understand a map image. Further, the image generation apparatus according to the present invention is useful for a server apparatus and the like connected through a communication network to, for example, the information terminal apparatus, the navigation apparatus as described above.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Multimedia (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- Instructional Devices (AREA)
- Traffic Control Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Navigation (AREA)
Abstract
Description
- The present invention relates to an image display apparatus and an image generation apparatus for displaying and generating a map image including a taken image taken by an image pickup apparatus.
- A conventional map display apparatus as described below is known. The conventional map display apparatus is communicably connected through a traffic control network to image pickup apparatuses each provided at a traffic signal. One traffic signal is provided on each corner of an intersection, i.e., the east side of the intersection, the west side thereof, the south side thereof, and the north side thereof. The image pickup apparatus provided at the traffic signal on the east side takes an image of a state of a road running toward the image pickup apparatus itself, that is, a road running from the west into the intersection, and transmits an obtained video to the map display apparatus through the traffic control network. Further, the image pickup apparatuses provided on the west side, the south side, and the north side each transmits, to the map display apparatus through the traffic control network, a video of a state of a road running toward the image pickup apparatus itself, that is, videos of states of roads running from the east, the north, and the south, respectively, into the intersection.
- The map display apparatus includes a map information display board on which an intersection is displayed, and four monitors which are assigned with four directions, east, west, south and north, respectively. The monitor for the east is embedded in a portion corresponding to the east side of the intersection displayed on the map information display board. The monitors for the west, the south, and the north are embedded in portions corresponding to the west side of the intersection displayed on the map information display board, the south side thereof, and the north side thereof, respectively.
- The map display apparatus acquires, from the image pickup apparatus provided on the west side, a video representing a road running into the intersection from the east, and rotates the acquired video in the left direction (counterclockwise), and then displays, on the monitor for the east, a video obtained by the rotation. Similarly, a video obtained by rotating, in the right direction (clockwise), a video representing a state of a road running into the intersection from the west is displayed on the monitor for the west. Further, a video obtained by vertically inverting (by rotating 180 degrees) a video representing a state of a road running into the intersection from the south is displayed on the monitor for the south. Further, on the monitor for the north, a video representing a state of a road running into the intersection from the north is displayed.
- The processes described above allow a video representing the intersection and its vicinity as viewed vertically from overhead to be displayed on the map information display board. Thus, a viewer is allowed to intuitively recognize the state of the intersection.
- As the point of view used for the video displayed on the map information display board, the point of view of the image pickup apparatus, that is, the point of view of a camera is used as it is. On the other hand, the point of view used for displaying the intersection, that is, a road map, on the map information display board is a point of view used for displaying the intersection viewed vertically from overhead of the intersection. That is, the point of view is different therebetween. A viewer is allowed to easily understand such a content displayed on the map display board, in a stationary state such as a state in a traffic control center or the like.
- However, there is a problem that, since the point of view used for the video is different from the point of view used for the road map in a moving state such as a state in a vehicle, a driver has difficulty in intuitively understanding a content displayed on the map information display board.
- Therefore, an object of the present invention is to provide a display apparatus or a generation apparatus for displaying or generating a map image which is easy for a moving user to intuitively understand.
- To achieve the above object, a first aspect of the present invention is directed to an image display apparatus, connected through a communication network to at least one image pickup apparatus and an image generation apparatus each of which is externally provided, capable of displaying at least two types of map images. The image display apparatus includes a first display section for displaying a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon, and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by at least notifying the image generation apparatus of a point-of-view angle and a line-of-sight direction of the first map image displayed by the first display section. Here, the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, and thereafter generates the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, notified by the request transmission section, and provides the image display apparatus with the point-of-view converted image. The image display apparatus further includes a second display section for displaying a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image.
- The request transmission section of the image display apparatus further notifies the image generation apparatus of a traveling direction of the moving object. In this case, the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, generates an intermediate image by extracting a portion of the taken image having been acquired, in accordance with the traveling direction notified by the request transmission section, and further generates the point-of-view converted image by using the intermediate image having been generated, and provides the image display apparatus with the point-of-view converted image.
- The image generation apparatus is connected through the communication network to a plurality of image pickup apparatuses provided at different positions from each other. In this case, the request transmission section of the image display apparatus further notifies the image generation apparatus of a setting position of one of the plurality of image pickup apparatuses so as to request the point-of-view converted image of the setting position from the image generation apparatus. The image generation apparatus acquires a taken image from the one of the plurality of image pickup apparatuses provided at the setting position for which the point-of-view converted image is requested, in response to a request from the request transmission section, generates the point-of-view converted image, and provides the image display apparatus with the point-of-view converted image. The second display section of the image display apparatus displays the second map image in which the point-of-view converted image of the setting position for which the point-of-view converted image is requested by the request transmission section, is superimposed on the first map image.
- Preferably, the second map image is obtained by superimposing the point-of-view converted image on the first map image at one of a position corresponding to a setting position of the image pickup apparatus, a position corresponding to the vicinity of the setting position, and at a position corresponding to a position taken by the image pickup apparatus.
- Further, a second aspect of the present invention is directed to an image display apparatus, connected through a communication network to at least one image pickup apparatus and an image generation apparatus each of which is externally provided, capable of displaying at least two types of map images. The image display apparatus includes: a first generation section for generating a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon; a first display section for displaying the first map image generated by the first generation section; and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by notifying the image generation apparatus of a point-of-view angle and a line-of sight direction of the first map image displayed by the first display section. Here, the image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, and thereafter generates the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image, and provides the image display apparatus with the point-of-view converted image. The image display apparatus further includes a second generation section for generating a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image, and a second display section for displaying the second map image generated by the second generation section.
- The request transmission section of the image display apparatus further notifies the image generation apparatus of a traveling direction of the moving object. The image generation apparatus acquires a taken image from the image pickup apparatus in response to a request from the request transmission section, generates an intermediate image by extracting a portion of the taken image having been acquired, in accordance with the traveling direction notified by the request transmission section, and further generates the point-of-view converted image by using the intermediate image having been generated, and provides the map image display apparatus with the point-of-view converted image.
- The image generation apparatus is connected through the communication network to a plurality of image pickup apparatuses provided at different positions from each other. In this case, the request transmission section of the image display apparatus further notifies the image generation apparatus of a setting position of one of the plurality of image pickup apparatuses so as to request the point-of-view converted image of the setting position from the image generation apparatus. The image generation apparatus acquires a taken image from the one of the plurality of image pickup apparatuses provided at the setting position for which the point-of-view converted image is requested, in response to a request from the request transmission section, generates the point-of-view converted image, and provides the map image display apparatus with the point-of-view converted image. The second display section of the image display apparatus displays the second map image in which the point-of-view converted image of the setting position for which the point-of-view converted image is requested by the request transmission section is superimposed on the first map image.
- The second generation section generates the second map image by superimposing the point-of-view converted image provided by the image generation apparatus, on the first map image, at one of a position corresponding to a setting position of the image pickup apparatus, a position corresponding to the vicinity of the setting position, and a position corresponding to a position taken by the image pickup apparatus.
- Further, a third aspect of the present invention is directed to an image providing system. The image providing system comprises: an image generation apparatus connected to at least one image pickup apparatus, which is externally provided, so as to communicate with each other; and an image display apparatus, connected to the image generation apparatus so as to communicate with each other, capable of displaying at least two types of map images. Here, the image display apparatus includes: a first display section for displaying a first map image of a moving object and a vicinity of the moving object, the moving object having the image display apparatus mounted thereon; and a request transmission section for requesting a point-of-view converted image from the image generation apparatus by notifying the image generation apparatus of a point-of-view angle and a line-of-sight direction of the first map image displayed by the first display section. Further, the image generation apparatus includes: an image acquisition section for acquiring a taken image from the image pickup apparatus in response to a request from the request transmission section; a point-of-view conversion processing section for generating the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired by the image acquisition section so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image; and a transmission section for transmitting, to the image display apparatus, the point-of-view converted image generated by the point-of-view conversion processing section. The image display apparatus further includes a second display section for displaying a second map image in which the point-of-view converted image provided by the image generation apparatus is superimposed on the first map image.
- Further, a fourth aspect of the present invention is directed to an image generation apparatus, connected through a communication network to at least one image pickup apparatus which is externally provided, capable of generating at least two types of map images. The image generation apparatus includes: a first generation section for generating a first map image representing a map of an external moving object and a vicinity of the external moving object; a point-of-view conversion processing section for acquiring a taken image from the image pickup apparatus in response to a request transmitted from the external moving object, and thereafter generating the point-of-view converted image by converting a point-of-view angle and a line-of-sight direction of the taken image having been acquired so as to match the point-of-view angle and the line-of-sight direction, respectively, of the first map image; and a second generation section for generating a second map image in which the point-of-view converted image generated by the point-of-view conversion processing section is superimposed on the first map image; and a transmission section for transmitting, to the external moving object, the second map image generated by the second generation section.
- According to each of the aspects, in the second map image, the direction and the point-of-view angle of the point-of-view converted image are converted so as to match the direction and the point-of-view angle, respectively, of the first map image, and therefore, when a user in a moving space views the second map image, the user is allowed to intuitively understand a content of the point-of-view converted image included in the second map image.
-
FIG. 1 is a block diagram illustrating an entire configuration of an image providing system according to a first embodiment of the present invention. -
FIG. 2 is a block diagram illustrating in detail a configuration of animage generation apparatus 2 shown inFIG. 1 . -
FIG. 3 is a block diagram illustrating in detail a configuration of animage display apparatus 3 shown inFIG. 1 . -
FIG. 4 is a flow chart illustrating process steps of each of theimage generation apparatus 2 and theimage display apparatus 3 shown inFIG. 1 . -
FIG. 5 is a schematic diagram illustrating an example of a first map image displayed in step S12 shown inFIG. 4 . -
FIG. 6 is a schematic diagram illustrating an example of a service point map image displayed in step S14 shown inFIG. 4 . -
FIG. 7 is a schematic diagram illustrating an example of a data structure of a point-of-view converted image request generated in step S16 shown inFIG. 4 . -
FIG. 8 is a schematic diagram illustrating an example of a second map image generated in step S18 shown inFIG. 4 . -
FIG. 9 is a schematic diagram illustrating another example of the second map image generated in step S18 shown inFIG. 4 . -
FIG. 10 is a schematic diagram illustrating still another example of the second map image generated in step S18 shown inFIG. 4 . -
FIG. 11 is a schematic diagram illustrating an example of a service point map image displayed in step S14 shown inFIG. 4 . -
- 1 image pickup apparatus
- 2 image generation apparatus
- 3 image display apparatus
- 4 communication network
- 21, 35 communication section
- 22, 32 storage device
- 23, 33 central processing section
- 31 input device
- 34 display section
-
FIG. 1 is a block diagram illustrating an entire configuration of an image providing system according to a first embodiment of the present invention. As shown inFIG. 1 , in the image providing system, at least oneimage pickup apparatus 1, animage generation apparatus 2, and animage display apparatus 3 are connected to each other through acommunication network 4 so as to communicate with each other. - The
image pickup apparatus 1 is provided in the vicinity of an actual road, takes an image of a state of the road from the point of view of a camera thereof, and transmits the taken image to thecommunication network 4. Next, an exemplary manner in which theimage pickup apparatus 1 is provided will be described. For example, as shown inFIG. 1 , theimage pickup apparatus 1 is provided above the center line of the road so as to be directed to both the up lane and the down lane of the road. In this case, theimage pickup apparatus 1 transmits, to thecommunication network 4, an image, taken from the point of view of the camera thereof, of states of both the lanes of the road. - The
image generation apparatus 2 is, for example, a server device on thecommunication network 4, and provides theimage display apparatus 3 with a point-of-view converted image. The point-of-view converted image will be described below in detail. - Here,
FIG. 2 is a block diagram illustrating in detail a configuration of theimage generation apparatus 2 shown inFIG. 1 . InFIG. 2 , theimage generation apparatus 2 comprises acommunication section 21, astorage device 22, and acentral processing section 23. - The
communication section 21 transmits, to thecentral processing section 23, various data transmitted through thecommunication network 4, and transmits, to thecommunication network 4, various data received from thecentral processing section 23. Thestorage device 22 stores a database for managing at least a point-of-view angle, a line-of-sight direction, a setting position, an image pickup position, and identification information of eachimage pickup apparatus 1 on thecommunication network 4, as shown inFIG. 2 . The point-of-view angle is an angle between an optical axis of theimage pickup apparatus 1 and a surface of the road, the line-of-sight direction represents a line-of-sight direction (corresponding to a compass direction) of theimage pickup apparatus 1 on the horizontal surface, and the image pickup position represents positional information relating to a road area taken by theimage pickup apparatus 1. - The
central processing section 23 typically includes a CPU, a ROM, and a RAM. The CPU executes a computer program previously stored in the ROM, by using the RAM as a work area. The processing performed by thecentral processing section 23 will be specifically described below with reference to a flow chart and the like. - The
image display apparatus 3 is typically an information terminal apparatus or a navigation apparatus mounted in a vehicle corresponding to a moving space, and is characterized by performing a process of requesting a point-of-view converted image from theimage generation apparatus 2, and combining (superimposing), with (on) a map image, the point-of-view converted image transmitted from theimage generation apparatus 2. - Here,
FIG. 3 is a block diagram illustrating in detail a configuration of theimage display apparatus 3 shown inFIG. 1 . InFIG. 3 , theimage display apparatus 3 comprises aninput device 31, astorage device 32, acentral processing section 33, adisplay section 34, and acommunication section 35. - The
input device 31 is, for example, a touch panel or a button to be operated by a user of theimage display apparatus 3. - The
storage device 32 stores a point database representing a collection of information with which identification of a point (hereinafter, referred to as an available point) at which theimage generation apparatus 2 is allowed to provide the point-of-view converted image is enabled, as shown inFIG. 3 . Thestorage device 32 further stores a map database representing a map of a predetermined area across, for example, Japan. The map data is structured such that the point-of-view angle of the map displayed on thedisplay section 34 is allowed to be changed in the up/down direction and/or in the right/left direction. Further, the map database is stored such that the direction for the map on a screen (hereinafter, referred to as a display screen) of thedisplay section 34 is changeable (such that the top of the map represents the north or the heading direction). - The
central processing section 33 typically includes a CPU, a ROM and a RAM. The CPU executes a computer program previously stored in the ROM, by using the RAM as a work area. The processing performed by thecentral processing section 33 will be specifically described below with reference to a flow chart and the like. - The
display section 34 displays various images generated by thecentral processing section 33. - The
communication section 35 transmits, to thecentral processing section 33, various data transmitted through thecommunication network 4, and transmits, to thecommunication network 4, various data received from thecentral processing section 33. - Next, the processing performed by the
image generation apparatus 2 and theimage display apparatus 3 as described above will be described in detail with reference to a flow chart shown inFIG. 4 . - Initially, the
central processing section 33 of theimage display apparatus 3 generates a first map image (step S11 inFIG. 4 ). Specifically, thecentral processing section 33 acquires the most recent position of a vehicle having theimage display apparatus 3 mounted therein by using an output from a GPS receiver and an autonomous navigation sensor not shown, and thereafter reads, from the map database in thestorage device 32, map data representing the most recent position and the vicinity thereof. Thecentral processing section 33 generates the first map image by using the read map data. Here, the direction and the point-of-view angle for the first map image having been generated are determined by a user operating theinput device 31 or are predetermined. - Reference map data generated in the above manner is transmitted from the
central processing section 33 to thedisplay section 34, and thedisplay section 34 displays, on the display screen, the first map image as shown inFIG. 5 (step S12). A route acquired through a well-known route search processing may be combined with the first map image. - Here, when the point-of-view converted image is to be displayed on the
display section 34, a user operates theinput device 31 in a predetermined manner. Theinput device 31 provides thecentral processing section 33 with a request of displaying the point-of-view converted image. When thecentral processing section 33 receives the request of displaying the point-of-view converted image as described above (step S13), thecentral processing section 33 generates a service point map (seeFIG. 6 ) on which a predetermined mark (hereinafter, referred to as an available point mark) is associated with the available point (step S14). InFIG. 6 , while the available point mark is represented as , the available point mark may be represented as, for example, a camera mark or an icon including an illustration of a camera so as to preferably allow a user to easily know that a video is provided. Further, when a lot of cameras are provided on the road so as to provide videos of the road in a series of areas, the available area may be displayed as shown inFIG. 11 . Further, at a time when the service point map is displayed, the direction for the map may be changed such that the top of the map represents the north. This is because, when the head of the map represents the heading direction, the direction for the map may be slightly different between at a time at which the point-of-view converted image is requested and at a time at which the point-of-view converted image is received, or it is necessary to change the direction of the point-of-view converted image each time the direction (the cardinal direction toward which the vehicle is heading) for the map is changed. - The process of step S14 will be specifically described. Initially, in the same manner as described above, the map data representing the most recent position and the vicinity thereof is read. The
central processing section 33 further reads, from the point database, available point information included in a range covered by the map data. Thecentral processing section 33 combines the available point mark with a point identified by the available point information having been read, in a map represented by the read map data, so as to generate the service point map. - The service point map (see
FIG. 6 ) as described above is transmitted from thecentral processing section 33 to thedisplay section 34, and displayed by the display section 34 (step S14). - In step S14, all the available points indicated by the available point information having been read may be displayed as a list. When the determination of step S13 is No, the process is returned to step S11.
- When the service point map image is displayed, a user designates an available point desired by the user by operating the
input device 31. Thus, the available point information having been designated is provided to the central processing section 33 (step S15). - Next, the
central processing section 33 generates information (hereinafter, referred to as a point-of-view converted image request) used for allowing theimage display apparatus 3 to request the point-of-view converted image from the image generation apparatus 2 (step S16). Here, the point-of-view converted image request includes identification information used for uniquely identifying each of theimage generation apparatus 2 and theimage display apparatus 3 on thecommunication network 4, information representing the direction and the point-of-view angle of the map having been most recently set, and the available point information acquired in step S15, as shown inFIG. 7 . - The point-of-view converted image request generated as describe above is transmitted to the
communication network 4 through the communication section 35 (step S16), transmitted over thecommunication network 4, and received by thecommunication section 21 of the image generation apparatus 2 (sequence SQ1 shown inFIG. 4 ). - When the
central processing section 23 of theimage generation apparatus 2 receives the point-of-view converted image request from the communication section 21 (step S21), thecentral processing section 23 generates a taken image request for requesting a taken image from theimage pickup apparatus 1 provided at the available point(s) represented by the point-of-view converted image request (step S22). Alternatively, thecentral processing section 23 may recognize the received available point as the image pickup position, and generate the taken image request for requesting the taken image. - The process of step S22 will be specifically described. The
central processing section 23 acquires, from the database (seeFIG. 2 ) of thestorage device 22, the identification information of theimage pickup apparatus 1 provided at the setting position represented by the available point information included in the point-of-view converted image request having been received. Thecentral processing section 23 generates the taken image request including the identification information having been acquired. - The taken image request generated as described above is transmitted to the
communication network 4 through the communication section 21 (step S22), and is received by theimage pickup apparatus 1 identified by the identification information included in the taken image request (sequence SQ2 shown inFIG. 4 ). Theimage pickup apparatus 1 generates the taken image as described above and transmits the taken image to theimage generation apparatus 2, in response to the reception of the taken image request (sequence SQ3). - When the
central processing section 23 of theimage generation apparatus 2 receives the taken image through the communication section 21 (step S23), thecentral processing section 23 performs the point-of-view conversion process for the taken image (step S24). - The process of step S24 will be specifically described. The
central processing section 23 acquires, from the database (seeFIG. 2 ) of thestorage device 22, the point-of-view angle and the line-of-sight direction of theimage pickup apparatus 1 from which the taken image having been most recently received has been transmitted. The point-of-view angle having been acquired is different from the point-of-view angle of the map having been most recently set by theimage display apparatus 2, and therefore thecentral processing section 23 changes the point-of-view angle of the taken image having been most recently taken, so as to match the point-of-view angle of the map. Thecentral processing section 23 further changes the direction, specified by the line-of-sight direction having been acquired, of the taken image in which the point-of-view has been converted, so as to match the direction for the map having been most recently set, thereby generating the point-of-view converted image. - The point-of-view converted image generated as described above is transmitted to the
communication network 4 through the communication section 21 (step S24), and is received by thecommunication section 35 of theimage display apparatus 3 from which the point-of-view converted image request has been transmitted (sequence SQ4 shown inFIG. 4 ). - When the
central processing section 33 of theimage display apparatus 3 receives the point-of-view converted image through the communication section 35 (step S17), a second map image in which the point-of-view converted image is combined with the first map image is generated (step S18). - The process of step S18 will be specifically described. The
central processing section 33 reads, from the map database of thestorage device 32, map data representing a point designated in step S15 and the vicinity thereof. Thecentral processing section 33 combines the point-of-view converted image having been most recently received, with the designated available point in the map image represented by the map data having been read, so as to generate the second map image shown inFIG. 8 . - While in an example shown in
FIG. 8 the point-of-view converted image is combined with the designated available point, the point-of-view converted image may be displayed at a position corresponding to the vicinity of the setting position of theimage pickup apparatus 1, or at a position corresponding to a position taken by the image pickup apparatus. As shown inFIG. 9 , the point-of-view converted image may be displayed so as to allow a user to recognize relationship with the designated available point. Further, theimage display apparatus 3 may be configured such that a user is allowed to change between generation of the second map image shown inFIG. 8 , and generation of that shown inFIG. 9 , by operating theinput device 31. - Further, as shown in
FIG. 10 , the point-of-view converted image may have triangle buttons at both ends thereof, and a position on the road displayed in the point-of-view converted image may be changed by pressing the triangle button. - The second map image generated as described above is transmitted from the
central processing section 33 to thedisplay section 34, and thedisplay section 34 displays the received second map image on the display screen (step S19). In the second map image as described above, the direction and the point-of-view angle of the point-of-view converted image match the direction and the point-of-view angle, respectively, of the map image, so that a user in a moving space is allowed to intuitively understand the content of the point-of-view converted image. - In the present embodiment, the point-of-view converted image including both lanes of the road is generated. However, the present invention is not restricted thereto, and when the
image display apparatus 3 notifies theimage generation apparatus 2 of the direction in which the vehicle is traveling, theimage generation apparatus 2 is allowed to recognize the direction in which the vehicle is traveling, and may generate an intermediate image including only the lane on which the vehicle is traveling, and may thereafter generate the point-of-view converted image as described above so as to provide theimage display apparatus 3 with the point-of-view converted image. Thus, theimage generation apparatus 2 is allowed to provide theimage display apparatus 3 with the point-of-view converted image obtained by changing a range covered by the point-of-view converted image in accordance with the direction in which the vehicle is traveling. In this case, theimage display apparatus 3 generates and displays the second map image in which the point-of-view converted image including only the lane on which the vehicle is traveling is superimposed on the first map image. Thus, a user is allowed to intuitively understand the state of the lane on which the vehicle is traveling and which is important to the user, without seeing the state of the opposing lane. - Further, following step S19, the process may be returned to step S11. However, when step S14 may be executed following step S19, a user is allowed to designate another available point, and the
image display apparatus 3 is allowed to acquire the point-of-view converted image including another point. Thus, the user is allowed to view another second map image. - Further, in the present embodiment, the first and the second map images are generated by the
image display apparatus 3. The present invention is not restricted thereto. The first and the second map images may be generated by theimage generation apparatus 2. In this case, theimage display apparatus 3 needs to transmit, to theimage generation apparatus 2, the information necessary for generation of the first and the second map images. Further, when theimage display apparatus 3 is capable of directly communicating with theimage pickup apparatus 1, the point-of-view conversion process performed by theimage generation apparatus 2 in the present embodiment may be performed by theimage display apparatus 3. Further, one of theimage generation apparatus 2 or theimage display apparatus 3 may automatically monitor a moving image at a point previously set by a user or a specific point (an intersection or a point, uploaded on the Internet, at which a congestion often occurs) on the set route, and measure traffic flow through image processing, and when, for example, a traffic situation changes due to, for example, a congestion occurring or a congestion being solved, it is possible to automatically display the image representing the point. Further, a point at which a congestion occurs may be checked while sequentially changing a point, on a set route, at which the moving image is automatically monitored, and further an image of a point which is not indicated by congestion information transmitted, for example, through an FM multiplex broadcasting and/or from a transmitter on a road included in a traffic information system (VICS (Vehicle Information and Communication System)), may be displayed. - The image display apparatus according to the present invention is useful for an in-vehicle information terminal apparatus, a navigation apparatus, and the like, through which a moving user needs to intuitively understand a map image. Further, the image generation apparatus according to the present invention is useful for a server apparatus and the like connected through a communication network to, for example, the information terminal apparatus, the navigation apparatus as described above.
Claims (10)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005254787A JP4207941B2 (en) | 2005-09-02 | 2005-09-02 | Image display device and image generation device |
JP2005-254787 | 2005-12-08 | ||
PCT/JP2006/317257 WO2007026839A1 (en) | 2005-09-02 | 2006-08-31 | Image display device and image generation device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090256906A1 true US20090256906A1 (en) | 2009-10-15 |
Family
ID=37808922
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/995,884 Abandoned US20090256906A1 (en) | 2005-09-02 | 2006-08-31 | Image display apparatus and image generation apparatus |
Country Status (5)
Country | Link |
---|---|
US (1) | US20090256906A1 (en) |
EP (1) | EP1921419A4 (en) |
JP (1) | JP4207941B2 (en) |
CN (1) | CN101243300A (en) |
WO (1) | WO2007026839A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150145951A1 (en) * | 2012-10-30 | 2015-05-28 | Thinkware Systems Corporation | Navigation guidance apparatus and method using wide-angle lens camera image |
US20180336426A1 (en) * | 2017-05-22 | 2018-11-22 | Toyota Jidosha Kabushiki Kaisha | Image processing system, image processing method, information processing device and recording medium |
US10527449B2 (en) * | 2017-04-10 | 2020-01-07 | Microsoft Technology Licensing, Llc | Using major route decision points to select traffic cameras for display |
US20210235165A1 (en) * | 2010-05-13 | 2021-07-29 | Rovi Guides, Inc. | Systems and methods for providing media content listings according to points of interest |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5022134B2 (en) * | 2007-07-31 | 2012-09-12 | 三菱重工業株式会社 | Traffic status display device |
JP5281421B2 (en) * | 2009-01-23 | 2013-09-04 | アルパイン株式会社 | In-vehicle system |
JP5402322B2 (en) | 2009-07-02 | 2014-01-29 | ソニー株式会社 | Information processing apparatus and information processing method |
JP5792424B2 (en) * | 2009-07-03 | 2015-10-14 | ソニー株式会社 | MAP INFORMATION DISPLAY DEVICE, MAP INFORMATION DISPLAY METHOD, AND PROGRAM |
US8825392B2 (en) | 2011-06-30 | 2014-09-02 | Navteq B.V. | Map view |
US20130162665A1 (en) * | 2011-12-21 | 2013-06-27 | James D. Lynch | Image view in mapping |
US9256983B2 (en) | 2012-06-28 | 2016-02-09 | Here Global B.V. | On demand image overlay |
US9256961B2 (en) | 2012-06-28 | 2016-02-09 | Here Global B.V. | Alternate viewpoint image enhancement |
US20150355463A1 (en) * | 2013-01-24 | 2015-12-10 | Sony Corporation | Image display apparatus, image display method, and image display system |
US9851299B2 (en) | 2014-10-25 | 2017-12-26 | Isle Management Co. | Method of analyzing air quality |
CN106204585A (en) * | 2016-07-05 | 2016-12-07 | 董超超 | A kind of video generation device registrated by Patch properties |
CN106157312A (en) * | 2016-07-05 | 2016-11-23 | 董超超 | A kind of image display device registrated by Patch properties |
CN108062864A (en) * | 2016-11-09 | 2018-05-22 | 奥迪股份公司 | A kind of traffic scene visualization system and method and vehicle for vehicle |
JP2019079475A (en) * | 2017-10-27 | 2019-05-23 | 大日本印刷株式会社 | Image reproduction system and image reproduction method |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6587784B1 (en) * | 1999-01-29 | 2003-07-01 | Hitachi, Ltd. | Stereoscopic map-display method and navigation system using the method |
US20030142115A1 (en) * | 2002-01-15 | 2003-07-31 | Takaaki Endo | Information processing apparatus and method |
US6768813B1 (en) * | 1999-06-16 | 2004-07-27 | Pentax Corporation | Photogrammetric image processing apparatus and method |
US20040246261A1 (en) * | 2003-06-03 | 2004-12-09 | Foundation Japan Construction Information Center | Map display device, map display system, map display method, and map display program product |
US7376510B1 (en) * | 2004-11-05 | 2008-05-20 | Navteq North America, Llc | Map display for a navigation system |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0935177A (en) * | 1995-07-18 | 1997-02-07 | Hitachi Ltd | Method and device for supporting driving |
JP3521180B2 (en) | 1997-11-28 | 2004-04-19 | 株式会社日立国際電気 | Display method and device of ITV system for monitoring a traffic point |
JP2002310687A (en) * | 2001-04-17 | 2002-10-23 | Denso Corp | Navigation device and program |
JP4078080B2 (en) * | 2002-01-15 | 2008-04-23 | キヤノン株式会社 | Information processing apparatus and method |
JP3877204B2 (en) * | 2002-04-05 | 2007-02-07 | 松下電器産業株式会社 | External image acquisition system and apparatus used therefor |
JP2004005493A (en) * | 2002-04-24 | 2004-01-08 | Vehicle Information & Communication System Center | Driver assist information transmitter, driver assist information receiver and driver assist information providing system |
JP4048292B2 (en) * | 2002-06-14 | 2008-02-20 | 松下電器産業株式会社 | Traffic information display system, captured image transmission device, in-vehicle information display device and storage medium |
JP4092479B2 (en) * | 2003-01-07 | 2008-05-28 | 日産自動車株式会社 | Vehicle driving support device |
US20050031169A1 (en) * | 2003-08-09 | 2005-02-10 | Alan Shulman | Birds eye view virtual imaging for real time composited wide field of view |
-
2005
- 2005-09-02 JP JP2005254787A patent/JP4207941B2/en not_active Expired - Fee Related
-
2006
- 2006-08-31 CN CNA2006800294210A patent/CN101243300A/en active Pending
- 2006-08-31 EP EP06797217A patent/EP1921419A4/en not_active Withdrawn
- 2006-08-31 WO PCT/JP2006/317257 patent/WO2007026839A1/en active Application Filing
- 2006-08-31 US US11/995,884 patent/US20090256906A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6587784B1 (en) * | 1999-01-29 | 2003-07-01 | Hitachi, Ltd. | Stereoscopic map-display method and navigation system using the method |
US6768813B1 (en) * | 1999-06-16 | 2004-07-27 | Pentax Corporation | Photogrammetric image processing apparatus and method |
US20030142115A1 (en) * | 2002-01-15 | 2003-07-31 | Takaaki Endo | Information processing apparatus and method |
US20040246261A1 (en) * | 2003-06-03 | 2004-12-09 | Foundation Japan Construction Information Center | Map display device, map display system, map display method, and map display program product |
US7376510B1 (en) * | 2004-11-05 | 2008-05-20 | Navteq North America, Llc | Map display for a navigation system |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210235165A1 (en) * | 2010-05-13 | 2021-07-29 | Rovi Guides, Inc. | Systems and methods for providing media content listings according to points of interest |
US11632593B2 (en) * | 2010-05-13 | 2023-04-18 | Rovi Guides, Inc. | Systems and methods for providing media content listings according to points of interest |
US20150145951A1 (en) * | 2012-10-30 | 2015-05-28 | Thinkware Systems Corporation | Navigation guidance apparatus and method using wide-angle lens camera image |
US10386199B2 (en) * | 2012-10-30 | 2019-08-20 | Thinkware Systems Corporation | Navigation guidance apparatus and method using wide-angle lens camera image |
US10527449B2 (en) * | 2017-04-10 | 2020-01-07 | Microsoft Technology Licensing, Llc | Using major route decision points to select traffic cameras for display |
US20180336426A1 (en) * | 2017-05-22 | 2018-11-22 | Toyota Jidosha Kabushiki Kaisha | Image processing system, image processing method, information processing device and recording medium |
US10740629B2 (en) * | 2017-05-22 | 2020-08-11 | Toyota Jidosha Kabushiki Kaisha | Image processing system, image processing method, information processing device and recording medium |
Also Published As
Publication number | Publication date |
---|---|
JP2007064924A (en) | 2007-03-15 |
EP1921419A1 (en) | 2008-05-14 |
CN101243300A (en) | 2008-08-13 |
EP1921419A4 (en) | 2011-09-07 |
WO2007026839A1 (en) | 2007-03-08 |
JP4207941B2 (en) | 2009-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20090256906A1 (en) | Image display apparatus and image generation apparatus | |
JP4454681B2 (en) | Traffic condition display method, traffic condition display system, in-vehicle device, and computer program | |
JP5052003B2 (en) | Information distribution system | |
US7693657B2 (en) | Navigation device | |
US6725154B2 (en) | Image display apparatus | |
US20070208507A1 (en) | Current position sensing system, map display system and current position sensing method | |
US20050209776A1 (en) | Navigation apparatus and intersection guidance method | |
US20150066364A1 (en) | Navigation system | |
JP2014133444A (en) | Cruise control device, method of the cruise control, and vehicle identification apparatus | |
EP3978291B1 (en) | Display system and vehicle | |
JP2013108830A (en) | Weather information processing system, weather information processing server, and information processing device | |
JP4800252B2 (en) | In-vehicle device and traffic information presentation method | |
JP2003085690A (en) | Live view device and live view system | |
KR20130052316A (en) | Navigation system for outputting actual image and outputting method using it | |
JP2020119131A (en) | Server, server control method, server control program, communication terminal, terminal control method, and terminal control program | |
JP2020009215A (en) | Image processing device and program | |
KR101689810B1 (en) | GPS system for connecting OBD and method of synchronizing data using same | |
KR20040034013A (en) | System and Method for Collection of Road Information Using Telematics Navigation System | |
JP4419725B2 (en) | Traffic information providing system, traffic information providing method, information providing apparatus, and in-vehicle information terminal | |
JP5082982B2 (en) | Car navigation system | |
JP2002286469A (en) | Traffic information acquiring system | |
KR101341750B1 (en) | Method and apparatus for providing road status | |
JP2013217808A (en) | On-vehicle apparatus | |
JP2019032793A (en) | Operation management device, operation management method, and operation management system | |
JP5104590B2 (en) | In-vehicle information terminal, information providing system, information providing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IISAKA, ATSUSHI;NISHIMURA, KENJI;MORI, TOSHIAKI;AND OTHERS;REEL/FRAME:020978/0558;SIGNING DATES FROM 20071214 TO 20071217 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION,JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021832/0215 Effective date: 20081001 Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021832/0215 Effective date: 20081001 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE |